Light-weight video coding based on perceptual video quality for live streaming

Yusuke Sakamoto, Shintaro Saika, Masaru Takeuchi, Tatsuya Nagashima, Zhengxue Cheng, Kenji Kanai, Jiro Katto, Kaijin Wei, Ju Zengwei, Xu Wei

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In video streaming on the internet, effective encoding recipes (i.e. bitrate-resolution pairs) are a main obstacle to deliver high-quality video streams. We developed a method to generate an encoding recipe that considers subjective visual quality with one just-noticeable difference (JND) distance. However, this method requires excessive computation time, which is not directly applicable for live streaming. In this paper, in order to provide a light-weight method for live streaming, we developed three acceleration techniques: resolution extrapolation, VMAF skipping and sampled objective measure calculation. These techniques are heuristic, but greatly contribute to reducing computational cost. Experimental results demonstrate that the proposed method achieves a significant reduction in computation time without significant effects on rate-JND characteristics.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages139-142
Number of pages4
ISBN (Electronic)9781538668573
DOIs
Publication statusPublished - 2019 Jan 4
Event20th IEEE International Symposium on Multimedia, ISM 2018 - Taichung, Taiwan, Province of China
Duration: 2018 Dec 102018 Dec 12

Publication series

NameProceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018

Conference

Conference20th IEEE International Symposium on Multimedia, ISM 2018
CountryTaiwan, Province of China
CityTaichung
Period18/12/1018/12/12

Fingerprint

Image coding
Video streaming
Extrapolation
Internet
Costs

Keywords

  • Adaptive video coding
  • Computation time
  • JND
  • Live streaming
  • Perceptual video quality

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology

Cite this

Sakamoto, Y., Saika, S., Takeuchi, M., Nagashima, T., Cheng, Z., Kanai, K., ... Wei, X. (2019). Light-weight video coding based on perceptual video quality for live streaming. In Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018 (pp. 139-142). [8603274] (Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISM.2018.00033

Light-weight video coding based on perceptual video quality for live streaming. / Sakamoto, Yusuke; Saika, Shintaro; Takeuchi, Masaru; Nagashima, Tatsuya; Cheng, Zhengxue; Kanai, Kenji; Katto, Jiro; Wei, Kaijin; Zengwei, Ju; Wei, Xu.

Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 139-142 8603274 (Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sakamoto, Y, Saika, S, Takeuchi, M, Nagashima, T, Cheng, Z, Kanai, K, Katto, J, Wei, K, Zengwei, J & Wei, X 2019, Light-weight video coding based on perceptual video quality for live streaming. in Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018., 8603274, Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018, Institute of Electrical and Electronics Engineers Inc., pp. 139-142, 20th IEEE International Symposium on Multimedia, ISM 2018, Taichung, Taiwan, Province of China, 18/12/10. https://doi.org/10.1109/ISM.2018.00033
Sakamoto Y, Saika S, Takeuchi M, Nagashima T, Cheng Z, Kanai K et al. Light-weight video coding based on perceptual video quality for live streaming. In Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 139-142. 8603274. (Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018). https://doi.org/10.1109/ISM.2018.00033
Sakamoto, Yusuke ; Saika, Shintaro ; Takeuchi, Masaru ; Nagashima, Tatsuya ; Cheng, Zhengxue ; Kanai, Kenji ; Katto, Jiro ; Wei, Kaijin ; Zengwei, Ju ; Wei, Xu. / Light-weight video coding based on perceptual video quality for live streaming. Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 139-142 (Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018).
@inproceedings{30a05bc606624bae9126c722dab60140,
title = "Light-weight video coding based on perceptual video quality for live streaming",
abstract = "In video streaming on the internet, effective encoding recipes (i.e. bitrate-resolution pairs) are a main obstacle to deliver high-quality video streams. We developed a method to generate an encoding recipe that considers subjective visual quality with one just-noticeable difference (JND) distance. However, this method requires excessive computation time, which is not directly applicable for live streaming. In this paper, in order to provide a light-weight method for live streaming, we developed three acceleration techniques: resolution extrapolation, VMAF skipping and sampled objective measure calculation. These techniques are heuristic, but greatly contribute to reducing computational cost. Experimental results demonstrate that the proposed method achieves a significant reduction in computation time without significant effects on rate-JND characteristics.",
keywords = "Adaptive video coding, Computation time, JND, Live streaming, Perceptual video quality",
author = "Yusuke Sakamoto and Shintaro Saika and Masaru Takeuchi and Tatsuya Nagashima and Zhengxue Cheng and Kenji Kanai and Jiro Katto and Kaijin Wei and Ju Zengwei and Xu Wei",
year = "2019",
month = "1",
day = "4",
doi = "10.1109/ISM.2018.00033",
language = "English",
series = "Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "139--142",
booktitle = "Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018",

}

TY - GEN

T1 - Light-weight video coding based on perceptual video quality for live streaming

AU - Sakamoto, Yusuke

AU - Saika, Shintaro

AU - Takeuchi, Masaru

AU - Nagashima, Tatsuya

AU - Cheng, Zhengxue

AU - Kanai, Kenji

AU - Katto, Jiro

AU - Wei, Kaijin

AU - Zengwei, Ju

AU - Wei, Xu

PY - 2019/1/4

Y1 - 2019/1/4

N2 - In video streaming on the internet, effective encoding recipes (i.e. bitrate-resolution pairs) are a main obstacle to deliver high-quality video streams. We developed a method to generate an encoding recipe that considers subjective visual quality with one just-noticeable difference (JND) distance. However, this method requires excessive computation time, which is not directly applicable for live streaming. In this paper, in order to provide a light-weight method for live streaming, we developed three acceleration techniques: resolution extrapolation, VMAF skipping and sampled objective measure calculation. These techniques are heuristic, but greatly contribute to reducing computational cost. Experimental results demonstrate that the proposed method achieves a significant reduction in computation time without significant effects on rate-JND characteristics.

AB - In video streaming on the internet, effective encoding recipes (i.e. bitrate-resolution pairs) are a main obstacle to deliver high-quality video streams. We developed a method to generate an encoding recipe that considers subjective visual quality with one just-noticeable difference (JND) distance. However, this method requires excessive computation time, which is not directly applicable for live streaming. In this paper, in order to provide a light-weight method for live streaming, we developed three acceleration techniques: resolution extrapolation, VMAF skipping and sampled objective measure calculation. These techniques are heuristic, but greatly contribute to reducing computational cost. Experimental results demonstrate that the proposed method achieves a significant reduction in computation time without significant effects on rate-JND characteristics.

KW - Adaptive video coding

KW - Computation time

KW - JND

KW - Live streaming

KW - Perceptual video quality

UR - http://www.scopus.com/inward/record.url?scp=85061628402&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061628402&partnerID=8YFLogxK

U2 - 10.1109/ISM.2018.00033

DO - 10.1109/ISM.2018.00033

M3 - Conference contribution

T3 - Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018

SP - 139

EP - 142

BT - Proceedings - 2018 IEEE International Symposium on Multimedia, ISM 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -