Unified distributed source coding frames for interactive multiview video streaming

Zhi Liu, Gene Cheung, Yusheng Ji

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)

Abstract

Because of differential coding used in standard video compression algorithms to exploit temporal correlation in adjacent frames for coding gain a frame lost in network will cause error propagation in subsequent frames at the decoder Previously proposed distributed source coding (DSC) frames can be periodically inserted to halt this error propagation by overcoming the uncertainty at encoder of which frames will be correctly received at decoder without resorting to large intra-coded I-frames In the case of interactive multiview video streaming (IMVS) where a user watches one of M available captured views at a time but can periodically select and switch to a neighboring view the encoder must encode multiview video to enable this view-switching interactivity without knowing the exact view trajectories taken by viewers at stream time In this paper we propose a unified DSC frame construction for IMVS so that the encoder can overcome both types of uncertainty in a coding-efficient manner; ie halt error propagation in differentially coded multiview video and facilitate periodic interactive view-switching at the same time Having the additional unified DSC frames we design a multiview frame structure to maximize the expected number of correctly decoded frames at decoder for a given bandwidth constraint We develop a fast algorithm to find locally optimal structure parameters and packetization and packet reordering strategies for transmission Experimental results show that our optimized frame structures using unified DSC frames outperform naïve structures using I- and P-frames only by up to 49% in fraction of correctly decoded frames under typical network condition

Original languageEnglish
Title of host publicationIEEE International Conference on Communications
Pages2048-2053
Number of pages6
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event2012 IEEE International Conference on Communications, ICC 2012 - Ottawa, ON, Canada
Duration: 2012 Jun 102012 Jun 15

Other

Other2012 IEEE International Conference on Communications, ICC 2012
CountryCanada
CityOttawa, ON
Period12/6/1012/6/15

Fingerprint

Video streaming
Watches
Image compression
Switches
Trajectories
Bandwidth
Uncertainty

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications

Cite this

Liu, Z., Cheung, G., & Ji, Y. (2012). Unified distributed source coding frames for interactive multiview video streaming. In IEEE International Conference on Communications (pp. 2048-2053). [6363933] https://doi.org/10.1109/ICC.2012.6363933

Unified distributed source coding frames for interactive multiview video streaming. / Liu, Zhi; Cheung, Gene; Ji, Yusheng.

IEEE International Conference on Communications. 2012. p. 2048-2053 6363933.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liu, Z, Cheung, G & Ji, Y 2012, Unified distributed source coding frames for interactive multiview video streaming. in IEEE International Conference on Communications., 6363933, pp. 2048-2053, 2012 IEEE International Conference on Communications, ICC 2012, Ottawa, ON, Canada, 12/6/10. https://doi.org/10.1109/ICC.2012.6363933
Liu Z, Cheung G, Ji Y. Unified distributed source coding frames for interactive multiview video streaming. In IEEE International Conference on Communications. 2012. p. 2048-2053. 6363933 https://doi.org/10.1109/ICC.2012.6363933
Liu, Zhi ; Cheung, Gene ; Ji, Yusheng. / Unified distributed source coding frames for interactive multiview video streaming. IEEE International Conference on Communications. 2012. pp. 2048-2053
@inproceedings{1fa2e8fb28574c6b918839e912ce3381,
title = "Unified distributed source coding frames for interactive multiview video streaming",
abstract = "Because of differential coding used in standard video compression algorithms to exploit temporal correlation in adjacent frames for coding gain a frame lost in network will cause error propagation in subsequent frames at the decoder Previously proposed distributed source coding (DSC) frames can be periodically inserted to halt this error propagation by overcoming the uncertainty at encoder of which frames will be correctly received at decoder without resorting to large intra-coded I-frames In the case of interactive multiview video streaming (IMVS) where a user watches one of M available captured views at a time but can periodically select and switch to a neighboring view the encoder must encode multiview video to enable this view-switching interactivity without knowing the exact view trajectories taken by viewers at stream time In this paper we propose a unified DSC frame construction for IMVS so that the encoder can overcome both types of uncertainty in a coding-efficient manner; ie halt error propagation in differentially coded multiview video and facilitate periodic interactive view-switching at the same time Having the additional unified DSC frames we design a multiview frame structure to maximize the expected number of correctly decoded frames at decoder for a given bandwidth constraint We develop a fast algorithm to find locally optimal structure parameters and packetization and packet reordering strategies for transmission Experimental results show that our optimized frame structures using unified DSC frames outperform na{\"i}ve structures using I- and P-frames only by up to 49{\%} in fraction of correctly decoded frames under typical network condition",
author = "Zhi Liu and Gene Cheung and Yusheng Ji",
year = "2012",
doi = "10.1109/ICC.2012.6363933",
language = "English",
isbn = "9781457720529",
pages = "2048--2053",
booktitle = "IEEE International Conference on Communications",

}

TY - GEN

T1 - Unified distributed source coding frames for interactive multiview video streaming

AU - Liu, Zhi

AU - Cheung, Gene

AU - Ji, Yusheng

PY - 2012

Y1 - 2012

N2 - Because of differential coding used in standard video compression algorithms to exploit temporal correlation in adjacent frames for coding gain a frame lost in network will cause error propagation in subsequent frames at the decoder Previously proposed distributed source coding (DSC) frames can be periodically inserted to halt this error propagation by overcoming the uncertainty at encoder of which frames will be correctly received at decoder without resorting to large intra-coded I-frames In the case of interactive multiview video streaming (IMVS) where a user watches one of M available captured views at a time but can periodically select and switch to a neighboring view the encoder must encode multiview video to enable this view-switching interactivity without knowing the exact view trajectories taken by viewers at stream time In this paper we propose a unified DSC frame construction for IMVS so that the encoder can overcome both types of uncertainty in a coding-efficient manner; ie halt error propagation in differentially coded multiview video and facilitate periodic interactive view-switching at the same time Having the additional unified DSC frames we design a multiview frame structure to maximize the expected number of correctly decoded frames at decoder for a given bandwidth constraint We develop a fast algorithm to find locally optimal structure parameters and packetization and packet reordering strategies for transmission Experimental results show that our optimized frame structures using unified DSC frames outperform naïve structures using I- and P-frames only by up to 49% in fraction of correctly decoded frames under typical network condition

AB - Because of differential coding used in standard video compression algorithms to exploit temporal correlation in adjacent frames for coding gain a frame lost in network will cause error propagation in subsequent frames at the decoder Previously proposed distributed source coding (DSC) frames can be periodically inserted to halt this error propagation by overcoming the uncertainty at encoder of which frames will be correctly received at decoder without resorting to large intra-coded I-frames In the case of interactive multiview video streaming (IMVS) where a user watches one of M available captured views at a time but can periodically select and switch to a neighboring view the encoder must encode multiview video to enable this view-switching interactivity without knowing the exact view trajectories taken by viewers at stream time In this paper we propose a unified DSC frame construction for IMVS so that the encoder can overcome both types of uncertainty in a coding-efficient manner; ie halt error propagation in differentially coded multiview video and facilitate periodic interactive view-switching at the same time Having the additional unified DSC frames we design a multiview frame structure to maximize the expected number of correctly decoded frames at decoder for a given bandwidth constraint We develop a fast algorithm to find locally optimal structure parameters and packetization and packet reordering strategies for transmission Experimental results show that our optimized frame structures using unified DSC frames outperform naïve structures using I- and P-frames only by up to 49% in fraction of correctly decoded frames under typical network condition

UR - http://www.scopus.com/inward/record.url?scp=84871992173&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871992173&partnerID=8YFLogxK

U2 - 10.1109/ICC.2012.6363933

DO - 10.1109/ICC.2012.6363933

M3 - Conference contribution

SN - 9781457720529

SP - 2048

EP - 2053

BT - IEEE International Conference on Communications

ER -