Collaborative Wireless Freeview Video Streaming with Network Coding

Bo Zhang, Zhi Liu, S. H Gary Chan, Gene Cheung

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Free viewpoint video (FVV) offers compelling interactive experience by allowing users to switch to any viewing angle at any time. An FVV is composed of a large number of camera-captured anchor views, with virtual views (not captured by any camera) rendered from their nearby anchors using techniques such as depth-image-based rendering (DIBR). We consider a group of wireless users who may interact with an FVV by independently switching views. We study a novel live FVV streaming network where each user pulls a subset of anchors from the server via a primary channel. To enhance anchor availability at each user, a user generates network-coded (NC) packets using some of its anchors and broadcasts them to its direct neighbors via a secondary channel. Given limited primary and secondary channel bandwidths at the devices, we seek to maximize the received video quality (i.e., minimize distortion) by jointly optimizing the set of anchors each device pulls and the anchor combination to generate NC packets. To our best knowledge, this is among the first body of work addressing such joint optimization problem for wireless live FVV streaming with NC-based collaboration. We first formulate the problem and show that it is NP-hard. We then propose a scalable and effective algorithm called PAFV (Peer-Assisted Freeview Video). In PAFV, each node collaboratively and distributedly decides on the anchors to pull and NC packets to share so as to minimize video distortion in its neighborhood. Extensive simulation studies show that PAFV outperforms other algorithms, achieving substantially lower video distortion (often by more than 20-50%) with significantly less redundancy (by as much as 70%). Our Android-based video experiment further confirms the effectiveness of PAFV over comparison schemes.

Original languageEnglish
Article number7384509
Pages (from-to)521-536
Number of pages16
JournalIEEE Transactions on Multimedia
Volume18
Issue number3
DOIs
Publication statusPublished - 2016 Mar 1

Fingerprint

Network coding
Video streaming
Anchors
Packet networks
Cameras
Redundancy
Servers
Switches
Availability
Bandwidth

Keywords

  • Distributed computing
  • multimedia computing
  • wireless networks

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Signal Processing
  • Media Technology
  • Computer Science Applications

Cite this

Collaborative Wireless Freeview Video Streaming with Network Coding. / Zhang, Bo; Liu, Zhi; Chan, S. H Gary; Cheung, Gene.

In: IEEE Transactions on Multimedia, Vol. 18, No. 3, 7384509, 01.03.2016, p. 521-536.

Research output: Contribution to journalArticle

Zhang, Bo ; Liu, Zhi ; Chan, S. H Gary ; Cheung, Gene. / Collaborative Wireless Freeview Video Streaming with Network Coding. In: IEEE Transactions on Multimedia. 2016 ; Vol. 18, No. 3. pp. 521-536.
@article{8eb4e72b180a46f3ade9a9829a5e6ff6,
title = "Collaborative Wireless Freeview Video Streaming with Network Coding",
abstract = "Free viewpoint video (FVV) offers compelling interactive experience by allowing users to switch to any viewing angle at any time. An FVV is composed of a large number of camera-captured anchor views, with virtual views (not captured by any camera) rendered from their nearby anchors using techniques such as depth-image-based rendering (DIBR). We consider a group of wireless users who may interact with an FVV by independently switching views. We study a novel live FVV streaming network where each user pulls a subset of anchors from the server via a primary channel. To enhance anchor availability at each user, a user generates network-coded (NC) packets using some of its anchors and broadcasts them to its direct neighbors via a secondary channel. Given limited primary and secondary channel bandwidths at the devices, we seek to maximize the received video quality (i.e., minimize distortion) by jointly optimizing the set of anchors each device pulls and the anchor combination to generate NC packets. To our best knowledge, this is among the first body of work addressing such joint optimization problem for wireless live FVV streaming with NC-based collaboration. We first formulate the problem and show that it is NP-hard. We then propose a scalable and effective algorithm called PAFV (Peer-Assisted Freeview Video). In PAFV, each node collaboratively and distributedly decides on the anchors to pull and NC packets to share so as to minimize video distortion in its neighborhood. Extensive simulation studies show that PAFV outperforms other algorithms, achieving substantially lower video distortion (often by more than 20-50{\%}) with significantly less redundancy (by as much as 70{\%}). Our Android-based video experiment further confirms the effectiveness of PAFV over comparison schemes.",
keywords = "Distributed computing, multimedia computing, wireless networks",
author = "Bo Zhang and Zhi Liu and Chan, {S. H Gary} and Gene Cheung",
year = "2016",
month = "3",
day = "1",
doi = "10.1109/TMM.2016.2518485",
language = "English",
volume = "18",
pages = "521--536",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Collaborative Wireless Freeview Video Streaming with Network Coding

AU - Zhang, Bo

AU - Liu, Zhi

AU - Chan, S. H Gary

AU - Cheung, Gene

PY - 2016/3/1

Y1 - 2016/3/1

N2 - Free viewpoint video (FVV) offers compelling interactive experience by allowing users to switch to any viewing angle at any time. An FVV is composed of a large number of camera-captured anchor views, with virtual views (not captured by any camera) rendered from their nearby anchors using techniques such as depth-image-based rendering (DIBR). We consider a group of wireless users who may interact with an FVV by independently switching views. We study a novel live FVV streaming network where each user pulls a subset of anchors from the server via a primary channel. To enhance anchor availability at each user, a user generates network-coded (NC) packets using some of its anchors and broadcasts them to its direct neighbors via a secondary channel. Given limited primary and secondary channel bandwidths at the devices, we seek to maximize the received video quality (i.e., minimize distortion) by jointly optimizing the set of anchors each device pulls and the anchor combination to generate NC packets. To our best knowledge, this is among the first body of work addressing such joint optimization problem for wireless live FVV streaming with NC-based collaboration. We first formulate the problem and show that it is NP-hard. We then propose a scalable and effective algorithm called PAFV (Peer-Assisted Freeview Video). In PAFV, each node collaboratively and distributedly decides on the anchors to pull and NC packets to share so as to minimize video distortion in its neighborhood. Extensive simulation studies show that PAFV outperforms other algorithms, achieving substantially lower video distortion (often by more than 20-50%) with significantly less redundancy (by as much as 70%). Our Android-based video experiment further confirms the effectiveness of PAFV over comparison schemes.

AB - Free viewpoint video (FVV) offers compelling interactive experience by allowing users to switch to any viewing angle at any time. An FVV is composed of a large number of camera-captured anchor views, with virtual views (not captured by any camera) rendered from their nearby anchors using techniques such as depth-image-based rendering (DIBR). We consider a group of wireless users who may interact with an FVV by independently switching views. We study a novel live FVV streaming network where each user pulls a subset of anchors from the server via a primary channel. To enhance anchor availability at each user, a user generates network-coded (NC) packets using some of its anchors and broadcasts them to its direct neighbors via a secondary channel. Given limited primary and secondary channel bandwidths at the devices, we seek to maximize the received video quality (i.e., minimize distortion) by jointly optimizing the set of anchors each device pulls and the anchor combination to generate NC packets. To our best knowledge, this is among the first body of work addressing such joint optimization problem for wireless live FVV streaming with NC-based collaboration. We first formulate the problem and show that it is NP-hard. We then propose a scalable and effective algorithm called PAFV (Peer-Assisted Freeview Video). In PAFV, each node collaboratively and distributedly decides on the anchors to pull and NC packets to share so as to minimize video distortion in its neighborhood. Extensive simulation studies show that PAFV outperforms other algorithms, achieving substantially lower video distortion (often by more than 20-50%) with significantly less redundancy (by as much as 70%). Our Android-based video experiment further confirms the effectiveness of PAFV over comparison schemes.

KW - Distributed computing

KW - multimedia computing

KW - wireless networks

UR - http://www.scopus.com/inward/record.url?scp=84962261526&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962261526&partnerID=8YFLogxK

U2 - 10.1109/TMM.2016.2518485

DO - 10.1109/TMM.2016.2518485

M3 - Article

VL - 18

SP - 521

EP - 536

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 3

M1 - 7384509

ER -