JET: Joint source and channel coding for error resilient virtual reality video wireless transmission

Zhi Liu, Susumu Ishihara, Ying Cui, Yusheng Ji, Yoshiaki Tanaka

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)

Abstract

Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance.

Original languageEnglish
Pages (from-to)154-162
Number of pages9
JournalSignal Processing
Volume147
DOIs
Publication statusPublished - 2018 Jun

Keywords

  • 360 video
  • Error resilient
  • Source and channel coding
  • VR
  • Video streaming
  • Virtual reality

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'JET: Joint source and channel coding for error resilient virtual reality video wireless transmission'. Together they form a unique fingerprint.

Cite this