JET: Joint source and channel coding for error resilient virtual reality video wireless transmission

Zhi Liu, Susumu Ishihara, Ying Cui, Yusheng Ji, Yoshiaki Tanaka

    Research output: Contribution to journalArticle

    8 Citations (Scopus)

    Abstract

    Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance.

    Original languageEnglish
    Pages (from-to)154-162
    Number of pages9
    JournalSignal Processing
    Volume147
    DOIs
    Publication statusPublished - 2018 Jun 1

    Fingerprint

    Channel coding
    Virtual reality
    Tile
    Switches
    Partitions (building)
    Forward error correction
    Heuristic algorithms
    Packet loss
    Wireless networks
    Industry

    Keywords

    • 360 video
    • Error resilient
    • Source and channel coding
    • Video streaming
    • Virtual reality
    • VR

    ASJC Scopus subject areas

    • Control and Systems Engineering
    • Software
    • Signal Processing
    • Computer Vision and Pattern Recognition
    • Electrical and Electronic Engineering

    Cite this

    JET : Joint source and channel coding for error resilient virtual reality video wireless transmission. / Liu, Zhi; Ishihara, Susumu; Cui, Ying; Ji, Yusheng; Tanaka, Yoshiaki.

    In: Signal Processing, Vol. 147, 01.06.2018, p. 154-162.

    Research output: Contribution to journalArticle

    Liu, Zhi ; Ishihara, Susumu ; Cui, Ying ; Ji, Yusheng ; Tanaka, Yoshiaki. / JET : Joint source and channel coding for error resilient virtual reality video wireless transmission. In: Signal Processing. 2018 ; Vol. 147. pp. 154-162.
    @article{e0cc1fa271dd4b54bce153bcbaee98a4,
    title = "JET: Joint source and channel coding for error resilient virtual reality video wireless transmission",
    abstract = "Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance.",
    keywords = "360 video, Error resilient, Source and channel coding, Video streaming, Virtual reality, VR",
    author = "Zhi Liu and Susumu Ishihara and Ying Cui and Yusheng Ji and Yoshiaki Tanaka",
    year = "2018",
    month = "6",
    day = "1",
    doi = "10.1016/j.sigpro.2018.01.009",
    language = "English",
    volume = "147",
    pages = "154--162",
    journal = "Signal Processing",
    issn = "0165-1684",
    publisher = "Elsevier",

    }

    TY - JOUR

    T1 - JET

    T2 - Joint source and channel coding for error resilient virtual reality video wireless transmission

    AU - Liu, Zhi

    AU - Ishihara, Susumu

    AU - Cui, Ying

    AU - Ji, Yusheng

    AU - Tanaka, Yoshiaki

    PY - 2018/6/1

    Y1 - 2018/6/1

    N2 - Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance.

    AB - Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance.

    KW - 360 video

    KW - Error resilient

    KW - Source and channel coding

    KW - Video streaming

    KW - Virtual reality

    KW - VR

    UR - http://www.scopus.com/inward/record.url?scp=85041475455&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85041475455&partnerID=8YFLogxK

    U2 - 10.1016/j.sigpro.2018.01.009

    DO - 10.1016/j.sigpro.2018.01.009

    M3 - Article

    AN - SCOPUS:85041475455

    VL - 147

    SP - 154

    EP - 162

    JO - Signal Processing

    JF - Signal Processing

    SN - 0165-1684

    ER -