Adaptive energy-aware free viewpoint video transmission over wireless networks

Zhi Liu, Jingyun Feng, Yusheng Ji, Yongbing Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

As consumer-level cameras are becoming cheaper and cheaper, the scene of interest can now be captured by multiple cameras simultaneously from different viewpoints. By transmitting texture and depth maps of the views captured using two adjacent cameras, users can synthesize any view in between using depth image based rendering (DIBR) technique such as 3D-warping. This provides users with continuous view angles and is key technique for Free Viewpoint TV (FTV), etc. In this scenario, multiple views must be delivered through bandwidth-limited wireless networks, how to adaptive reduce the source coding rate to fit the bandwidth becomes an important issue. The standard multi-view video codec H.264 MVC explores the inter-view and intra-view correlation to reduce source encoding rate. But all views are required at the client side for decoding any single view, which is apparently not transmission efficient. A better solution is using H.264 to differentially encode the two adjacent views separately, but still this requires double-folder bandwidth comparing to the traditional video streaming. Multiple description coding (MDC) encodes one view into multiple descriptions for robust transmission. This inspires another option: sending only part of each view. This can greatly reduce the source encoding rate, but interpolating skipped frames before synthesizing the middle view consumes mobile devices' precious battery life. Whether to send at a lower source encoding rate but with extra energy consumption or send at a high source encoding rate is nontrivial, and has not been studied in any formal way. In this paper, we investigated both source encoding rate reduction and energy consumption with the bandwidth constraint. We formulated the problem into an optimization problem, i.e., maximizing the system utility, which is defined as the received video quality minus the weighted energy consumption. Simulation results showed that our proposed scheme provides a significant advantage over competing schemes in typical network conditions.

Original languageEnglish
Title of host publication2014 International Conference on Computing, Networking and Communications, ICNC 2014
PublisherIEEE Computer Society
Pages157-162
Number of pages6
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event2014 International Conference on Computing, Networking and Communications, ICNC 2014 - Honolulu, HI, United States
Duration: 2014 Feb 32014 Feb 6

Other

Other2014 International Conference on Computing, Networking and Communications, ICNC 2014
CountryUnited States
CityHonolulu, HI
Period14/2/314/2/6

Fingerprint

Wireless networks
Bandwidth
Energy utilization
Cameras
Video streaming
Mobile devices
Decoding
Textures

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Liu, Z., Feng, J., Ji, Y., & Zhang, Y. (2014). Adaptive energy-aware free viewpoint video transmission over wireless networks. In 2014 International Conference on Computing, Networking and Communications, ICNC 2014 (pp. 157-162). [6785323] IEEE Computer Society. https://doi.org/10.1109/ICCNC.2014.6785323

Adaptive energy-aware free viewpoint video transmission over wireless networks. / Liu, Zhi; Feng, Jingyun; Ji, Yusheng; Zhang, Yongbing.

2014 International Conference on Computing, Networking and Communications, ICNC 2014. IEEE Computer Society, 2014. p. 157-162 6785323.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liu, Z, Feng, J, Ji, Y & Zhang, Y 2014, Adaptive energy-aware free viewpoint video transmission over wireless networks. in 2014 International Conference on Computing, Networking and Communications, ICNC 2014., 6785323, IEEE Computer Society, pp. 157-162, 2014 International Conference on Computing, Networking and Communications, ICNC 2014, Honolulu, HI, United States, 14/2/3. https://doi.org/10.1109/ICCNC.2014.6785323
Liu Z, Feng J, Ji Y, Zhang Y. Adaptive energy-aware free viewpoint video transmission over wireless networks. In 2014 International Conference on Computing, Networking and Communications, ICNC 2014. IEEE Computer Society. 2014. p. 157-162. 6785323 https://doi.org/10.1109/ICCNC.2014.6785323
Liu, Zhi ; Feng, Jingyun ; Ji, Yusheng ; Zhang, Yongbing. / Adaptive energy-aware free viewpoint video transmission over wireless networks. 2014 International Conference on Computing, Networking and Communications, ICNC 2014. IEEE Computer Society, 2014. pp. 157-162
@inproceedings{9b4b76846d7e49208376afec89801f16,
title = "Adaptive energy-aware free viewpoint video transmission over wireless networks",
abstract = "As consumer-level cameras are becoming cheaper and cheaper, the scene of interest can now be captured by multiple cameras simultaneously from different viewpoints. By transmitting texture and depth maps of the views captured using two adjacent cameras, users can synthesize any view in between using depth image based rendering (DIBR) technique such as 3D-warping. This provides users with continuous view angles and is key technique for Free Viewpoint TV (FTV), etc. In this scenario, multiple views must be delivered through bandwidth-limited wireless networks, how to adaptive reduce the source coding rate to fit the bandwidth becomes an important issue. The standard multi-view video codec H.264 MVC explores the inter-view and intra-view correlation to reduce source encoding rate. But all views are required at the client side for decoding any single view, which is apparently not transmission efficient. A better solution is using H.264 to differentially encode the two adjacent views separately, but still this requires double-folder bandwidth comparing to the traditional video streaming. Multiple description coding (MDC) encodes one view into multiple descriptions for robust transmission. This inspires another option: sending only part of each view. This can greatly reduce the source encoding rate, but interpolating skipped frames before synthesizing the middle view consumes mobile devices' precious battery life. Whether to send at a lower source encoding rate but with extra energy consumption or send at a high source encoding rate is nontrivial, and has not been studied in any formal way. In this paper, we investigated both source encoding rate reduction and energy consumption with the bandwidth constraint. We formulated the problem into an optimization problem, i.e., maximizing the system utility, which is defined as the received video quality minus the weighted energy consumption. Simulation results showed that our proposed scheme provides a significant advantage over competing schemes in typical network conditions.",
author = "Zhi Liu and Jingyun Feng and Yusheng Ji and Yongbing Zhang",
year = "2014",
doi = "10.1109/ICCNC.2014.6785323",
language = "English",
pages = "157--162",
booktitle = "2014 International Conference on Computing, Networking and Communications, ICNC 2014",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Adaptive energy-aware free viewpoint video transmission over wireless networks

AU - Liu, Zhi

AU - Feng, Jingyun

AU - Ji, Yusheng

AU - Zhang, Yongbing

PY - 2014

Y1 - 2014

N2 - As consumer-level cameras are becoming cheaper and cheaper, the scene of interest can now be captured by multiple cameras simultaneously from different viewpoints. By transmitting texture and depth maps of the views captured using two adjacent cameras, users can synthesize any view in between using depth image based rendering (DIBR) technique such as 3D-warping. This provides users with continuous view angles and is key technique for Free Viewpoint TV (FTV), etc. In this scenario, multiple views must be delivered through bandwidth-limited wireless networks, how to adaptive reduce the source coding rate to fit the bandwidth becomes an important issue. The standard multi-view video codec H.264 MVC explores the inter-view and intra-view correlation to reduce source encoding rate. But all views are required at the client side for decoding any single view, which is apparently not transmission efficient. A better solution is using H.264 to differentially encode the two adjacent views separately, but still this requires double-folder bandwidth comparing to the traditional video streaming. Multiple description coding (MDC) encodes one view into multiple descriptions for robust transmission. This inspires another option: sending only part of each view. This can greatly reduce the source encoding rate, but interpolating skipped frames before synthesizing the middle view consumes mobile devices' precious battery life. Whether to send at a lower source encoding rate but with extra energy consumption or send at a high source encoding rate is nontrivial, and has not been studied in any formal way. In this paper, we investigated both source encoding rate reduction and energy consumption with the bandwidth constraint. We formulated the problem into an optimization problem, i.e., maximizing the system utility, which is defined as the received video quality minus the weighted energy consumption. Simulation results showed that our proposed scheme provides a significant advantage over competing schemes in typical network conditions.

AB - As consumer-level cameras are becoming cheaper and cheaper, the scene of interest can now be captured by multiple cameras simultaneously from different viewpoints. By transmitting texture and depth maps of the views captured using two adjacent cameras, users can synthesize any view in between using depth image based rendering (DIBR) technique such as 3D-warping. This provides users with continuous view angles and is key technique for Free Viewpoint TV (FTV), etc. In this scenario, multiple views must be delivered through bandwidth-limited wireless networks, how to adaptive reduce the source coding rate to fit the bandwidth becomes an important issue. The standard multi-view video codec H.264 MVC explores the inter-view and intra-view correlation to reduce source encoding rate. But all views are required at the client side for decoding any single view, which is apparently not transmission efficient. A better solution is using H.264 to differentially encode the two adjacent views separately, but still this requires double-folder bandwidth comparing to the traditional video streaming. Multiple description coding (MDC) encodes one view into multiple descriptions for robust transmission. This inspires another option: sending only part of each view. This can greatly reduce the source encoding rate, but interpolating skipped frames before synthesizing the middle view consumes mobile devices' precious battery life. Whether to send at a lower source encoding rate but with extra energy consumption or send at a high source encoding rate is nontrivial, and has not been studied in any formal way. In this paper, we investigated both source encoding rate reduction and energy consumption with the bandwidth constraint. We formulated the problem into an optimization problem, i.e., maximizing the system utility, which is defined as the received video quality minus the weighted energy consumption. Simulation results showed that our proposed scheme provides a significant advantage over competing schemes in typical network conditions.

UR - http://www.scopus.com/inward/record.url?scp=84899570092&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899570092&partnerID=8YFLogxK

U2 - 10.1109/ICCNC.2014.6785323

DO - 10.1109/ICCNC.2014.6785323

M3 - Conference contribution

AN - SCOPUS:84899570092

SP - 157

EP - 162

BT - 2014 International Conference on Computing, Networking and Communications, ICNC 2014

PB - IEEE Computer Society

ER -