Distributed Markov decision process in cooperative peer-to-peer repair for WWAN video broadcast

Zhi Liu, Gene Cheung, Yusheng Ji

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Error resilient video broadcast over Wireless Wide Area Networks (WWAN) remains difficult due to unavoidable packet losses (a result of the underlying unreliable and time-varying transmission medium) and unavailability of per-packet, per-user retransmissions (stemming from the well-known NAK implosion problem). Previous cooperative solutions for multi-homed devices listening to the same video broadcast call for local recovery via packet sharing: assuming peers are physically located more than one transmission wavelength apart, channels to the streaming source are statistically independent, and peers can exchange different subsets of received packets with neighbors via a secondary network like ad hoc Wireless Local Area Network (WLAN) to alleviate individual WWAN packet losses. While it is known that using structured network coding (SNC) to encode received packets before peer exchange can further improve packet repair performance, the decisions of who should send repair packets encoded in what SNC types at available transmission opportunities were not optimized in any formal way. In this paper, we propose a distributed decision making strategy based on Markov decision process (MDP), so that each peer can make locally optimal transmission decisions based on observations eavesdropped on the WLAN channel. Our proposed MDP is both computationally scalable and peer-adaptive, so that state transition probabilities in MDP can be appropriately estimated based on observed aggregate behavior of other peers. Experiments show that decisions made using our proposed MDP outperformed decisions made by a random scheme by at least 4dB in PSNR in received video quality.

Original languageEnglish
Title of host publicationProceedings - IEEE International Conference on Multimedia and Expo
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event2011 12th IEEE International Conference on Multimedia and Expo, ICME 2011 - Barcelona, Spain
Duration: 2011 Jul 112011 Jul 15

Other

Other2011 12th IEEE International Conference on Multimedia and Expo, ICME 2011
CountrySpain
CityBarcelona
Period11/7/1111/7/15

Keywords

  • cooperative peer-to-peer repair
  • Markov decision process
  • Wireless video streaming

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Distributed Markov decision process in cooperative peer-to-peer repair for WWAN video broadcast'. Together they form a unique fingerprint.

  • Cite this

    Liu, Z., Cheung, G., & Ji, Y. (2011). Distributed Markov decision process in cooperative peer-to-peer repair for WWAN video broadcast. In Proceedings - IEEE International Conference on Multimedia and Expo [6012176] https://doi.org/10.1109/ICME.2011.6012176