Evaluation of the minimum overflow threshold of bayes codes for a Markov source

Shota Saito, Nozomi Miya, Toshiyasu Matsushima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

The objective of this research is to evaluate the ε-minimum overflow threshold of the Bayes codes for a Markov source. In the lossless variable-length source coding problem, typical criteria are the mean codeword length and the overflow probability. The overflow probability is the probability with which a codeword length per source symbol exceeds a threshold and the ε-minimum overflow threshold is defined. In the non-universal setting, the Shannon code is optimal under the mean codeword length and the ε-minimum overflow threshold for the Shannon code is derived for an i.i.d. source. On the other hand, in the universal setting, the Bayes code is one of universal codes which minimize the mean codeword length under the Bayes criterion. However, few studies have been done on the overflow probability for the Bayes codes. In this paper, we assume a stationary ergodic finite order Markov source and derive the upper and lower bounds of the ε-minimum overflow threshold of the Bayes codes.

Original languageEnglish
Title of host publicationProceedings of 2014 International Symposium on Information Theory and Its Applications, ISITA 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages211-215
Number of pages5
ISBN (Electronic)9784885522925
Publication statusPublished - 2014 Dec 8
Event2014 International Symposium on Information Theory and Its Applications, ISITA 2014 - Melbourne, Australia
Duration: 2014 Oct 262014 Oct 29

Publication series

NameProceedings of 2014 International Symposium on Information Theory and Its Applications, ISITA 2014

Conference

Conference2014 International Symposium on Information Theory and Its Applications, ISITA 2014
Country/TerritoryAustralia
CityMelbourne
Period14/10/2614/10/29

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Cite this