An analysis of the difference of code lengths between two-step codes based on MDL principle and Bayes codes

Masayuki Goto, Toshiyasu Matsushima, Shigeichi Hirasawa

研究成果: Article査読

4 被引用数 (Scopus)

抄録

In this paper, we discuss the difference in code lengths between the code based on the minimum description length (MDL) principle (the MDL code) and the Bayes code under the condition that the same prior distribution is assumed for both codes. It is proved that the code length of the Bayes code is smaller than that of the MDL code by o(1) or O(1) for the discrete model class and by O(1) for the parametric model class. Because we can assume the same prior for the Bayes code as for the code based on the MDL principle, it is possible to construct the Bayes code with equal or smaller code length than the code based on the MDL principle. From the viewpoint of mean code length per symbol unit (compression rate), the Bayes code is asymptotically indistinguishable from the MDL two-stage codes.

本文言語English
ページ(範囲)927-944
ページ数18
ジャーナルIEEE Transactions on Information Theory
47
3
DOI
出版ステータスPublished - 2001 3

ASJC Scopus subject areas

  • 情報システム
  • コンピュータ サイエンスの応用
  • 図書館情報学

フィンガープリント

「An analysis of the difference of code lengths between two-step codes based on MDL principle and Bayes codes」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル