Properties of a word-valued source with a non-prefix-free word set

Takashi Ishida, Masayuki Goto, Toshiyasu Matsushima, Shigeichi Hirasawa

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Recently, a word-valued source has been proposed as a new class of information source models. A word-valued source is regarded as a source with a probability distribution over a word set. Although a word-valued source is a nonstationary source in general, it has been proved that an entropy rate of the source exists and the Asymptotic Equipartition Property (AEP) holds when the word set of the source is prefix-free. However, when the word set is not prefix-free (non-prefix-free), only an upper bound on the entropy density rate for an i.i.d. word-valued source has been derived so far. In this paper, we newly derive a lower bound on the entropy density rate for an i.i.d. word-valued source with a finite non-prefix-free word set. Then some numerical examples are given in order to investigate the behavior of the bounds.

Original languageEnglish
Pages (from-to)3710-3723
Number of pages14
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE89-A
Issue number12
DOIs
Publication statusPublished - 2006 Dec

Keywords

  • Asymptotic Equipartition Property (AEP)
  • Entropy density rate
  • Entropy rate
  • Non-prefix-free
  • Word set
  • Word-valued source

ASJC Scopus subject areas

  • Signal Processing
  • Computer Graphics and Computer-Aided Design
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Properties of a word-valued source with a non-prefix-free word set'. Together they form a unique fingerprint.

  • Cite this