First- and second-order coding theorems for mixed memoryless channels with general mixture

Hideki Yagi, Te Sun Han, Ryo Nomura

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

This paper investigates the first- and second-order maximum achievable rates of codes with/without cost constraints for mixed channels whose channel law is characterized by a general mixture of (at most) uncountably many stationary and memoryless discrete channels. These channels are referred to as mixed memoryless channels with general mixture and include the class of mixed memoryless channels of finitely or countably memoryless channels as a special case. For the mixed memoryless channels with general mixture, the first-order coding theorem which gives a formula for the $\varepsilon $ -capacity is established, and then a direct part of the second-order coding theorem is provided. A subclass of mixed memoryless channels whose component channels can be ordered according to their capacity is introduced, and the first- and second-order coding theorems are established. It is shown that the established formulas reduce to several known formulas for restricted scenarios.

Original languageEnglish
Article number7479457
Pages (from-to)4395-4412
Number of pages18
JournalIEEE Transactions on Information Theory
Volume62
Issue number8
DOIs
Publication statusPublished - 2016 Aug 1
Externally publishedYes

Fingerprint

coding
scenario
Law
costs
Costs

Keywords

  • $\varepsilon $ -capacity
  • Channel coding
  • cost constraint
  • information spectrum
  • mixed channel
  • second-order coding rate

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this

First- and second-order coding theorems for mixed memoryless channels with general mixture. / Yagi, Hideki; Han, Te Sun; Nomura, Ryo.

In: IEEE Transactions on Information Theory, Vol. 62, No. 8, 7479457, 01.08.2016, p. 4395-4412.

Research output: Contribution to journalArticle

@article{eef581156b4b4b12bde5913d2ce3799e,
title = "First- and second-order coding theorems for mixed memoryless channels with general mixture",
abstract = "This paper investigates the first- and second-order maximum achievable rates of codes with/without cost constraints for mixed channels whose channel law is characterized by a general mixture of (at most) uncountably many stationary and memoryless discrete channels. These channels are referred to as mixed memoryless channels with general mixture and include the class of mixed memoryless channels of finitely or countably memoryless channels as a special case. For the mixed memoryless channels with general mixture, the first-order coding theorem which gives a formula for the $\varepsilon $ -capacity is established, and then a direct part of the second-order coding theorem is provided. A subclass of mixed memoryless channels whose component channels can be ordered according to their capacity is introduced, and the first- and second-order coding theorems are established. It is shown that the established formulas reduce to several known formulas for restricted scenarios.",
keywords = "$\varepsilon $ -capacity, Channel coding, cost constraint, information spectrum, mixed channel, second-order coding rate",
author = "Hideki Yagi and Han, {Te Sun} and Ryo Nomura",
year = "2016",
month = "8",
day = "1",
doi = "10.1109/TIT.2016.2573310",
language = "English",
volume = "62",
pages = "4395--4412",
journal = "IEEE Transactions on Information Theory",
issn = "0018-9448",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "8",

}

TY - JOUR

T1 - First- and second-order coding theorems for mixed memoryless channels with general mixture

AU - Yagi, Hideki

AU - Han, Te Sun

AU - Nomura, Ryo

PY - 2016/8/1

Y1 - 2016/8/1

N2 - This paper investigates the first- and second-order maximum achievable rates of codes with/without cost constraints for mixed channels whose channel law is characterized by a general mixture of (at most) uncountably many stationary and memoryless discrete channels. These channels are referred to as mixed memoryless channels with general mixture and include the class of mixed memoryless channels of finitely or countably memoryless channels as a special case. For the mixed memoryless channels with general mixture, the first-order coding theorem which gives a formula for the $\varepsilon $ -capacity is established, and then a direct part of the second-order coding theorem is provided. A subclass of mixed memoryless channels whose component channels can be ordered according to their capacity is introduced, and the first- and second-order coding theorems are established. It is shown that the established formulas reduce to several known formulas for restricted scenarios.

AB - This paper investigates the first- and second-order maximum achievable rates of codes with/without cost constraints for mixed channels whose channel law is characterized by a general mixture of (at most) uncountably many stationary and memoryless discrete channels. These channels are referred to as mixed memoryless channels with general mixture and include the class of mixed memoryless channels of finitely or countably memoryless channels as a special case. For the mixed memoryless channels with general mixture, the first-order coding theorem which gives a formula for the $\varepsilon $ -capacity is established, and then a direct part of the second-order coding theorem is provided. A subclass of mixed memoryless channels whose component channels can be ordered according to their capacity is introduced, and the first- and second-order coding theorems are established. It is shown that the established formulas reduce to several known formulas for restricted scenarios.

KW - $\varepsilon $ -capacity

KW - Channel coding

KW - cost constraint

KW - information spectrum

KW - mixed channel

KW - second-order coding rate

UR - http://www.scopus.com/inward/record.url?scp=84978719312&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978719312&partnerID=8YFLogxK

U2 - 10.1109/TIT.2016.2573310

DO - 10.1109/TIT.2016.2573310

M3 - Article

VL - 62

SP - 4395

EP - 4412

JO - IEEE Transactions on Information Theory

JF - IEEE Transactions on Information Theory

SN - 0018-9448

IS - 8

M1 - 7479457

ER -