### Abstract

The problem of distortionless encoding when the parameters of the probabilistic model of a source are unknown is considered from a statistical decision theory point of view. A class of predictive and nonpredictive codes is proposed that are optimal within this framework. Specifically, it is shown that the codeword length of the proposed predictive code coincides with that of the proposed nonpredictive code for any source sequence. A bound for the redundancy for universal coding is given in terms of the supremum of the Bayes risk. If this supremum exists, then there exists a minimax code whose mean code length approaches it in the proposed class of codes, and the minimax code is given by the Bayes solution relative to the prior distribution of the source parameters that maximizes the Bayes risk.

Original language | English |
---|---|

Pages (from-to) | 1288-1293 |

Number of pages | 6 |

Journal | IEEE Transactions on Information Theory |

Volume | 37 |

Issue number | 5 |

DOIs | |

Publication status | Published - 1991 Sep |

### Fingerprint

### Keywords

- Bayes principle
- Source coding
- and nonpredictive coding
- decision theory. universal code
- mean-code length
- minimax principle
- predictive coding

### ASJC Scopus subject areas

- Information Systems
- Computer Science Applications
- Library and Information Sciences