TY - JOUR
T1 - Generalized source coding theorems and hypothesis testing
T2 - Part I — Information measures
AU - Chen, Po-Ning
AU - Alajaji, Fady
PY - 1998/1/1
Y1 - 1998/1/1
N2 - Expressions for ϵ-entropy rate, ϵ-mutual information rate and ϵ-divergence rate are introduced. These quantities, which consist of the quantiles of the asymptotic information spectra, generalize the inf/sup-entropy/information/divergence rates of Han and Verdú. The algebraic properties of these information measures are rigorously analyzed, and examples illustrating their use in the computation of the e-capacity are presented. In Part II of this work, these measures are employed to prove general source coding theorems for block codes, and the general formula of the Neyman-Pearson hypothesis testing type-II error exponent subject to upper bounds on the type-I error probability.
AB - Expressions for ϵ-entropy rate, ϵ-mutual information rate and ϵ-divergence rate are introduced. These quantities, which consist of the quantiles of the asymptotic information spectra, generalize the inf/sup-entropy/information/divergence rates of Han and Verdú. The algebraic properties of these information measures are rigorously analyzed, and examples illustrating their use in the computation of the e-capacity are presented. In Part II of this work, these measures are employed to prove general source coding theorems for block codes, and the general formula of the Neyman-Pearson hypothesis testing type-II error exponent subject to upper bounds on the type-I error probability.
KW - Divergence, e-capacity
KW - Entropy
KW - Information theory
KW - Mutual information
UR - http://www.scopus.com/inward/record.url?scp=0032071817&partnerID=8YFLogxK
U2 - 10.1080/02533839.1998.9670392
DO - 10.1080/02533839.1998.9670392
M3 - Article
AN - SCOPUS:0032071817
SN - 0253-3839
VL - 21
SP - 283
EP - 292
JO - Journal of the Chinese Institute of Engineers, Transactions of the Chinese Institute of Engineers,Series A/Chung-kuo Kung Ch'eng Hsuch K'an
JF - Journal of the Chinese Institute of Engineers, Transactions of the Chinese Institute of Engineers,Series A/Chung-kuo Kung Ch'eng Hsuch K'an
IS - 3
ER -