TY - GEN

T1 - Optimal rate allocation in multiterminal compress-and-estimate source coding

AU - Song, Ruiyang

AU - Rini, Stefano

AU - Kipnis, Alon

AU - Goldsmith, Andrea J.

N1 - Publisher Copyright:
© 2016 IEEE.

PY - 2016/10/21

Y1 - 2016/10/21

N2 - We consider a multiterminal source coding problem in which a source is estimated at a central processing unit from lossy-compressed remote observations. Each lossy-encoded observation is produced by a remote sensor. The sensor first obtains a noisy version of the source, then compresses this observation based on minimizing a local distortion measure that depends only on the marginal distribution of its observation. The central node, on the other hand, has knowledge of the joint distribution of the source and all the observations and produces the source estimate that minimizes a different distortion measure between the source and its reconstruction. In this paper, we investigate the problem of optimally choosing the rate of each lossy-compressed remote estimate so as to minimize the distortion at the central processor, subject to bound on the sum of the communication rate between the sensors and the central unit. We focus, in particular, on two models of practical relevance: the case of a Gaussian source observed in additive Gaussian noise and reconstructed under quadratic distortion, and the case of a binary source observed in bit-flipping noise and reconstructed under Hamming distortion. In both scenarios we show that there exist regimes under which having more remote encoders does not reduce the source distortion. In other words, having fewer, high-quality remote estimates provides a smaller distortion than having more, lower-quality estimates.

AB - We consider a multiterminal source coding problem in which a source is estimated at a central processing unit from lossy-compressed remote observations. Each lossy-encoded observation is produced by a remote sensor. The sensor first obtains a noisy version of the source, then compresses this observation based on minimizing a local distortion measure that depends only on the marginal distribution of its observation. The central node, on the other hand, has knowledge of the joint distribution of the source and all the observations and produces the source estimate that minimizes a different distortion measure between the source and its reconstruction. In this paper, we investigate the problem of optimally choosing the rate of each lossy-compressed remote estimate so as to minimize the distortion at the central processor, subject to bound on the sum of the communication rate between the sensors and the central unit. We focus, in particular, on two models of practical relevance: the case of a Gaussian source observed in additive Gaussian noise and reconstructed under quadratic distortion, and the case of a binary source observed in bit-flipping noise and reconstructed under Hamming distortion. In both scenarios we show that there exist regimes under which having more remote encoders does not reduce the source distortion. In other words, having fewer, high-quality remote estimates provides a smaller distortion than having more, lower-quality estimates.

KW - Binary source

KW - Binary symmetric channel

KW - CEO problem

KW - Gaussian source

KW - Remote source coding

UR - http://www.scopus.com/inward/record.url?scp=84998577645&partnerID=8YFLogxK

U2 - 10.1109/ITW.2016.7606806

DO - 10.1109/ITW.2016.7606806

M3 - Conference contribution

AN - SCOPUS:84998577645

T3 - 2016 IEEE Information Theory Workshop, ITW 2016

SP - 111

EP - 115

BT - 2016 IEEE Information Theory Workshop, ITW 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2016 IEEE Information Theory Workshop, ITW 2016

Y2 - 11 September 2016 through 14 September 2016

ER -