Foundations and Trends® in Communications and Information Theory > Vol 21 > Issue 6

Channel Simulation: Theory and Applications to Lossy Compression and Differential Privacy

By Cheuk Ting Li, The Chinese University of Hong Kong, China, ctli@ie.cuhk.edu.hk

 
Suggested Citation
Cheuk Ting Li (2024), "Channel Simulation: Theory and Applications to Lossy Compression and Differential Privacy", Foundations and TrendsĀ® in Communications and Information Theory: Vol. 21: No. 6, pp 847-1106. http://dx.doi.org/10.1561/0100000141

Publication Date: 17 Dec 2024
© 2024 C. T. Li
 
Subjects
Data compression,  Quantization,  Source coding,  Rate-distortion theory,  Privacy-preserving systems,  Privacy
 

Share

Download article
In this article:
Preface
Notations
1. Introduction and Motivations
2. The Channel Simulation Setting
3. One-shot Channel Simulation with Unlimited Common Randomness
4. One-shot Channel Simulation without Common Randomness
5. Asymptotic Channel Simulation with Unlimited Common Randomness
6. Asymptotic Channel Simulation without Common Randomness
7. Asymptotic Channel Simulation with Limited Common Randomness
8. One-shot Bounds for Fixed-Length Channel Simulation
9. Source and Channel Simulation with Limited Local Randomness
10. Other Settings
11. Conclusions and Future Directions
Acknowledgements
Appendices
References

Abstract

One-shot channel simulation (or channel synthesis) has seen increasing applications in lossy compression, differential privacy and machine learning. In this setting, an encoder observes a source X, and transmits a description to a decoder, so as to allow it to produce an output Y with a desired conditional distribution PY|X. In other words, the encoder and the decoder are simulating the noisy channel PY|X using noiseless communication. This can also be seen as a lossy compression scheme with a stronger guarantee on the joint distribution of X and Y. This monograph gives an overview of the theory and applications of the channel simulation problem. We will present a unifying review of various one-shot and asymptotic channel simulation techniques that have been proposed in different areas, namely dithered quantization, rejection sampling, minimal random coding, likelihood encoder, soft covering, Poisson functional representation, and dyadic decomposition.

DOI:10.1561/0100000141