mlsanityData to 7 Oct 2026

The Rate-Distortion-Perception-Classification Tradeoff: Joint Source Coding and Modulation via Inverse-Domain GANs

arXiv 2312.14792 ↗First posted 22 Dec 2023cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The joint source-channel coding (JSCC) framework leverages deep learning to learn from data the best codes for source and channel coding. When the output signal, rather than being binary, is directly mapped onto the IQ domain (complex-valued), we call the resulting framework joint source coding and modulation (JSCM). We consider a JSCM scenario and show the existence of a strict tradeoff between channel rate, distortion, perception, and classification accuracy, a tradeoff that we name RDPC. We then propose two image compression methods to navigate that tradeoff: the RDPCO algorithm which, under simple assumptions, directly solves the optimization problem characterizing the tradeoff, and an algorithm based on an inverse-domain generative adversarial network (ID-GAN), which is more general and achieves extreme compression. Simulation results corroborate the theoretical findings, showing that both algorithms exhibit the RDPC tradeoff. They also demonstrate that the proposed ID-GAN algorithm effectively balances image distortion, perception, and classification accuracy, and significantly outperforms traditional separation-based methods and recent deep JSCM architectures in terms of one or more of these metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 22 Dec 2023.

Builds on

24 of 45 references.

References · 24

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2013Auto-Encoding Variational Bayescited by 3,980
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  6. 2021Convex optimizationcited by 2,479
  7. 2017Improved Training of Wasserstein GANscited by 2,223
  8. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
  9. 2017The Perception-Distortion Tradeoffcited by 582
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  12. 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 213
12 more
  1. 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 207
  2. 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
  3. 2021Semantic Communication Systems for Speech Transmissioncited by 93
  4. 2018Deep Learning for Joint Source-Channel Coding of Textcited by 68
  5. 2020Wireless Image Retrieval at the Edgecited by 57
  6. 2022Generative Joint Source-Channel Coding for Semantic Image Transmissioncited by 55
  7. 2020Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Codingcited by 42
  8. 2021On Perceptual Lossy Compression: The Cost of Perceptual Reconstruction and An Optimal Training Frameworkcited by 27
  9. 2021Deep Joint Source Channel Coding for WirelessImage Transmission with OFDMcited by 22
  10. 2019On The Classification-Distortion-Perception Tradeoffcited by 21
  11. 2022Deep Joint Source-Channel Coding for CSI Feedback: An End-to-End Approachcited by 13
  12. 2023Cooperative Task-Oriented Communication for Multi-Modal Data with Transmission Controlcited by 3

Built on by

Not cited yet.