A Synonymous Variational Perspective on the Rate-Distortion-Perception Tradeoff
Not on the map. Why?
Abstract (arXiv)
The fundamental limit of natural signal compression has traditionally been characterized by classical rate-distortion (RD) theory through the tradeoff between coding rate and reconstruction distortion, while the rate-distortion-perception (RDP) framework introduces a divergence-based measure of perceptual quality as a modeling principle, leaving its theoretical origin unclear. In this paper, motivated by a synonymity-based semantic information perspective, we reformulate perceptual reconstruction as recovering any admissible sample within an ideal synonymous set (synset) associated with the source, rather than the source sample itself, and establish a synonymous source coding architecture. On this basis, we develop a synonymous variational inference (SVI) analysis framework with a synonymous variational lower bound (SVLBO) for tractable analysis of synset-oriented compression. Within this framework, we establish a synonymity-perception consistency principle, showing that optimal identification of semantic information is theoretically consistent with perceptual optimization. Based on this result, we further derive a tight-bound synonymous source coding rate characterization and show that its Jensen-limit relaxation leads to a synonymous rate-distortion-perception form for practical optimization. These analytical results show that the distributional divergence term arises naturally from the synset-based reconstruction objective, clarify its compatibility with existing RDP formulations and classical RD theory, and suggest the potential advantages of synonymous source coding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
19 of 38 references.
References · 19
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2016End-to-end Optimized Image Compressioncited by 696
- 2017The Perception-Distortion Tradeoffcited by 587
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2020High-Fidelity Generative Image Compressioncited by 338
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 103
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
- 2021Universal Rate-Distortion-Perception Representations for Lossy Compressioncited by 47
7 more
- 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 41
- 2021A coding theorem for the rate-distortion-perception functioncited by 30
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 23
- 2025Diffusion-based Perceptual Neural Video Compression with Temporal Diffusion Information Reusecited by 22
- 2024Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measurecited by 8
- 2023Computation of Rate-Distortion-Perception Function under f-Divergence Perception Constraintscited by 6
- 2025Synonymous Variational Inference for Perceptual Image Compressioncited by 4
Built on by
Not cited yet.