Dual-Latent Collaborative Decoding for Fidelity-Perception Balanced Image Compression
Not on the map. Why?
Abstract (arXiv)
Learned image compression (LIC) increasingly requires reconstructions that balance distortion fidelity and perceptual realism across a wide range of bitrates. However, most existing methods still rely on a single compressed latent representation to simultaneously carry structural details, semantic cues, and perceptual priors, requiring the same latent representation to serve multiple, potentially conflicting roles. This tension becomes evident across different latent paradigms: scalar-quantized (SQ) continuous latents provide rate-scalable fidelity but tend to lose perceptual details at low rates, while vector-quantized (VQ) discrete tokens preserve compact semantic cues but suffer from limited structural fidelity and bitrate scalability. To address this issue, we propose Mixture of Decoder Experts (MoDE), a dual-latent collaborative decoding framework that decomposes reconstruction responsibilities across complementary latent paradigms. Specifically, MoDE treats the SQ branch as a fidelity-oriented expert and the VQ branch as a perception-oriented expert, and coordinates them through two decoder-side modules: Expert-Specific Enhancement (ESE), which preserves branch-specific expert references, and Cross-Expert Modulation (CEM), which enables selective complementary transfer during reconstruction. The resulting framework supports selective cross-latent collaboration under a shared dual-stream bitstream and enables both fidelity-anchored and perception-anchored decoding. Extensive experiments demonstrate that MoDE achieves a more favorable fidelity-perception balance than representative distortion-oriented, perception-oriented, generative, and dual-latent baselines across a wide bitrate range, highlighting decoder-side expert collaboration as an effective design for wide-range fidelity-perception balanced LIC.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
28 of 37 references.
References · 28
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2017Neural Discrete Representation Learningcited by 4,712
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2021Scaling Vision with Sparse Mixture of Expertscited by 747
- 2016End-to-end Optimized Image Compressioncited by 696
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2020High-Fidelity Generative Image Compressioncited by 338
16 more
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 80
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 60
- 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 35
- 2022Image Compression with Product Quantized Masked Image Modelingcited by 33
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 33
- 2023Extreme Image Compression using Fine-tuned VQGANscited by 29
- 2024RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusioncited by 23
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 23
- 2025DLF: Extreme Image Compression with Dual-generative Latent Fusioncited by 21
- 2024HybridFlow: Infusing Continuity into Masked Codebook for Extreme Low-Bitrate Image Compressioncited by 14
- 2020Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blockscited by 12
- 2024Unifying Generation and Compression: Ultra-low bitrate Image Coding Via Multi-stage Transformercited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Rate-Adaptive One-Step Diffusion Compression for AIGC Images25 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2024Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression
- 2025Compact Latent Representation for Image Compression (CLRIC)
- 2025Extremely low-bitrate Image Compression Semantically Disentangled by LMMs from a Human Perception Perspective
- 2026Tree-VQ: Progressive Image Compression from Pretrained Vector Quantizers
- 2024Image and Video Compression using Generative Sparse Representation with Fidelity Controls ↗
- 2026Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling
- 2026MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts