Nonlinear Transform Coding
Not on the map. Why?
Abstract (arXiv)
We review a class of methods that can be collected under the name nonlinear transform coding (NTC), which over the past few years have become competitive with the best linear transform codecs for images, and have superseded them in terms of rate--distortion performance under established perceptual quality metrics such as MS-SSIM. We assess the empirical rate--distortion performance of NTC with the help of simple example sources, for which the optimal performance of a vector quantizer is easier to estimate than with natural data sources. To this end, we introduce a novel variant of entropy-constrained vector quantization. We provide an analysis of various forms of stochastic optimization techniques for NTC models; review architectures of transforms based on artificial neural networks, as well as learned entropy models; and provide a direct comparison of a number of methods to parameterize the rate--distortion trade-off of nonlinear transforms, introducing a simplified one.
Key facts. Cited by 132 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 23; 2023: 25; 2024: 26; 2025: 28; 2026: 14.
132 papers.
Sort:
By area:
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2022Variable Bitrate Neural Fieldscited by 116
- 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
- 2022Lossy Compression with Gaussian Diffusioncited by 87
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 79
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022VCT: A Video Compression Transformercited by 74
- 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 52
38 more
- 2021Lossy Compression for Lossless Predictioncited by 51
- 2022Wireless Deep Video Semantic Transmissioncited by 49
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 42
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariancecited by 42
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2022Neural Data-Dependent Transform for Learned Image Compressioncited by 29
- 2021On the advantages of stochastic encoderscited by 28
- 2021End-to-End Rate-Distortion Optimized Learned Hierarchical Bi-Directional Video Compressioncited by 28
- 2024Image Compression for Machine and Human Vision with Spatial-Frequency Adaptationcited by 26
- 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Modelscited by 25
- 2025Compression of 3D Gaussian Splatting with Optimized Feature Planes and Standard Video Codecscited by 24
- 2023Random-Access Neural Compression of Material Texturescited by 23
- 2023Computationally-Efficient Neural Image Compression with Shallow Decoderscited by 22
- 2025Linear Attention Modeling for Learned Image Compressioncited by 22
- 2021LVAC: Learned Volumetric Attribute Compression for Point Clouds using Coordinate Based Networkscited by 19
- 2023Joint Task and Data Oriented Semantic Communications: A Deep Separate Source-channel Coding Schemecited by 19
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inferencecited by 18
- 2022High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregationcited by 16
- 2024NeRFCodec: Neural Feature Compression Meets Neural Radiance Fields for Memory-Efficient Scene Representationcited by 16
- 2022MobileCodec: Neural Inter-frame Video Compression on Mobile Devicescited by 15
- 2023M2T: Masking Transformers Twice for Faster Decodingcited by 14
- 2023NVTC: Nonlinear Vector Transform Codingcited by 14
- 2021Neural Distributed Source Codingcited by 13
- 2021Towards Empirical Sandwich Bounds on the Rate-Distortion Functioncited by 13
- 2023Efficient Contextformer: Spatio-Channel Window Attention for Fast Context Modeling in Learned Image Compressioncited by 13
- 2023FrankenSplit: Efficient Neural Feature Compression with Shallow Variational Bottleneck Injection for Mobile Edge Computingcited by 12
- 2023Semantically Structured Image Compression via Irregular Group-Based Decouplingcited by 12
- 2025Image Quality Assessment: From Human to Machine Preferencecited by 12
- 2024What makes an image realistic?cited by 10
- 2025Lossy Neural Compression for Geospatial Analytics: A Reviewcited by 10
- 2021Insights from Generative Modeling for Neural Video Compressioncited by 9
- 2022Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Codingcited by 9
- 2023RECOMBINER: Robust and Enhanced Compression with Bayesian Implicit Neural Representationscited by 9
- 2024Variable-Rate Learned Image Compression with Multi-Objective Optimization and Quantization-Reconstruction Offsetscited by 9
- 2021Self-Organized Variational Autoencoders (Self-VAE) for Learned Image Compressioncited by 8
- 2022Attention-Based Generative Neural Image Compression on Solar Dynamics Observatorycited by 8
- 2022Toward Adaptive Semantic Communications: Efficient Data Transmission via Online Learned Nonlinear Transform Source-Channel Codingcited by 8
- 2023ECRF: Entropy-Constrained Neural Radiance Fields Compression with Frequency Domain Optimizationcited by 8
50 most cited of 132 All 132 (JSON)
- 2026Transform-Aligned Learned Features for Lossy Point Cloud Attribute Compression28 Sep 2026
- 2026CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression26 Aug 2026
- 2026KV Cache Compression Through the Lens of Transform Coding14 Aug 2026
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding9 Aug 2026
- 2026Codebook Capacity Governs Perceptual Quality Across Resolutions in Hierarchical Discrete Video Compression25 Jul 2026
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective29 Jun 2026
- 2026Entropy-Coded MS-VQ-VAE with Learned Priors for Ultra-Low Bitrate Video Compression28 Jun 2026
- 2026Adaptive Fused Prior Transfer for Controllable Generative Image Compression16 May 2026
- 2026Adaptive Transform Coding for Semantic Compression29 Apr 2026
- 2026Fundamental Limits of CSI Compression in FDD Massive MIMO15 Mar 2026
- 2026HiDE: Hierarchical Dictionary-Based Entropy Modeling for Learned Image Compression6 Mar 2026
- 2026Uni-LVC: A Unified Method for Intra- and Inter-Mode Learned Video Compression5 Mar 2026
38 more
- 2026Leveraging Second-Order Curvature for Efficient Learned Image Compression: Theory and Empirical Evidence28 Jan 2026
- 2026Advances in Diffusion-Based Generative Compression26 Jan 2026
- 2025Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels23 Dec 2025
- 2025Disentangled representations via score-based variational autoencoders18 Dec 2025
- 2025Error-Propagation-Free Learned Video Compression With Dual-Domain Progressive Temporal Alignment11 Dec 2025
- 2025Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression30 Nov 2025
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications11 Nov 2025
- 2025Generative Image Coding with Diffusion Prior17 Sep 2025
- 2025Deep Unrolling of Sparsity-Induced RDO for 3D Point Cloud Attribute Coding10 Sep 2025
- 2025Way to Build Native AI-driven 6G Air Interface: Principles, Roadmap, and Outlook21 Aug 2025
- 2025Comp-X: On Defining an Interactive Learned Image Compression Paradigm With Expert-driven LLM Agent21 Aug 2025
- 2025Adaptive Source-Channel Coding for Semantic Communications11 Aug 2025
- 2025Zero-shot Denoising via Neural Compression: Theoretical and algorithmic framework15 Jun 2025
- 2025Optimizing Learned Image Compression on Scalar and Entropy-Constraint Quantization10 Jun 2025
- 2025Synonymous Variational Inference for Perceptual Image Compression28 May 2025
- 2025Accelerating Learned Image Compression Through Modeling Neural Training Dynamics23 May 2025
- 2025Why Compress What You Can Generate? When GPT-4o Generation Ushers in Image Compression Fields30 Apr 2025
- 2025On the Design of Diffusion-based Neural Speech Codecs11 Apr 2025
- 2025Image Coding for Machines via Feature-Preserving Rate-Distortion Optimization3 Apr 2025
- 2025DeCompress: Denoising via Neural Compression27 Mar 2025
- 2025Multi-Scale Invertible Neural Network for Wide-Range Variable-Rate Learned Image Compression27 Mar 2025
- 2025Optimal Neural Compressors for the Rate-Distortion-Perception Tradeoff21 Mar 2025
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inference17 Mar 2025
- 2025Image Quality Assessment: From Human to Machine Preference13 Mar 2025
- 2025Lossy Neural Compression for Geospatial Analytics: A Review3 Mar 2025
- 2025Balanced Rate-Distortion Optimization in Learned Image Compression27 Feb 2025
- 2025Linear Attention Modeling for Learned Image Compression9 Feb 2025
- 2025Compression of 3D Gaussian Splatting with Optimized Feature Planes and Standard Video Codecs6 Jan 2025
- 2025Remote Inference over Dynamic Links via Adaptive Rate Deep Task-Oriented Vector Quantization5 Jan 2025
- 2025Exploiting Latent Properties to Optimize Neural Codecs2 Jan 2025
- 2024Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Models4 Nov 2024
- 2024Bi-Level Spatial and Channel-aware Transformer for Learned Image Compression7 Aug 2024
- 2024Bidirectional Stereo Image Compression with Cross-Dimensional Entropy Model15 Jul 2024
- 2024Image Compression for Machine and Human Vision with Spatial-Frequency Adaptation13 Jul 2024
- 2024Neural-based Video Compression on Solar Dynamics Observatory Images12 Jul 2024
- 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models3 Jul 2024
- 2024CMC-Bench: Towards a New Paradigm of Visual Signal Compression13 Jun 2024
- 2024Neural NeRF Compression13 Jun 2024
50 newest of 132 All 132 (JSON)
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2022Lossy Compression with Gaussian Diffusioncited by 87
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariancecited by 42
- 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Modelscited by 25
- 2024Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Modelscited by 5
- 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Modelscited by 3
- 2025Generative Image Coding with Diffusion Priorcited by 1
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communicationscited by 1
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspectivecited by 1
- 2025Disentangled representations via score-based variational autoencoderscited by 0
- 2026Advances in Diffusion-Based Generative Compressioncited by 0
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective29 Jun 2026
- 2026Advances in Diffusion-Based Generative Compression26 Jan 2026
- 2025Disentangled representations via score-based variational autoencoders18 Dec 2025
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications11 Nov 2025
- 2025Generative Image Coding with Diffusion Prior17 Sep 2025
- 2024Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Models4 Nov 2024
- 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models3 Jul 2024
- 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models25 Mar 2024
- 2024Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariance3 Feb 2024
- 2022Lossy Image Compression with Conditional Diffusion Models14 Sep 2022
- 2022Lossy Compression with Gaussian Diffusion17 Jun 2022
- 2026KV Cache Compression Through the Lens of Transform Coding14 Aug 2026
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2022Variable Bitrate Neural Fieldscited by 116
- 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 79
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022VCT: A Video Compression Transformercited by 74
- 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 52
- 2021Lossy Compression for Lossless Predictioncited by 51
- 2022Wireless Deep Video Semantic Transmissioncited by 49
12 most cited of 118 All 118 (JSON)
- 2026Transform-Aligned Learned Features for Lossy Point Cloud Attribute Compression28 Sep 2026
- 2026CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression26 Aug 2026
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding9 Aug 2026
- 2026Codebook Capacity Governs Perceptual Quality Across Resolutions in Hierarchical Discrete Video Compression25 Jul 2026
- 2026Entropy-Coded MS-VQ-VAE with Learned Priors for Ultra-Low Bitrate Video Compression28 Jun 2026
- 2026Adaptive Fused Prior Transfer for Controllable Generative Image Compression16 May 2026
- 2026Adaptive Transform Coding for Semantic Compression29 Apr 2026
- 2026Fundamental Limits of CSI Compression in FDD Massive MIMO15 Mar 2026
- 2026HiDE: Hierarchical Dictionary-Based Entropy Modeling for Learned Image Compression6 Mar 2026
- 2026Uni-LVC: A Unified Method for Intra- and Inter-Mode Learned Video Compression5 Mar 2026
- 2026Leveraging Second-Order Curvature for Efficient Learned Image Compression: Theory and Empirical Evidence28 Jan 2026
- 2025Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels23 Dec 2025
12 newest of 118 All 118 (JSON)