Non-local Attention Optimized Deep Image Compression
Not on the map. Why?
Abstract (arXiv)
This paper proposes a novel Non-Local Attention Optimized Deep Image Compression (NLAIC) framework, which is built on top of the popular variational auto-encoder (VAE) structure. Our NLAIC framework embeds non-local operations in the encoders and decoders for both image and latent feature probability information (known as hyperprior) to capture both local and global correlations, and apply attention mechanism to generate masks that are used to weigh the features for the image and hyperprior, which implicitly adapt bit allocation for different features based on their importance. Furthermore, both hyperpriors and spatial-channel neighbors of the latent features are used to improve entropy coding. The proposed model outperforms the existing methods on Kodak dataset, including learned (e.g., Balle2019, Balle2018) and conventional (e.g., BPG, JPEG2000, JPEG) image compression methods, for both PSNR and MS-SSIM distortion metrics.
Key facts. Cited by 86 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 23; 2023: 20; 2024: 16; 2025: 11; 2026: 4.
86 papers.
Sort:
By area:
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
- 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 69
- 2021Transformer-based Image Compressioncited by 60
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2022CANF-VC: Conditional Augmented Normalizing Flows for Video Compressioncited by 44
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 42
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Triggercited by 40
- 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 33
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2021Extending Neural P-frame Codecs for B-frame Codingcited by 30
38 more
- 2022Neural Data-Dependent Transform for Learned Image Compressioncited by 29
- 2021Towards Robust Neural Image Compression: Adversarial Attack and Model Finetuningcited by 24
- 2021ANFIC: Image Compression Using Augmented Normalizing Flowscited by 20
- 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 20
- 2024Causal Context Adjustment Loss for Learned Image Compressioncited by 19
- 2022Preprocessing Enhanced Image Compression for Machine Visioncited by 18
- 2022Efficient Visual Computing with Camera RAW Snapshotscited by 18
- 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusioncited by 17
- 2022High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregationcited by 16
- 2024Controlling Rate, Distortion, and Realism: Towards a Single Comprehensive Neural Image Compression Modelcited by 16
- 2022MobileCodec: Neural Inter-frame Video Compression on Mobile Devicescited by 15
- 2022Neural Distributed Image Compression with Cross-Attention Feature Alignmentcited by 15
- 2021CSformer: Bridging Convolution and Transformer for Compressive Sensingcited by 14
- 2023Multi-Modality Deep Network for Extreme Learned Image Compressioncited by 14
- 2022Learning-Driven Lossy Image Compression; A Comprehensive Surveycited by 13
- 2023Efficient Contextformer: Spatio-Channel Window Attention for Fast Context Modeling in Learned Image Compressioncited by 13
- 2021Learning Cross-Scale Weighted Prediction for Efficient Neural Video Compressioncited by 12
- 2023FrankenSplit: Efficient Neural Feature Compression with Shallow Variational Bottleneck Injection for Mobile Edge Computingcited by 12
- 2024When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Codingcited by 11
- 2024Robust and Transferable Backdoor Attacks Against Deep Image Compression With Selective Frequency Priorcited by 11
- 2023Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compressioncited by 10
- 2022High-Fidelity Variable-Rate Image Compression via Invertible Activation Transformationcited by 8
- 2022Attention-Based Generative Neural Image Compression on Solar Dynamics Observatorycited by 8
- 2024Generalized Gaussian Model for Learned Image Compressioncited by 8
- 2021Rate Distortion Characteristic Modeling for Neural Image Compressioncited by 6
- 2021Universal Efficient Variable-rate Neural Image Compressioncited by 6
- 2022Learned Image Compression with Generalized Octave Convolution and Cross-Resolution Parameter Estimationcited by 6
- 2023Machine Perception-Driven Image Compression: A Layered Generative Approachcited by 6
- 2023LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compressioncited by 6
- 2023Multi-Context Dual Hyper-Prior Neural Image Compressioncited by 6
- 2022Estimating the Resize Parameter in End-to-end Learned Image Compressioncited by 5
- 2024DeepHQ: Learned Hierarchical Quantizer for Progressive Deep Image Codingcited by 5
- 2021Learning-Based Video Coding with Joint Deep Compression and Enhancementcited by 4
- 2022Exploring Structural Sparsity in Neural Image Compressioncited by 4
- 2022Practical Learned Lossless JPEG Recompression with Multi-Level Cross-Channel Entropy Model in the DCT Domaincited by 4
- 2024STanH : Parametric Quantization for Variable Rate Learned Image Compressioncited by 4
- 2025Multi-Scale Invertible Neural Network for Wide-Range Variable-Rate Learned Image Compressioncited by 4
- 2023Make Lossy Compression Meaningful for Low-Light Imagescited by 3
50 most cited of 86 All 86 (JSON)
- 2026Compressing 3D Gaussian Splatting via Cross-Representation Priors19 Sep 2026
- 2026ARCHE: Autoregressive Residual Compression with Hyperprior and Excitation10 Mar 2026
- 2026LightMedSeg: Lightweight 3D Medical Image Segmentation with Learned Spatial Anchors7 Mar 2026
- 2026RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion18 Feb 2026
- 2025Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression30 Nov 2025
- 2025A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression25 Nov 2025
- 2025A Multi-Stage Optimization Framework for Deploying Learned Image Compression on FPGAs21 Nov 2025
- 2025Scaling Learned Image Compression Models up to 1 Billion12 Aug 2025
- 2025Learned Image Compression with Hierarchical Progressive Context Modeling25 Jul 2025
- 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion13 May 2025
- 2025Multi-Scale Invertible Neural Network for Wide-Range Variable-Rate Learned Image Compression27 Mar 2025
- 2025Leveraging Diffusion Knowledge for Generative Image Compression with Fractal Frequency-Aware Band Learning14 Mar 2025
38 more
- 2025Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization5 Mar 2025
- 2025Interleaved Block-based Learned Image Compression with Feature Enhancement and Quantization Error Compensation21 Feb 2025
- 2025CANeRV: Content Adaptive Neural Representation for Video Compression10 Feb 2025
- 2024Sparse Point Clouds Assisted Learned Image Compression20 Dec 2024
- 2024Robust and Transferable Backdoor Attacks Against Deep Image Compression With Selective Frequency Prior2 Dec 2024
- 2024Generalized Gaussian Model for Learned Image Compression28 Nov 2024
- 2024DT-JRD: Deep Transformer based Just Recognizable Difference Prediction Model for Video Coding for Machines14 Nov 2024
- 2024Causal Context Adjustment Loss for Learned Image Compression7 Oct 2024
- 2024STanH : Parametric Quantization for Variable Rate Learned Image Compression1 Oct 2024
- 2024Approximately Invertible Neural Network for Learned Image Compression30 Aug 2024
- 2024DeepHQ: Learned Hierarchical Quantizer for Progressive Deep Image Coding22 Aug 2024
- 2024When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Coding15 Aug 2024
- 2024Exploiting Inter-Image Similarity Prior for Low-Bitrate Remote Sensing Image Compression17 Jul 2024
- 2024Exploring Distortion Prior with Latent Diffusion Models for Remote Sensing Image Compression6 Jun 2024
- 2024Controlling Rate, Distortion, and Realism: Towards a Single Comprehensive Neural Image Compression Model27 May 2024
- 2024CAMSIC: Content-aware Masked Image Modeling Transformer for Stereo Image Compression13 Mar 2024
- 2024Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling29 Feb 2024
- 2024Traditional Transformation Theory Guided Model for Learned Image Compression24 Feb 2024
- 2024End-to-End Optimized Image Compression with the Frequency-Oriented Transform16 Jan 2024
- 2023Neural-based Compression Scheme for Solar Image Data6 Nov 2023
- 2023Image Compression using only Attention based Neural Networks17 Oct 2023
- 2023Image Data Hiding in Neural Compressed Latent Representations1 Oct 2023
- 2023CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression1 Oct 2023
- 2023Multi-Context Dual Hyper-Prior Neural Image Compression19 Sep 2023
- 2023Dynamic Kernel-Based Adaptive Spatial Aggregation for Learned Image Compression17 Aug 2023
- 2023RFD-ECNet: Extreme Underwater Image Compression with Reference to Feature Dictionar17 Aug 2023
- 2023Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compression15 Aug 2023
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compression28 Jul 2023
- 2023ConvNeXt-ChARM: ConvNeXt-based Transform for Efficient Neural Image Compression12 Jul 2023
- 2023AICT: An Adaptive Image Compression Transformer12 Jul 2023
- 2023Joint Hierarchical Priors and Adaptive Spatial Resolution for Efficient Neural Image Compression5 Jul 2023
- 2023Efficient Contextformer: Spatio-Channel Window Attention for Fast Context Modeling in Learned Image Compression25 Jun 2023
- 2023Make Lossy Compression Meaningful for Low-Light Images24 May 2023
- 2023Exploring the Rate-Distortion-Complexity Optimization in Neural Image Compression12 May 2023
- 2023Multi-Modality Deep Network for Extreme Learned Image Compression26 Apr 2023
- 2023LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression19 Apr 2023
- 2023Machine Perception-Driven Image Compression: A Layered Generative Approach14 Apr 2023
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Trigger28 Feb 2023
50 newest of 86 All 86 (JSON)
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
- 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 69
- 2021Transformer-based Image Compressioncited by 60
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2022CANF-VC: Conditional Augmented Normalizing Flows for Video Compressioncited by 44
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 42
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Triggercited by 40
- 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 33
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2021Extending Neural P-frame Codecs for B-frame Codingcited by 30
12 most cited of 83 All 83 (JSON)
- 2026Compressing 3D Gaussian Splatting via Cross-Representation Priors19 Sep 2026
- 2026ARCHE: Autoregressive Residual Compression with Hyperprior and Excitation10 Mar 2026
- 2026LightMedSeg: Lightweight 3D Medical Image Segmentation with Learned Spatial Anchors7 Mar 2026
- 2026RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion18 Feb 2026
- 2025Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression30 Nov 2025
- 2025A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression25 Nov 2025
- 2025A Multi-Stage Optimization Framework for Deploying Learned Image Compression on FPGAs21 Nov 2025
- 2025Scaling Learned Image Compression Models up to 1 Billion12 Aug 2025
- 2025Learned Image Compression with Hierarchical Progressive Context Modeling25 Jul 2025
- 2025Multi-Scale Invertible Neural Network for Wide-Range Variable-Rate Learned Image Compression27 Mar 2025
- 2025Leveraging Diffusion Knowledge for Generative Image Compression with Fractal Frequency-Aware Band Learning14 Mar 2025
- 2025Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization5 Mar 2025
12 newest of 83 All 83 (JSON)