Deep Residual Learning in the JPEG Transform Domain
Not on the map. Why?
Abstract (arXiv)
We introduce a general method of performing Residual Network inference and learning in the JPEG transform domain that allows the network to consume compressed images as input. Our formulation leverages the linearity of the JPEG transform to redefine convolution and batch normalization with a tune-able numerical approximation for ReLu. The result is mathematically equivalent to the spatial domain network up to the ReLu approximation accuracy. A formulation for image classification and a model conversion algorithm for spatial domain networks are given as examples of the method. We show that the sparsity of the JPEG format allows for faster processing of images with little to no penalty in the network accuracy.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 10; 2023: 8; 2024: 10; 2025: 2; 2026: 5.
44 papers.
Sort:
- 2024Parameter-Efficient Fine-Tuning with Discrete Fourier Transformcited by 67
- 2023Frequency Perception Network for Camouflaged Object Detectioncited by 37
- 2021TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learningcited by 31
- 2022Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domaincited by 28
- 2022Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolutioncited by 25
- 2021A Survey of Deep Learning Techniques for Weed Detection from Imagescited by 23
- 2023TransFace++: Rethinking the Face Recognition Paradigm with a Focus on Accuracy, Efficiency, and Securitycited by 22
- 2021Towards Discriminative Representation Learning for Unsupervised Person Re-identificationcited by 20
- 2022RGB no more: Minimally-decoded JPEG Vision Transformerscited by 18
- 2024Continual Learning in the Frequency Domaincited by 12
- 2021FreqNet: A Frequency-domain Image Super-Resolution Network with Dicrete Cosine Transformcited by 11
- 2022Boosting Night-time Scene Parsing with Learnable Frequencycited by 9
32 more
- 2024Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semanticscited by 9
- 2022Compressed Vision for Efficient Video Understandingcited by 8
- 2023Frequency Spectrum is More Effective for Multimodal Representation and Fusion: A Multimodal Spectrum Rumor Detectorcited by 8
- 2021Less is More: Accelerating Faster Neural Networks Straight from JPEGcited by 7
- 2021Prior-Induced Information Alignment for Image Mattingcited by 6
- 2023Machine Perception-Driven Image Compression: A Layered Generative Approachcited by 6
- 2023Lite-Mind: Towards Efficient and Robust Brain Representation Networkcited by 6
- 2024MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projectioncited by 6
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learningcited by 5
- 2022Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulationcited by 4
- 2024Constrained Multiview Representation for Self-supervised Contrastive Learningcited by 3
- 2021Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directionscited by 2
- 2024Learned Compression for Compressed Learningcited by 2
- 2026Bitstream Action Recognition is Byte Modelingcited by 2
- 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networkscited by 1
- 2021Deep Learning Based Image Retrieval in the JPEG Compressed Domaincited by 1
- 2022Explicitly Increasing Input Information Density for Vision Transformers on Small Datasetscited by 1
- 2022Learning Spatiotemporal Frequency-Transformer for Low-Quality Video Super-Resolutioncited by 1
- 2023Learned Lossless Compression for JPEG via Frequency-Domain Predictioncited by 1
- 2026S2FT: Parameter-Efficient Fine-Tuning in Sparse Spectrum Domaincited by 1
- 2022Document Image Binarization in JPEG Compressed Domain using Dual Discriminator Generative Adversarial Networkscited by 0
- 2023CompTLL-UNet: Compressed Domain Text-Line Localization in Challenging Handwritten Documents using Deep Feature Learning from JPEG Coefficientscited by 0
- 2023CNNs for JPEGs: A Study in Computational Costcited by 0
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attackcited by 0
- 2024Evaluating Adversarial Robustness in the Spatial Frequency Domaincited by 0
- 2024What Operations can be Performed Directly on Compressed Arrays, and with What Error?cited by 0
- 2024Content-Aware Preserving Image Generationcited by 0
- 2025MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projectioncited by 0
- 2025Learning Single-Image Super-Resolution in the JPEG Compressed Domaincited by 0
- 2026Low-Frequency Shortcuts in Texture-Driven Visual Learningcited by 0
- 2026SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstructioncited by 0
- 2026FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inferencecited by 0
- 2026Bitstream Action Recognition is Byte Modeling16 Aug 2026
- 2026FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference17 Jun 2026
- 2026SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction2 Jun 2026
- 2026Low-Frequency Shortcuts in Texture-Driven Visual Learning2 Jun 2026
- 2026S2FT: Parameter-Efficient Fine-Tuning in Sparse Spectrum Domain9 May 2026
- 2025Learning Single-Image Super-Resolution in the JPEG Compressed Domain3 Dec 2025
- 2025MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection29 May 2025
- 2024Learned Compression for Compressed Learning12 Dec 2024
- 2024Content-Aware Preserving Image Generation15 Nov 2024
- 2024MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection9 Oct 2024
- 2024Continual Learning in the Frequency Domain9 Oct 2024
- 2024Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semantics5 Aug 2024
32 more
- 2024What Operations can be Performed Directly on Compressed Arrays, and with What Error?17 Jun 2024
- 2024Evaluating Adversarial Robustness in the Spatial Frequency Domain10 May 2024
- 2024Parameter-Efficient Fine-Tuning with Discrete Fourier Transform5 May 2024
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack14 Mar 2024
- 2024Constrained Multiview Representation for Self-supervised Contrastive Learning5 Feb 2024
- 2023Frequency Spectrum is More Effective for Multimodal Representation and Fusion: A Multimodal Spectrum Rumor Detector18 Dec 2023
- 2023Lite-Mind: Towards Efficient and Robust Brain Representation Network6 Dec 2023
- 2023CNNs for JPEGs: A Study in Computational Cost20 Sep 2023
- 2023TransFace++: Rethinking the Face Recognition Paradigm with a Focus on Accuracy, Efficiency, and Security20 Aug 2023
- 2023Frequency Perception Network for Camouflaged Object Detection17 Aug 2023
- 2023CompTLL-UNet: Compressed Domain Text-Line Localization in Challenging Handwritten Documents using Deep Feature Learning from JPEG Coefficients11 Aug 2023
- 2023Machine Perception-Driven Image Compression: A Layered Generative Approach14 Apr 2023
- 2023Learned Lossless Compression for JPEG via Frequency-Domain Prediction5 Mar 2023
- 2022Learning Spatiotemporal Frequency-Transformer for Low-Quality Video Super-Resolution27 Dec 2022
- 2022RGB no more: Minimally-decoded JPEG Vision Transformers29 Nov 2022
- 2022Explicitly Increasing Input Information Density for Vision Transformers on Small Datasets25 Oct 2022
- 2022Compressed Vision for Efficient Video Understanding6 Oct 2022
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning14 Sep 2022
- 2022Document Image Binarization in JPEG Compressed Domain using Dual Discriminator Generative Adversarial Networks13 Sep 2022
- 2022Boosting Night-time Scene Parsing with Learnable Frequency30 Aug 2022
- 2022Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution5 Aug 2022
- 2022Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation18 Jul 2022
- 2022Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain15 Jul 2022
- 2021TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learning7 Dec 2021
- 2021FreqNet: A Frequency-domain Image Super-Resolution Network with Dicrete Cosine Transform21 Nov 2021
- 2021Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions30 Aug 2021
- 2021Towards Discriminative Representation Learning for Unsupervised Person Re-identification7 Aug 2021
- 2021Deep Learning Based Image Retrieval in the JPEG Compressed Domain8 Jul 2021
- 2021Prior-Induced Information Alignment for Image Matting28 Jun 2021
- 2021Less is More: Accelerating Faster Neural Networks Straight from JPEG1 Apr 2021
- 2021A Survey of Deep Learning Techniques for Weed Detection from Images2 Mar 2021
- 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networks3 Jan 2021
- 2024Parameter-Efficient Fine-Tuning with Discrete Fourier Transformcited by 67
- 2023Frequency Perception Network for Camouflaged Object Detectioncited by 37
- 2021TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learningcited by 31
- 2022Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domaincited by 28
- 2022Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolutioncited by 25
- 2021A Survey of Deep Learning Techniques for Weed Detection from Imagescited by 23
- 2023TransFace++: Rethinking the Face Recognition Paradigm with a Focus on Accuracy, Efficiency, and Securitycited by 22
- 2021Towards Discriminative Representation Learning for Unsupervised Person Re-identificationcited by 20
- 2022RGB no more: Minimally-decoded JPEG Vision Transformerscited by 18
- 2024Continual Learning in the Frequency Domaincited by 12
- 2021FreqNet: A Frequency-domain Image Super-Resolution Network with Dicrete Cosine Transformcited by 11
- 2022Boosting Night-time Scene Parsing with Learnable Frequencycited by 9
12 most cited of 44 All 44 (JSON)
- 2026Bitstream Action Recognition is Byte Modeling16 Aug 2026
- 2026FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference17 Jun 2026
- 2026SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction2 Jun 2026
- 2026Low-Frequency Shortcuts in Texture-Driven Visual Learning2 Jun 2026
- 2026S2FT: Parameter-Efficient Fine-Tuning in Sparse Spectrum Domain9 May 2026
- 2025Learning Single-Image Super-Resolution in the JPEG Compressed Domain3 Dec 2025
- 2025MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection29 May 2025
- 2024Learned Compression for Compressed Learning12 Dec 2024
- 2024Content-Aware Preserving Image Generation15 Nov 2024
- 2024MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection9 Oct 2024
- 2024Continual Learning in the Frequency Domain9 Oct 2024
- 2024Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semantics5 Aug 2024
12 newest of 44 All 44 (JSON)