A Fourier Perspective on Model Robustness in Computer Vision
Not on the map. Why?
Abstract (arXiv)
Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across corruption types. Indeed increasing performance in the presence of random noise is often met with reduced performance on other corruptions such as contrast change. Understanding when and why these sorts of trade-offs occur is a crucial step towards mitigating them. Towards this end, we investigate recently observed trade-offs caused by Gaussian data augmentation and adversarial training. We find that both methods improve robustness to corruptions that are concentrated in the high frequency domain while reducing robustness to corruptions that are concentrated in the low frequency domain. This suggests that one way to mitigate these trade-offs via data augmentation is to use a more diverse set of augmentations. Towards this end we observe that AutoAugment, a recently proposed data augmentation policy optimized for clean accuracy, achieves state-of-the-art robustness on the CIFAR-10-C benchmark.
Key facts. Cited by 288 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 62; 2022: 53; 2023: 50; 2024: 47; 2025: 41; 2026: 35.
288 papers.
Sort:
By area:
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
- 2022How Do Vision Transformers Work?cited by 305
- 2021Vision Transformers are Robust Learnerscited by 208
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 128
- 2022Inception Transformercited by 99
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
- 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similaritycited by 76
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 75
38 more
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2022Benchmarking and Analyzing Point Cloud Classification under Corruptionscited by 70
- 2021Editing a classifier by rewriting its prediction rulescited by 64
- 2023On the Foundations of Shortcut Learningcited by 64
- 2021A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustnesscited by 62
- 2021Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNscited by 57
- 2021Causally motivated Shortcut Removal Using Auxiliary Labelscited by 55
- 2023Open-Vocabulary Segmentation with Semantic-Assisted Calibrationcited by 49
- 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
- 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
- 2023Adaptive Frequency Filters As Efficient Global Token Mixerscited by 45
- 2022EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbonescited by 42
- 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
- 2022Deep Frequency Filtering for Domain Generalizationcited by 41
- 2021Fighting deepfakes by detecting GAN DCT anomaliescited by 39
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2022PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalizationcited by 38
- 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 36
- 2022Exposing Outlier Exposure: What Can Be Learned From Few, One, and Zero Outlier Imagescited by 35
- 2023Continual Test-time Domain Adaptation via Dynamic Sample Selectioncited by 35
- 2021Improving robustness against common corruptions with frequency biased modelscited by 34
- 2022Do better ImageNet classifiers assess perceptual similarity better?cited by 34
- 2024Frequency-Adaptive Dilated Convolution for Semantic Segmentationcited by 34
- 2021Does enhanced shape bias improve neural network robustness to common corruptions?cited by 32
- 2021SpectralDefense: Detecting Adversarial Attacks on CNNs in the Fourier Domaincited by 30
- 2022Large-scale Robustness Analysis of Video Action Recognition Modelscited by 29
- 2021Defending Against Image Corruptions Through Adversarial Augmentationscited by 28
- 2021A Frequency Perspective of Adversarial Robustnesscited by 28
- 2023What do neural networks learn in image classification? A frequency shortcut perspectivecited by 28
- 2023Spatial-frequency channels, shape bias, and adversarial robustnesscited by 28
- 2021Enhancing Adversarial Robustness via Test-time Transformation Ensemblingcited by 27
- 2021Impact of Aliasing on Generalization in Deep Convolutional Networkscited by 25
- 2022Robustness Analysis of Video-Language Models Against Visual and Language Perturbationscited by 23
- 2022On the Strong Correlation Between Model Invariance and Generalizationcited by 23
- 2022Global Spectral Filter Memory Network for Video Object Segmentationcited by 22
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 20
- 2024Can Biases in ImageNet Models Explain Generalization?cited by 20
50 most cited of 288 All 288 (JSON)
- 2026Detection of Adversarial Attacks on Super-Resolvers Using Spectral Features28 Sep 2026
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models17 Sep 2026
- 2026VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition4 Sep 2026
- 2026Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain1 Sep 2026
- 2026Suppress and Diversify: Refining Robust Pathways for Corruption Robustness7 Aug 2026
- 2026Robustness Emerges Early in Training Dynamics, but Is Not Preserved5 Aug 2026
- 2026Structural Preservation Governs Data Augmentation in Deep Learning-Based Laser Speckle Material Classification22 Jul 2026
- 2026Geometric Collapse: When Vision Models Fail to Verify Physical Causality8 Jul 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control6 Jul 2026
38 more
- 2026CP-WSP: A Declarative CP-SAT Framework for Configurable Multi-Constraint Workforce Scheduling6 Jul 2026
- 2026FedFFT: Taming Client Drift in Federated SAM via Spectral Perturbation Filtering5 Jul 2026
- 2026Beyond Compression: Quantifying Spectral Accessibility in Vision Representations2 Jun 2026
- 2026Low-Frequency Shortcuts in Texture-Driven Visual Learning2 Jun 2026
- 2026COD10K-C: Benchmarking Robustness of Camouflaged Object Detection Under Natural Image Corruptions23 May 2026
- 2026Early High-Frequency Injection for Geometry-Sensitive OOD Detection20 May 2026
- 2026How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligence19 May 2026
- 2026VoxShield: Protecting 3D Medical Datasets from Unauthorized Training via Frequency-Aware Inter-Slice Disruption17 May 2026
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detection8 May 2026
- 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domains5 May 2026
- 2026Safety, Security, and Cognitive Risks in State-Space Models: A Systematic Threat Analysis with Spectral, Stateful, and Capacity Attacks4 Apr 2026
- 2026Fast Preemptive Robustification: High-Frequency Response Anti-Aligns Shared Vulnerability26 Mar 2026
- 2026MoireMix: A Formula-Based Data Augmentation for Improving Image Classification Robustness26 Mar 2026
- 2026Tracking the Discriminative Axis: Dual Prototypes for Test-Time OOD Detection Under Covariate Shift16 Mar 2026
- 2026MRGeo: Robust Cross-View Geo-Localization of Corrupted Images via Spatial and Channel Feature Enhancement13 Mar 2026
- 2026ActiveFreq: Integrating Active Learning and Frequency Domain Analysis for Interactive Segmentation12 Mar 2026
- 2026Cross-view geo-localization, Image retrieval, Multiscale geometric modeling, Frequency domain enhancement3 Mar 2026
- 2026Spectral Phase Encoding for Quantum Kernel Methods23 Feb 2026
- 2026Low-Pass Filtering Improves Behavioral Alignment of Vision Models14 Feb 2026
- 2026TIP: Resisting Gradient Inversion via Targeted Interpretable Perturbation in Federated Learning12 Feb 2026
- 2026Same Answer, Different Representations: Hidden instability in VLMs6 Feb 2026
- 2026Perturbing the Phase: Analyzing Adversarial Robustness of Complex-Valued Neural Networks6 Feb 2026
- 2026Low-Cost Hard-Label Adversarial Attack with Theoretical Foundations17 Jan 2026
- 2025Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks20 Dec 2025
- 2025Mimicking Human Visual Development for Learning Robust Image Representations16 Dec 2025
- 2025Towards Lossless Ultimate Vision Token Compression for VLMs9 Dec 2025
- 2025AQUA-Net: Adaptive Frequency Fusion and Illumination Aware Network for Underwater Image Enhancement5 Dec 2025
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation20 Nov 2025
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025MANI-Pure: Magnitude-Adaptive Noise Injection for Adversarial Purification29 Sep 2025
- 2025Frequency-Aware Model Parameter Explorer: A new attribution method for improving explainability25 Sep 2025
- 2025Less Precise Can Be More Reliable: A Systematic Evaluation of Quantization's Impact on VLMs Beyond Accuracy25 Sep 2025
- 2025Promoting Shape Bias in CNNs: Frequency-Based and Contrastive Regularization for Corruption Robustness14 Sep 2025
- 2025A Modern Look at Simplicity Bias in Image Classification Tasks13 Sep 2025
- 2025NM-Hebb: Coupling Local Hebbian Plasticity with Metric Learning for More Accurate and Interpretable CNNs27 Aug 2025
- 2025Target-Agnostic Calibration under Distribution Shift with Frequency-Aware Gradient Rectification27 Aug 2025
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptation20 Aug 2025
50 newest of 288 All 288 (JSON)
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2025Noise Matters: Optimizing Matching Noise for Diffusion Classifierscited by 7
- 2025Less Precise Can Be More Reliable: A Systematic Evaluation of Quantization's Impact on VLMs Beyond Accuracycited by 3
- 2026Same Answer, Different Representations: Hidden instability in VLMscited by 2
- 2025On the Domain Robustness of Contrastive Vision-Language Modelscited by 1
- 2025Towards Lossless Ultimate Vision Token Compression for VLMscited by 1
- 2026Beyond Compression: Quantifying Spectral Accessibility in Vision Representationscited by 1
- 2026Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domaincited by 0
- 2026Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Modelscited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapsecited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2026Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models17 Sep 2026
- 2026Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain1 Sep 2026
- 2026Beyond Compression: Quantifying Spectral Accessibility in Vision Representations2 Jun 2026
- 2026Same Answer, Different Representations: Hidden instability in VLMs6 Feb 2026
- 2025Towards Lossless Ultimate Vision Token Compression for VLMs9 Dec 2025
- 2025Less Precise Can Be More Reliable: A Systematic Evaluation of Quantization's Impact on VLMs Beyond Accuracy25 Sep 2025
- 2025Noise Matters: Optimizing Matching Noise for Diffusion Classifiers15 Aug 2025
- 2025On the Domain Robustness of Contrastive Vision-Language Models30 Jun 2025
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
- 2025Demystifying Adversarial Robustness in Diffusion Models: Compression, Randomness, and Geometrycited by 1
- 2025MANI-Pure: Magnitude-Adaptive Noise Injection for Adversarial Purificationcited by 1
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptationcited by 0
- 2025MANI-Pure: Magnitude-Adaptive Noise Injection for Adversarial Purification29 Sep 2025
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptation20 Aug 2025
- 2025Demystifying Adversarial Robustness in Diffusion Models: Compression, Randomness, and Geometry28 May 2025
- 2023FreeU: Free Lunch in Diffusion U-Net20 Sep 2023
- 2023Improving Adversarial Transferability via Model Alignmentcited by 10
- 2023Improving Adversarial Transferability via Model Alignment30 Nov 2023
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
- 2022How Do Vision Transformers Work?cited by 305
- 2021Vision Transformers are Robust Learnerscited by 208
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 128
- 2022Inception Transformercited by 99
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
- 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similaritycited by 76
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 75
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
12 most cited of 271 All 271 (JSON)
- 2026Detection of Adversarial Attacks on Super-Resolvers Using Spectral Features28 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition4 Sep 2026
- 2026Suppress and Diversify: Refining Robust Pathways for Corruption Robustness7 Aug 2026
- 2026Robustness Emerges Early in Training Dynamics, but Is Not Preserved5 Aug 2026
- 2026Structural Preservation Governs Data Augmentation in Deep Learning-Based Laser Speckle Material Classification22 Jul 2026
- 2026Geometric Collapse: When Vision Models Fail to Verify Physical Causality8 Jul 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control6 Jul 2026
- 2026CP-WSP: A Declarative CP-SAT Framework for Configurable Multi-Constraint Workforce Scheduling6 Jul 2026
- 2026FedFFT: Taming Client Drift in Federated SAM via Spectral Perturbation Filtering5 Jul 2026
- 2026Low-Frequency Shortcuts in Texture-Driven Visual Learning2 Jun 2026
12 newest of 271 All 271 (JSON)