On the Structural Sensitivity of Deep Convolutional Networks to the Directions of Fourier Basis Functions
Not on the map. Why?
Abstract (arXiv)
Data-agnostic quasi-imperceptible perturbations on inputs are known to degrade recognition accuracy of deep convolutional networks severely. This phenomenon is considered to be a potential security issue. Moreover, some results on statistical generalization guarantees indicate that the phenomenon can be a key to improve the networks' generalization. However, the characteristics of the shared directions of such harmful perturbations remain unknown. Our primal finding is that convolutional networks are sensitive to the directions of Fourier basis functions. We derived the property by specializing a hypothesis of the cause of the sensitivity, known as the linearity of neural networks, to convolutional networks and empirically validated it. As a by-product of the analysis, we propose an algorithm to create shift-invariant universal adversarial perturbations available in black-box settings.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 5; 2024: 4; 2025: 3; 2026: 2.
31 papers.
Sort:
By area:
- 2023On the Foundations of Shortcut Learningcited by 64
- 2021SpectralDefense: Detecting Adversarial Attacks on CNNs in the Fourier Domaincited by 30
- 2021A Frequency Perspective of Adversarial Robustnesscited by 28
- 2021Relative stability toward diffeomorphisms indicates performance in deep netscited by 12
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?cited by 11
- 2021Detecting AutoAttack Perturbations in the Frequency Domaincited by 10
- 2024FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attackscited by 8
- 2022Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibrationcited by 7
- 2023Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequenciescited by 7
- 2021Real-time Detection of Practical Universal Adversarial Perturbationscited by 6
- 2021Bridging the Gap Between Adversarial Robustness and Optimization Biascited by 5
- 2021Frequency Centric Defense Mechanisms against Adversarial Examplescited by 3
19 more
- 2022Understanding robustness and generalization of artificial neural networks through Fourier maskscited by 3
- 2021F-Drop&Match: GANs with a Dead Zone in the High-Frequency Domaincited by 2
- 2022FourierNet: Shape-Preserving Network for Henle's Fiber Layer Segmentation in Optical Coherence Tomography Imagescited by 2
- 2024Towards a Novel Perspective on Adversarial Examples Driven by Frequencycited by 2
- 2025On the Complexity-Faithfulness Trade-off of Gradient-Based Explanationscited by 2
- 2021Simple black-box universal adversarial attacks on medical image classification based on deep neural networkscited by 1
- 2022Adversarial amplitude swap towards robust image classifierscited by 1
- 2022Robustness and invariance properties of image classifierscited by 1
- 2022Universal Adversarial Directionscited by 1
- 2022Aliasing is a Driver of Adversarial Attackscited by 1
- 2023Fourier Sensitivity and Regularization of Computer Vision Modelscited by 1
- 2024Interpreting Global Perturbation Robustness of Image Models using Axiomatic Spectral Importance Decompositioncited by 1
- 2024DFT-Based Adversarial Attack Detection in MRI Brain Imaging: Enhancing Diagnostic Accuracy in Alzheimer's Case Studiescited by 1
- 2023Exploiting Frequency Spectrum of Adversarial Images for General Robustnesscited by 0
- 2023Frequency maps reveal the correlation between Adversarial Attacks and Implicit Biascited by 0
- 2025FREQuency ATTribution: benchmarking frequency-based occlusion for time series datacited by 0
- 2025Understanding Sensitivity of Differential Attention through the Lens of Adversarial Robustnesscited by 0
- 2026How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligencecited by 0
- 2026Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Modelscited by 0
- 2026Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models17 Sep 2026
- 2026How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligence19 May 2026
- 2025Understanding Sensitivity of Differential Attention through the Lens of Adversarial Robustness1 Oct 2025
- 2025On the Complexity-Faithfulness Trade-off of Gradient-Based Explanations14 Aug 2025
- 2025FREQuency ATTribution: benchmarking frequency-based occlusion for time series data23 Jun 2025
- 2024DFT-Based Adversarial Attack Detection in MRI Brain Imaging: Enhancing Diagnostic Accuracy in Alzheimer's Case Studies16 Aug 2024
- 2024Interpreting Global Perturbation Robustness of Image Models using Axiomatic Spectral Importance Decomposition2 Aug 2024
- 2024FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attacks30 Jul 2024
- 2024Towards a Novel Perspective on Adversarial Examples Driven by Frequency16 Apr 2024
- 2023On the Foundations of Shortcut Learning24 Oct 2023
- 2023Frequency maps reveal the correlation between Adversarial Attacks and Implicit Bias24 May 2023
- 2023Exploiting Frequency Spectrum of Adversarial Images for General Robustness15 May 2023
19 more
- 2023Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies3 Mar 2023
- 2023Fourier Sensitivity and Regularization of Computer Vision Models31 Jan 2023
- 2022Aliasing is a Driver of Adversarial Attacks22 Dec 2022
- 2022Universal Adversarial Directions28 Oct 2022
- 2022Robustness and invariance properties of image classifiers30 Aug 2022
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?9 May 2022
- 2022Understanding robustness and generalization of artificial neural networks through Fourier masks16 Mar 2022
- 2022Adversarial amplitude swap towards robust image classifiers14 Mar 2022
- 2022Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibration24 Feb 2022
- 2022FourierNet: Shape-Preserving Network for Henle's Fiber Layer Segmentation in Optical Coherence Tomography Images17 Jan 2022
- 2021Detecting AutoAttack Perturbations in the Frequency Domain16 Nov 2021
- 2021A Frequency Perspective of Adversarial Robustness26 Oct 2021
- 2021Frequency Centric Defense Mechanisms against Adversarial Examples26 Oct 2021
- 2021Simple black-box universal adversarial attacks on medical image classification based on deep neural networks11 Aug 2021
- 2021F-Drop&Match: GANs with a Dead Zone in the High-Frequency Domain4 Jun 2021
- 2021Real-time Detection of Practical Universal Adversarial Perturbations16 May 2021
- 2021Relative stability toward diffeomorphisms indicates performance in deep nets6 May 2021
- 2021SpectralDefense: Detecting Adversarial Attacks on CNNs in the Fourier Domain4 Mar 2021
- 2021Bridging the Gap Between Adversarial Robustness and Optimization Bias17 Feb 2021
- 2023On the Foundations of Shortcut Learningcited by 64
- 2021SpectralDefense: Detecting Adversarial Attacks on CNNs in the Fourier Domaincited by 30
- 2021A Frequency Perspective of Adversarial Robustnesscited by 28
- 2021Relative stability toward diffeomorphisms indicates performance in deep netscited by 12
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?cited by 11
- 2021Detecting AutoAttack Perturbations in the Frequency Domaincited by 10
- 2024FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attackscited by 8
- 2022Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibrationcited by 7
- 2023Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequenciescited by 7
- 2021Real-time Detection of Practical Universal Adversarial Perturbationscited by 6
- 2021Bridging the Gap Between Adversarial Robustness and Optimization Biascited by 5
- 2021Frequency Centric Defense Mechanisms against Adversarial Examplescited by 3
12 most cited of 29 All 29 (JSON)
- 2025Understanding Sensitivity of Differential Attention through the Lens of Adversarial Robustness1 Oct 2025
- 2025On the Complexity-Faithfulness Trade-off of Gradient-Based Explanations14 Aug 2025
- 2025FREQuency ATTribution: benchmarking frequency-based occlusion for time series data23 Jun 2025
- 2024DFT-Based Adversarial Attack Detection in MRI Brain Imaging: Enhancing Diagnostic Accuracy in Alzheimer's Case Studies16 Aug 2024
- 2024Interpreting Global Perturbation Robustness of Image Models using Axiomatic Spectral Importance Decomposition2 Aug 2024
- 2024FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attacks30 Jul 2024
- 2024Towards a Novel Perspective on Adversarial Examples Driven by Frequency16 Apr 2024
- 2023On the Foundations of Shortcut Learning24 Oct 2023
- 2023Frequency maps reveal the correlation between Adversarial Attacks and Implicit Bias24 May 2023
- 2023Exploiting Frequency Spectrum of Adversarial Images for General Robustness15 May 2023
- 2023Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies3 Mar 2023
- 2023Fourier Sensitivity and Regularization of Computer Vision Models31 Jan 2023
12 newest of 29 All 29 (JSON)