SparseFool: a few pixels make a big difference
Not on the map. Why?
Abstract (arXiv)
Deep Neural Networks have achieved extraordinary results on image classification tasks, but have been shown to be vulnerable to attacks with carefully crafted perturbations of the input data. Although most attacks usually change values of many image's pixels, it has been shown that deep networks are also vulnerable to sparse alterations of the input. However, no computationally efficient method has been proposed to compute sparse perturbations. In this paper, we exploit the low mean curvature of the decision boundary, and propose SparseFool, a geometry inspired sparse attack that controls the sparsity of the perturbations. Extensive evaluations show that our approach computes sparse perturbations very fast, and scales efficiently to high dimensional data. We further analyze the transferability and the visual effects of the perturbations, and show the existence of shared semantic information across the images and the networks. Finally, we show that adversarial training can only slightly improve the robustness against sparse additive perturbations computed with SparseFool.
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 19; 2023: 11; 2024: 20; 2025: 14; 2026: 7.
94 papers.
Sort:
By area:
- 2021On Improving Adversarial Transferability of Vision Transformerscited by 70
- 2021Fast Minimum-norm Adversarial Attacks through Adaptive Norm Constraintscited by 50
- 2021Mind the box: l1-APGD for sparse adversarial attacks on image classifierscited by 50
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 47
- 2021A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimizationcited by 46
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 35
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2021Adversarial Robustness against Multiple and Single lp-Threat Models via Quick Fine-Tuning of Robust Classifierscited by 23
- 2022Physical-World Optical Adversarial Attacks on 3D Face Recognitioncited by 23
- 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
38 more
- 2021Adversarial Imaging Pipelinescited by 15
- 2021Sparse and Imperceptible Adversarial Attack via a Homotopy Algorithmcited by 15
- 2021Adversarial Attacks on Spiking Convolutional Neural Networks for Event-based Visioncited by 14
- 2024AttackBench: Evaluating Gradient-based Attacks for Adversarial Examplescited by 14
- 2022Query Efficient Decision Based Sparse Attacks Against Black-Box Deep Learning Modelscited by 13
- 2022Fooling Explanations in Text Classifierscited by 13
- 2024Understanding Robustness of Visual State Space Models for Image Classificationcited by 12
- 2024Exploring Vulnerabilities of No-Reference Image Quality Assessment Models: A Query-Based Black-Box Methodcited by 10
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspectivecited by 10
- 2021Transferable Sparse Adversarial Attackcited by 9
- 2023Hierarchical Randomized Smoothingcited by 9
- 2025Towards Effective and Sparse Adversarial Attack on Spiking Neural Networks via Breaking Invisible Surrogate Gradientscited by 9
- 2021PDPGD: Primal-Dual Proximal Gradient Descent Adversarial Attackcited by 8
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 8
- 2022AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classificationcited by 7
- 2024σ-zero: Gradient-based Optimization of ℓ0-norm Adversarial Examplescited by 7
- 2024BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attackcited by 7
- 2025TarPro: Targeted Protection against Malicious Image Editingcited by 7
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Modelscited by 6
- 2021Robust Classification Under ℓ0 Attack for the Gaussian Mixture Modelcited by 5
- 2022Adversarial Scratches: Deployable Attacks to CNN Classifierscited by 5
- 2023Adversarial Attacks and Defenses on 3D Point Cloud Classification: A Surveycited by 5
- 2023GSE: Group-wise Sparse and Explainable Adversarial Attackscited by 5
- 2021Reachability Analysis of Convolutional Neural Networkscited by 4
- 2022On the uncertainty principle of neural networkscited by 4
- 2023Continual Adversarial Defensecited by 4
- 2024Quantum-Inspired Analysis of Neural Network Vulnerabilities: The Role of Conjugate Variables in System Attackscited by 4
- 2024Sparse-PGD: A Unified Framework for Sparse Adversarial Perturbations Generationcited by 4
- 2024Natural Language Induced Adversarial Imagescited by 4
- 2021Lagrangian Objective Function Leads to Improved Unforeseen Attack Generalization in Adversarial Trainingcited by 3
- 2021An Overview of Laser Injection against Embedded Neural Network Modelscited by 3
- 2021Transferable Adversarial Examples for Anchor Free Object Detectioncited by 3
- 2021EG-Booster: Explanation-Guided Booster of ML Evasion Attackscited by 3
- 2021Amicable Aid: Perturbing Images to Improve Classification Performancecited by 3
- 2022Learning to Accelerate Approximate Methods for Solving Integer Programming via Early Fixingcited by 3
- 2022LP-BFGS attack: An adversarial attack based on the Hessian with limited pixelscited by 3
- 2023Attacking Important Pixels for Anchor-free Detectorscited by 3
- 2024Theoretical Understanding of Learning from Adversarial Perturbationscited by 2
50 most cited of 94 All 94 (JSON)
- 2026Don't Waste the Noise: Importance-Guided Perturbation Allocation under Joint Global and Local Constraints1 Oct 2026
- 2026Uncovering the Limits of Proof Sharing for Neural Networks19 Aug 2026
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026Fast LapSum: Exact Differentiable Top-k at Million Scale7 Aug 2026
- 2026RoME: Robust Mixture of Low-Rank Experts against Multiple Adversarial Perturbations7 Jul 2026
- 2026Right Predictions, Misleading Explanations: On the Vulnerability of Vision-Language Model Explanations15 May 2026
- 2026XSPA: Crafting Imperceptible X-Shaped Sparse Adversarial Perturbations for Transferable Attacks on VLMs30 Mar 2026
- 2025SPOOF: Simple Pixel Operations for Out-of-Distribution Fooling5 Dec 2025
- 2025Fine-Grained Iterative Adversarial Attacks with Limited Computation Budget30 Oct 2025
- 2025A Versatile Framework for Designing Group-Sparse Adversarial Attacks18 Oct 2025
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025Towards Interpretable Adversarial Examples via Sparse Adversarial Attack8 Jun 2025
38 more
- 2025Lorica: A Synergistic Fine-Tuning Framework for Advancing Personalized Adversarial Robustness4 Jun 2025
- 2025Input-Specific and Universal Adversarial Attack Generation for Spiking Neural Networks in the Spiking Domain7 May 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2025Rethinking Robustness in Machine Learning: A Posterior Agreement Approach20 Mar 2025
- 2025TarPro: Targeted Protection against Malicious Image Editing18 Mar 2025
- 2025Towards Effective and Sparse Adversarial Attack on Spiking Neural Networks via Breaking Invisible Surrogate Gradients5 Mar 2025
- 2025Fast Adversarial Training against Sparse Attacks Requires Loss Smoothing28 Feb 2025
- 2025Boosting Adversarial Robustness and Generalization with Dictionary Structure2 Feb 2025
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspective7 Jan 2025
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Models16 Dec 2024
- 2024Sparse patches adversarial attacks via extrapolating point-wise information25 Nov 2024
- 2024Natural Language Induced Adversarial Images11 Oct 2024
- 2024Discerning the Chaos: Detecting Adversarial Perturbations while Disentangling Intentional from Unintentional Noises29 Sep 2024
- 2024Hidden Activations Are Not Enough: A General Approach to Neural Network Predictions20 Sep 2024
- 2024Probabilistic Iterative Hard Thresholding for Sparse Learning2 Sep 2024
- 2024Interpreting Global Perturbation Robustness of Image Models using Axiomatic Spectral Importance Decomposition2 Aug 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024Improving Adversarial Robustness via Decoupled Visual Representation Masking16 Jun 2024
- 2024Sparse-PGD: A Unified Framework for Sparse Adversarial Perturbations Generation8 May 2024
- 2024AttackBench: Evaluating Gradient-based Attacks for Adversarial Examples30 Apr 2024
- 2024BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attack8 Apr 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024Understanding Robustness of Visual State Space Models for Image Classification16 Mar 2024
- 2024Quantum-Inspired Analysis of Neural Network Vulnerabilities: The Role of Conjugate Variables in System Attacks16 Feb 2024
- 2024Theoretical Understanding of Learning from Adversarial Perturbations16 Feb 2024
- 2024σ-zero: Gradient-based Optimization of ℓ0-norm Adversarial Examples2 Feb 2024
- 2024STAA-Net: A Sparse and Transferable Adversarial Attack for Speech Emotion Recognition2 Feb 2024
- 2024Sparse and Transferable Universal Singular Vectors Attack25 Jan 2024
- 2024Exploring Vulnerabilities of No-Reference Image Quality Assessment Models: A Query-Based Black-Box Method10 Jan 2024
- 2023Continual Adversarial Defense15 Dec 2023
- 2023GSE: Group-wise Sparse and Explainable Adversarial Attacks29 Nov 2023
- 2023Hierarchical Randomized Smoothing24 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanations30 Sep 2023
- 2023AudioFool: Fast, Universal and synchronization-free Cross-Domain Attack on Speech Recognition20 Sep 2023
- 2023Adversarial Attacks and Defenses on 3D Point Cloud Classification: A Survey1 Jul 2023
- 2023AdvCheck: Characterizing Adversarial Examples via Local Gradient Checking25 Mar 2023
- 2023Open-World Object Detection via Discriminative Class Prototype Learning23 Feb 2023
50 newest of 94 All 94 (JSON)
- 2021On Improving Adversarial Transferability of Vision Transformerscited by 70
- 2021Fast Minimum-norm Adversarial Attacks through Adaptive Norm Constraintscited by 50
- 2021Mind the box: l1-APGD for sparse adversarial attacks on image classifierscited by 50
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 47
- 2021A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimizationcited by 46
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 35
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2021Adversarial Robustness against Multiple and Single lp-Threat Models via Quick Fine-Tuning of Robust Classifierscited by 23
- 2022Physical-World Optical Adversarial Attacks on 3D Face Recognitioncited by 23
- 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
12 most cited of 88 All 88 (JSON)
- 2026Don't Waste the Noise: Importance-Guided Perturbation Allocation under Joint Global and Local Constraints1 Oct 2026
- 2026Uncovering the Limits of Proof Sharing for Neural Networks19 Aug 2026
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026Fast LapSum: Exact Differentiable Top-k at Million Scale7 Aug 2026
- 2025SPOOF: Simple Pixel Operations for Out-of-Distribution Fooling5 Dec 2025
- 2025Fine-Grained Iterative Adversarial Attacks with Limited Computation Budget30 Oct 2025
- 2025A Versatile Framework for Designing Group-Sparse Adversarial Attacks18 Oct 2025
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025Towards Interpretable Adversarial Examples via Sparse Adversarial Attack8 Jun 2025
- 2025Lorica: A Synergistic Fine-Tuning Framework for Advancing Personalized Adversarial Robustness4 Jun 2025
- 2025Input-Specific and Universal Adversarial Attack Generation for Spiking Neural Networks in the Spiking Domain7 May 2025
- 2025Rethinking Robustness in Machine Learning: A Posterior Agreement Approach20 Mar 2025
12 newest of 88 All 88 (JSON)