PatchAttack: A Black-box Texture-based Attack with Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Patch-based attacks introduce a perceptible but localized change to the input that induces misclassification. A limitation of current patch-based black-box attacks is that they perform poorly for targeted attacks, and even for the less challenging non-targeted scenarios, they require a large number of queries. Our proposed PatchAttack is query efficient and can break models for both targeted and non-targeted attacks. PatchAttack induces misclassifications by superimposing small textured patches on the input image. We parametrize the appearance of these patches by a dictionary of class-specific textures. This texture dictionary is learned by clustering Gram matrices of feature activations from a VGG backbone. PatchAttack optimizes the position and texture parameters of each patch using reinforcement learning. Our experiments show that PatchAttack achieves > 99% success rate on ImageNet for a wide range of architectures, while only manipulating 3% of the image for non-targeted attacks and 10% on average for targeted attacks. Furthermore, we show that PatchAttack circumvents state-of-the-art adversarial defense methods successfully.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 15; 2024: 15; 2025: 9; 2026: 4.
67 papers.
Sort:
By area:
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 175
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 48
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2022Simultaneously Optimizing Perturbations and Positions for Black-box Adversarial Patch Attackscited by 41
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locationscited by 38
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attackscited by 31
- 2023Frequency Domain-based Dataset Distillationcited by 28
- 2022ImageNet-Patch: A Dataset for Benchmarking Machine Learning Robustness against Adversarial Patchescited by 27
38 more
- 2023RFLA: A Stealthy Reflected Light Adversarial Attack in the Physical Worldcited by 23
- 2022ObjectSeeker: Certifiably Robust Object Detection against Patch Hiding Attacks via Patch-agnostic Maskingcited by 22
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognitioncited by 21
- 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
- 2021Meta Adversarial Training against Universal Patchescited by 19
- 2021Generative Dynamic Patch Attackcited by 19
- 2023Query-Efficient Decision-based Black-Box Patch Attackcited by 19
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 18
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Surveycited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2021Attacking Video Recognition Models with Bullet-Screen Commentscited by 16
- 2022PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognitioncited by 16
- 2023Black-box Targeted Adversarial Attack on Segment Anything (SAM)cited by 13
- 2024Breaking Barriers in Physical-World Adversarial Examples: Improving Robustness and Transferability via Robust Featurecited by 13
- 2021Reinforcement Learning Based Sparse Black-box Adversarial Attack on Video Recognition Modelscited by 12
- 2024Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Modelscited by 11
- 2023PatchCURE: Improving Certifiable Robustness, Model Utility, and Computation Efficiency of Adversarial Patch Defensescited by 10
- 2023TrajPAC: Towards Robustness Verification of Pedestrian Trajectory Prediction Modelscited by 8
- 2023LogoStyleFool: Vitiating Video Recognition Systems via Logo Style Transfercited by 6
- 2024Towards Physically Realizable Adversarial Attacks in Embodied Vision Navigationcited by 6
- 2022Adversarial Scratches: Deployable Attacks to CNN Classifierscited by 5
- 2022Scale-free and Task-agnostic Attack: Generating Photo-realistic Adversarial Patterns with Patch Quilting Generatorcited by 5
- 2023Patch of Invisibility: Naturalistic Physical Black-Box Adversarial Attacks on Object Detectorscited by 5
- 2021Multiplicative Reweighting for Robust Neural Network Optimizationcited by 4
- 2021Patch Shortcuts: Interpretable Proxy Models Efficiently Find Black-Box Vulnerabilitiescited by 4
- 2022On the interplay of adversarial robustness and architecture components: patches, convolution and attentioncited by 4
- 2024Sparse-PGD: A Unified Framework for Sparse Adversarial Perturbations Generationcited by 4
- 2026SoK: The Pitfalls of Deep Reinforcement Learning for Cybersecuritycited by 4
- 2021The Duo of Artificial Intelligence and Big Data for Industry 4.0: Review of Applications, Techniques, Challenges, and Future Research Directionscited by 3
- 2023Distributional Modeling for Location-Aware Adversarial Patchescited by 3
- 2024BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Taskscited by 3
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computingcited by 3
- 2025MFFI: Multi-Dimensional Face Forgery Image Dataset for Real-World Scenarioscited by 3
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijackingcited by 3
- 2023Agnostic Multi-Robust Learning Using ERMcited by 2
- 2024Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinementcited by 2
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systemscited by 2
- 2025Amnesia as a Catalyst for Enhancing Black Box Pixel Attacks in Image Classification and Object Detectioncited by 2
50 most cited of 67 All 67 (JSON)
- 2026Budget-Aware Adaptive Adversarial Patches for Black-Box Object Detection16 Jun 2026
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking27 May 2026
- 2026SoK: The Pitfalls of Deep Reinforcement Learning for Cybersecurity9 Feb 2026
- 2026Adversarial Vulnerability Transcends Computational Paradigms: Feature Engineering Provides No Defense Against Neural Adversarial Transfer29 Jan 2026
- 2025CertMask: Certifiable Defense Against Adversarial Patches via Theoretically Optimal Mask Coverage13 Nov 2025
- 2025FeatureFool: Zero-Query Fooling of Video Models via Feature Map21 Oct 2025
- 2025MFFI: Multi-Dimensional Face Forgery Image Dataset for Real-World Scenarios6 Sep 2025
- 2025TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks16 Aug 2025
- 2025Benchmarking Adversarial Patch Selection and Location3 Aug 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models22 May 2025
- 2025On Transfer-based Universal Attacks in Pure Black-box Setting11 Apr 2025
38 more
- 2025Amnesia as a Catalyst for Enhancing Black Box Pixel Attacks in Image Classification and Object Detection10 Feb 2025
- 2024Breaking Barriers in Physical-World Adversarial Examples: Improving Robustness and Transferability via Robust Feature22 Dec 2024
- 2024RED: Robust Environmental Design26 Nov 2024
- 2024Noise as a Double-Edged Sword: Reinforcement Learning Exploits Randomized Defenses in Neural Networks31 Oct 2024
- 2024LLM-Assisted Red Teaming of Diffusion Models through "Failures Are Fated, But Can Be Faded"22 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Towards Physically Realizable Adversarial Attacks in Embodied Vision Navigation16 Sep 2024
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computing22 Aug 2024
- 2024Universal Multi-view Black-box Attack against Object Detectors via Layout Optimization9 Jul 2024
- 2024Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models11 Jun 2024
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systems6 Jun 2024
- 2024Sparse-PGD: A Unified Framework for Sparse Adversarial Perturbations Generation8 May 2024
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attacks25 Apr 2024
- 2024BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Tasks1 Apr 2024
- 2024Towards Adversarial Robustness And Backdoor Mitigation in SSL23 Mar 2024
- 2024Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinement3 Jan 2024
- 2023LogoStyleFool: Vitiating Video Recognition Systems via Logo Style Transfer15 Dec 2023
- 2023Generating Visually Realistic Adversarial Patch5 Dec 2023
- 2023Frequency Domain-based Dataset Distillation15 Nov 2023
- 2023PatchCURE: Improving Certifiable Robustness, Model Utility, and Computation Efficiency of Adversarial Patch Defenses19 Oct 2023
- 2023Black-box Targeted Adversarial Attack on Segment Anything (SAM)16 Oct 2023
- 2023TrajPAC: Towards Robustness Verification of Pedestrian Trajectory Prediction Models11 Aug 2023
- 2023RFLA: A Stealthy Reflected Light Adversarial Attack in the Physical World14 Jul 2023
- 2023Query-Efficient Decision-based Black-Box Patch Attack2 Jul 2023
- 2023Distributional Modeling for Location-Aware Adversarial Patches28 Jun 2023
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Models20 May 2023
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locations24 Mar 2023
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognition21 Mar 2023
- 2023Agnostic Multi-Robust Learning Using ERM15 Mar 2023
- 2023Patch of Invisibility: Naturalistic Physical Black-Box Adversarial Attacks on Object Detectors7 Mar 2023
- 2023An Incremental Gray-box Physical Adversarial Attack on Neural Network Training20 Feb 2023
- 2022Simultaneously Optimizing Perturbations and Positions for Black-box Adversarial Patch Attacks26 Dec 2022
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Prediction19 Sep 2022
- 2022On the interplay of adversarial robustness and architecture components: patches, convolution and attention14 Sep 2022
- 2022PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition21 Aug 2022
- 2022Scale-free and Task-agnostic Attack: Generating Photo-realistic Adversarial Patterns with Patch Quilting Generator12 Aug 2022
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey16 Jun 2022
- 2022Adversarial Scratches: Deployable Attacks to CNN Classifiers20 Apr 2022
50 newest of 67 All 67 (JSON)
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 48
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2022Simultaneously Optimizing Perturbations and Positions for Black-box Adversarial Patch Attackscited by 41
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locationscited by 38
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attackscited by 31
- 2023Frequency Domain-based Dataset Distillationcited by 28
- 2022ImageNet-Patch: A Dataset for Benchmarking Machine Learning Robustness against Adversarial Patchescited by 27
- 2023RFLA: A Stealthy Reflected Light Adversarial Attack in the Physical Worldcited by 23
12 most cited of 64 All 64 (JSON)
- 2026Budget-Aware Adaptive Adversarial Patches for Black-Box Object Detection16 Jun 2026
- 2026SoK: The Pitfalls of Deep Reinforcement Learning for Cybersecurity9 Feb 2026
- 2026Adversarial Vulnerability Transcends Computational Paradigms: Feature Engineering Provides No Defense Against Neural Adversarial Transfer29 Jan 2026
- 2025CertMask: Certifiable Defense Against Adversarial Patches via Theoretically Optimal Mask Coverage13 Nov 2025
- 2025FeatureFool: Zero-Query Fooling of Video Models via Feature Map21 Oct 2025
- 2025MFFI: Multi-Dimensional Face Forgery Image Dataset for Real-World Scenarios6 Sep 2025
- 2025TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks16 Aug 2025
- 2025Benchmarking Adversarial Patch Selection and Location3 Aug 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models22 May 2025
- 2025On Transfer-based Universal Attacks in Pure Black-box Setting11 Apr 2025
- 2025Amnesia as a Catalyst for Enhancing Black Box Pixel Attacks in Image Classification and Object Detection10 Feb 2025
12 newest of 64 All 64 (JSON)