PatchZero: Defending against Adversarial Patch Attacks by Detecting and Zeroing the Patch
Not on the map. Why?
Abstract (arXiv)
Adversarial patch attacks mislead neural networks by injecting adversarial pixels within a local region. Patch attacks can be highly effective in a variety of tasks and physically realizable via attachment (e.g. a sticker) to the real-world objects. Despite the diversity in attack patterns, adversarial patches tend to be highly textured and different in appearance from natural images. We exploit this property and present PatchZero, a general defense pipeline against white-box adversarial patches without retraining the downstream classifier or detector. Specifically, our defense detects adversaries at the pixel-level and "zeros out" the patch region by repainting with mean pixel values. We further design a two-stage adversarial training scheme to defend against the stronger adaptive attacks. PatchZero achieves SOTA defense performance on the image classification (ImageNet, RESISC45), object detection (PASCAL VOC), and video classification (UCF101) tasks with little degradation in benign performance. In addition, PatchZero transfers to different patch shapes and attack types.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 5 Jul 2022.
Builds on
38 of 49 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
26 more
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 685
- 2017Countering Adversarial Images using Input Transformationscited by 520
- 2017Adversarial Patchcited by 517
- 2017PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examplescited by 244
- 2018Adversarial Logit Pairingcited by 224
- 2016A study of the effect of JPG compression on adversarial imagescited by 197
- 2018DPatch: An Adversarial Patch Attack on Object Detectorscited by 147
- 2018LaVAN: Localized and Visible Adversarial Noisecited by 113
- 2020Certified Defenses for Adversarial Patchescited by 101
- 2020(De)Randomized Smoothing for Certifiable Defense against Patch Attackscited by 98
- 2019On Physical Adversarial Patches for Object Detectioncited by 93
- 2018Local Gradients Smoothing: Defense against localized adversarial attackscited by 87
- 2018Universal Adversarial Trainingcited by 87
- 2021Segment and Complete: Defending Object Detectors against Adversarial Patch Attacks with Robust Patch Detectioncited by 67
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 65
- 2020Adversarial Training against Location-Optimized Adversarial Patchescited by 50
- 2020Detection as Regression: Certified Object Detection by Median Smoothingcited by 47
- 2019Role of Spatial Context in Adversarial Robustness for Object Detectioncited by 35
- 2021DetectorGuard: Provably Securing Object Detectors against Localized Patch Hiding Attackscited by 29
- 2021PatchGuard++: Efficient Provable Attack Detection against Adversarial Patchescited by 29
- 2020Defending Against Multiple and Unforeseen Adversarial Videoscited by 19
- 2021DI-AA: An Interpretable White-box Attack for Fooling Deep Neural Networkscited by 10
- 2020Overcomplete Representations Against Adversarial Videoscited by 6
- 2021We Can Always Catch You: Detecting Adversarial Patched Objects WITH or WITHOUT Signaturecited by 6
- 2020MultAV: Multiplicative Adversarial Videoscited by 5
Built on by
Citing papers per year: 2023: 6; 2024: 9; 2025: 10; 2026: 5.
30 papers.
Sort:
By area:
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attackscited by 32
- 2023PatchCURE: Improving Certifiable Robustness, Model Utility, and Computation Efficiency of Adversarial Patch Defensescited by 11
- 2023Adversarial Examples in the Physical World: A Surveycited by 10
- 2025Safety of Embodied Navigation: A Surveycited by 10
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patchescited by 4
- 2024Breaking the Illusion: Real-world Challenges for Adversarial Patches in Object Detectioncited by 4
- 2023PatchBackdoor: Backdoor Attack against Deep Neural Networks without Model Modificationcited by 3
- 2023Attention-Based Real-Time Defenses for Physical Adversarial Attacks in Vision Applicationscited by 3
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computingcited by 3
- 2025PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detectioncited by 3
- 2024Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectorscited by 2
- 2023X-Detect: Explainable Adversarial Patch Detection for Object Detectors in Retailcited by 1
18 more
- 2023Runtime Stealthy Perception Attacks against DNN-based Adaptive Cruise Control Systemscited by 1
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifoldscited by 1
- 2024How to beat a Bayesian adversarycited by 1
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challengescited by 1
- 2025GAN-Based Single-Stage Defense for Traffic Sign Classification Under Adversarial Patchcited by 1
- 2025IAP: Invisible Adversarial Patch Attack through Perceptibility-Aware Localization and Perturbation Optimizationcited by 1
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environmentscited by 1
- 2025Concept-Based Masking: A Patch-Agnostic Defense Against Adversarial Patch Attackscited by 1
- 2025A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical Worldcited by 1
- 2024Universal Multi-view Black-box Attack against Object Detectors via Layout Optimizationcited by 0
- 2024RED: Robust Environmental Designcited by 0
- 2025SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Modelscited by 0
- 2025SpaNN: Detecting Multiple Adversarial Patches on CNNs by Spanning Saliency Thresholdscited by 0
- 2026Defending against Patch-Based and Texture-Based Adversarial Attacks with Spectral Decompositioncited by 0
- 2026The Unseen Adversaries: Robust and Generalized Defense Against Adversarial Patchescited by 0
- 2026Detectors Learn the Wrong Thing: Shortcut-Resistant Adversarial Training Against Physically Realizable Attackscited by 0
- 2026AdROD: HyperNetwork-based Adversarially Robust Object Detection for Autonomous Drivingcited by 0
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Modelscited by 0
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Models21 Aug 2026
- 2026AdROD: HyperNetwork-based Adversarially Robust Object Detection for Autonomous Driving17 Aug 2026
- 2026Detectors Learn the Wrong Thing: Shortcut-Resistant Adversarial Training Against Physically Realizable Attacks23 Jul 2026
- 2026The Unseen Adversaries: Robust and Generalized Defense Against Adversarial Patches29 Apr 2026
- 2026Defending against Patch-Based and Texture-Based Adversarial Attacks with Spectral Decomposition12 Apr 2026
- 2025A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical World20 Oct 2025
- 2025Concept-Based Masking: A Patch-Agnostic Defense Against Adversarial Patch Attacks5 Oct 2025
- 2025Safety of Embodied Navigation: A Survey7 Aug 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 2025IAP: Invisible Adversarial Patch Attack through Perceptibility-Aware Localization and Perturbation Optimization9 Jul 2025
- 2025PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detection30 Jun 2025
- 2025SpaNN: Detecting Multiple Adversarial Patches on CNNs by Spanning Saliency Thresholds23 Jun 2025
18 more
- 2025SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models22 May 2025
- 2025GAN-Based Single-Stage Defense for Traffic Sign Classification Under Adversarial Patch16 Mar 2025
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challenges1 Mar 2025
- 2024RED: Robust Environmental Design26 Nov 2024
- 2024Breaking the Illusion: Real-world Challenges for Adversarial Patches in Object Detection23 Oct 2024
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computing22 Aug 2024
- 2024How to beat a Bayesian adversary11 Jul 2024
- 2024Universal Multi-view Black-box Attack against Object Detectors via Layout Optimization9 Jul 2024
- 2024Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectors21 Jun 2024
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attacks25 Apr 2024
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches31 Mar 2024
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds12 Jan 2024
- 2023Attention-Based Real-Time Defenses for Physical Adversarial Attacks in Vision Applications19 Nov 2023
- 2023Adversarial Examples in the Physical World: A Survey1 Nov 2023
- 2023PatchCURE: Improving Certifiable Robustness, Model Utility, and Computation Efficiency of Adversarial Patch Defenses19 Oct 2023
- 2023PatchBackdoor: Backdoor Attack against Deep Neural Networks without Model Modification22 Aug 2023
- 2023Runtime Stealthy Perception Attacks against DNN-based Adaptive Cruise Control Systems18 Jul 2023
- 2023X-Detect: Explainable Adversarial Patch Detection for Object Detectors in Retail14 Jun 2023
- 2024PAD: Patch-Agnostic Defense against Adversarial Patch Attackscited by 32
- 2023PatchCURE: Improving Certifiable Robustness, Model Utility, and Computation Efficiency of Adversarial Patch Defensescited by 11
- 2023Adversarial Examples in the Physical World: A Surveycited by 10
- 2025Safety of Embodied Navigation: A Surveycited by 10
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patchescited by 4
- 2024Breaking the Illusion: Real-world Challenges for Adversarial Patches in Object Detectioncited by 4
- 2023PatchBackdoor: Backdoor Attack against Deep Neural Networks without Model Modificationcited by 3
- 2023Attention-Based Real-Time Defenses for Physical Adversarial Attacks in Vision Applicationscited by 3
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computingcited by 3
- 2025PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detectioncited by 3
- 2024Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectorscited by 2
- 2023X-Detect: Explainable Adversarial Patch Detection for Object Detectors in Retailcited by 1
12 most cited of 27 All 27 (JSON)
- 2026Detectors Learn the Wrong Thing: Shortcut-Resistant Adversarial Training Against Physically Realizable Attacks23 Jul 2026
- 2026The Unseen Adversaries: Robust and Generalized Defense Against Adversarial Patches29 Apr 2026
- 2026Defending against Patch-Based and Texture-Based Adversarial Attacks with Spectral Decomposition12 Apr 2026
- 2025A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical World20 Oct 2025
- 2025Concept-Based Masking: A Patch-Agnostic Defense Against Adversarial Patch Attacks5 Oct 2025
- 2025Safety of Embodied Navigation: A Survey7 Aug 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 2025IAP: Invisible Adversarial Patch Attack through Perceptibility-Aware Localization and Perturbation Optimization9 Jul 2025
- 2025PBCAT: Patch-based composite adversarial training against physically realizable attacks on object detection30 Jun 2025
- 2025SpaNN: Detecting Multiple Adversarial Patches on CNNs by Spanning Saliency Thresholds23 Jun 2025
- 2025SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models22 May 2025
- 2025GAN-Based Single-Stage Defense for Traffic Sign Classification Under Adversarial Patch16 Mar 2025
12 newest of 27 All 27 (JSON)