Fooling thermal infrared pedestrian detectors in real world using small bulbs
Not on the map. Why?
Abstract (arXiv)
Thermal infrared detection systems play an important role in many areas such as night security, autonomous driving, and body temperature detection. They have the unique advantages of passive imaging, temperature sensitivity and penetration. But the security of these systems themselves has not been fully explored, which poses risks in applying these systems. We propose a physical attack method with small bulbs on a board against the state of-the-art pedestrian detectors. Our goal is to make infrared pedestrian detectors unable to detect real-world pedestrians. Towards this goal, we first showed that it is possible to use two kinds of patches to attack the infrared pedestrian detector based on YOLOv3. The average precision (AP) dropped by 64.12% in the digital world, while a blank board with the same size caused the AP to drop by 29.69% only. After that, we designed and manufactured a physical board and successfully attacked YOLOv3 in the real world. In recorded videos, the physical board caused AP of the target detector to drop by 34.48%, while a blank board with the same size caused the AP to drop by 14.91% only. With the ensemble attack techniques, the designed physical board had good transferability to unseen detectors. We also proposed the first physical multispectral (infrared and visible) attack. By using a combination method, we successfully hide from the visible light and infrared object detection systems at the same time.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 20 Jan 2021.
Builds on
16 of 30 references.
References · 16
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2016Adversarial Machine Learning at Scalecited by 934
- 2016Universal adversarial perturbationscited by 774
- 2019Fooling automated surveillance cameras: adversarial patches to attack person detectioncited by 268
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
4 more
- 2018Invisible Mask: Practical Attacks on Face Recognition with Infraredcited by 33
- 2019Adversarial T-shirt! Evading Person Detectors in A Physical Worldcited by 13
- 2020End-to-End Face Parsing via Interlinked Convolutional Neural Networkscited by 6
- 2016Linear Support Tensor Machine: Pedestrian Detection in Thermal Infrared Imagescited by 2
Built on by
Citing papers per year: 2022: 10; 2023: 18; 2024: 10; 2025: 6; 2026: 7.
51 papers.
Sort:
By area:
- 2022Adversarial Texture for Fooling Person Detectors in the Physical Worldcited by 96
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 58
- 2022Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real Worldcited by 42
- 2023Physically Realizable Natural-Looking Clothing Textures Evade Person Detectors via 3D Modelingcited by 41
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locationscited by 38
- 2022HOTCOLD Block: Fooling Thermal Infrared Detectors with a Novel Wearable Designcited by 27
- 2023Unified Adversarial Patch for Cross-modal Attacks in the Physical Worldcited by 27
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustnesscited by 23
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2024SceneTAP: Scene-Coherent Typographic Adversarial Planner against Vision-Language Models in Real-World Environmentscited by 22
38 more
- 2023Unified Adversarial Patch for Visible-Infrared Cross-modal Attacks in the Physical Worldcited by 21
- 2022Defensive Patches for Robust Recognition in the Physical Worldcited by 20
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
- 2022Recognizing Object by Components with Human Prior Knowledge Enhances Adversarial Robustness of Deep Neural Networkscited by 18
- 2023Physical Adversarial Attacks for Surveillance: A Surveycited by 15
- 2023On the Importance of Backbone to the Adversarial Robustness of Object Detectorscited by 12
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical Worldcited by 11
- 2023Adversarial Examples in the Physical World: A Surveycited by 10
- 2023Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical Worldcited by 10
- 2023State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systemscited by 8
- 2024Infrared Adversarial Car Stickerscited by 8
- 2023CBA: Contextual Background Attack against Optical Aerial Detection in the Physical Worldcited by 7
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNscited by 6
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2024Real-world Adversarial Defense against Patch Attacks based on Diffusion Modelcited by 5
- 2025Adversarial Attacks on Event-Based Pedestrian Detectors: A Physical Approachcited by 5
- 2023Defending Against Physical Adversarial Patch Attacks on Infrared Human Detectioncited by 4
- 2023Two-stage optimized unified adversarial patch for attacking visible-infrared cross-modal detectors in the physical worldcited by 4
- 2024Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical Worldcited by 4
- 2024BadPatch: Diffusion-Based Generation of Physical Adversarial Patchescited by 4
- 2024Out-of-Bounding-Box Triggers: A Stealthy Approach to Cheat Object Detectorscited by 3
- 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systemscited by 3
- 2024Multi-View Black-Box Physical Attacks on Infrared Pedestrian Detectors Using Adversarial Infrared Gridcited by 1
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challengescited by 1
- 2025Learning Fourier shapes to probe the geometric world of deep neural networkscited by 1
- 2026Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modelingcited by 1
- 2026Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Patterncited by 1
- 2024Adversarial Infrared Geometry: Using Geometry to Perform Adversarial Attack against Infrared Pedestrian Detectorscited by 0
- 2024PADetBench: Towards Benchmarking Physical Attacks against Object Detectioncited by 0
- 2025Towards an End-to-End (E2E) Adversarial Learning and Application in the Physical Worldcited by 0
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessoriescited by 0
- 2025Human-Imperceptible Physical Adversarial Attack for NIR Face Recognition Modelscited by 0
- 2026Thermal Topology Collapse: Universal Physical Patch Attacks on Infrared Vision Systemscited by 0
- 2026Physical Adversarial Attacks on AI Surveillance Systems:Detection, Tracking, and Visible--Infrared Evasioncited by 0
- 2026Unleashing the Representational Power of Fourier Shapes for Attacking Infrared Object Detectioncited by 0
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modelingcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Stealthy in Semantics, Antagonistic in Space: Attacking Visible-Infrared Object Detectors via Object-Level Misalignment16 Sep 2026
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Unleashing the Representational Power of Fourier Shapes for Attacking Infrared Object Detection18 May 2026
- 2026Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Pattern6 May 2026
- 2026Physical Adversarial Attacks on AI Surveillance Systems:Detection, Tracking, and Visible--Infrared Evasion8 Apr 2026
- 2026Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modeling26 Mar 2026
- 2026Thermal Topology Collapse: Universal Physical Patch Attacks on Infrared Vision Systems23 Mar 2026
- 2025Learning Fourier shapes to probe the geometric world of deep neural networks7 Nov 2025
- 2025Human-Imperceptible Physical Adversarial Attack for NIR Face Recognition Models22 Apr 2025
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challenges1 Mar 2025
- 2025Adversarial Attacks on Event-Based Pedestrian Detectors: A Physical Approach1 Mar 2025
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessories26 Jan 2025
38 more
- 2025Towards an End-to-End (E2E) Adversarial Learning and Application in the Physical World14 Jan 2025
- 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systems18 Dec 2024
- 2024BadPatch: Diffusion-Based Generation of Physical Adversarial Patches2 Dec 2024
- 2024SceneTAP: Scene-Coherent Typographic Adversarial Planner against Vision-Language Models in Real-World Environments28 Nov 2024
- 2024Out-of-Bounding-Box Triggers: A Stealthy Approach to Cheat Object Detectors14 Oct 2024
- 2024Real-world Adversarial Defense against Patch Attacks based on Diffusion Model14 Sep 2024
- 2024PADetBench: Towards Benchmarking Physical Attacks against Object Detection17 Aug 2024
- 2024Multi-View Black-Box Physical Attacks on Infrared Pedestrian Detectors Using Adversarial Infrared Grid1 Jul 2024
- 2024Infrared Adversarial Car Stickers16 May 2024
- 2024Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical World30 Apr 2024
- 2024Adversarial Infrared Geometry: Using Geometry to Perform Adversarial Attack against Infrared Pedestrian Detectors6 Mar 2024
- 2023Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical World21 Dec 2023
- 2023Two-stage optimized unified adversarial patch for attacking visible-infrared cross-modal detectors in the physical world4 Dec 2023
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023
- 2023Adversarial Examples in the Physical World: A Survey1 Nov 2023
- 2023Defending Against Physical Adversarial Patch Attacks on Infrared Human Detection27 Sep 2023
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlook11 Aug 2023
- 2023Unified Adversarial Patch for Visible-Infrared Cross-modal Attacks in the Physical World27 Jul 2023
- 2023Unified Adversarial Patch for Cross-modal Attacks in the Physical World15 Jul 2023
- 2023Physically Realizable Natural-Looking Clothing Textures Evade Person Detectors via 3D Modeling4 Jul 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023On the Importance of Backbone to the Adversarial Robustness of Object Detectors27 May 2023
- 2023Physical Adversarial Attacks for Surveillance: A Survey1 May 2023
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical World21 Apr 2023
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locations24 Mar 2023
- 2023State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systems22 Mar 2023
- 2023CBA: Contextual Background Attack against Optical Aerial Detection in the Physical World27 Feb 2023
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detection19 Feb 2023
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustness30 Jan 2023
- 2022HOTCOLD Block: Fooling Thermal Infrared Detectors with a Novel Wearable Design12 Dec 2022
- 2022Recognizing Object by Components with Human Prior Knowledge Enhances Adversarial Robustness of Deep Neural Networks4 Dec 2022
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Survey3 Nov 2022
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Survey30 Sep 2022
- 2022A Survey on Physical Adversarial Attack in Computer Vision28 Sep 2022
- 2022Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real World12 May 2022
- 2022Defensive Patches for Robust Recognition in the Physical World13 Apr 2022
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNs2 Apr 2022
- 2022SoK: On the Semantic AI Security in Autonomous Driving10 Mar 2022
50 newest of 51 All 51 (JSON)
- 2022Adversarial Texture for Fooling Person Detectors in the Physical Worldcited by 96
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 58
- 2022Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real Worldcited by 42
- 2023Physically Realizable Natural-Looking Clothing Textures Evade Person Detectors via 3D Modelingcited by 41
- 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locationscited by 38
- 2022HOTCOLD Block: Fooling Thermal Infrared Detectors with a Novel Wearable Designcited by 27
- 2023Unified Adversarial Patch for Cross-modal Attacks in the Physical Worldcited by 27
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustnesscited by 23
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2023Unified Adversarial Patch for Visible-Infrared Cross-modal Attacks in the Physical Worldcited by 21
12 most cited of 47 All 47 (JSON)
- 2026Stealthy in Semantics, Antagonistic in Space: Attacking Visible-Infrared Object Detectors via Object-Level Misalignment16 Sep 2026
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Unleashing the Representational Power of Fourier Shapes for Attacking Infrared Object Detection18 May 2026
- 2026Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Pattern6 May 2026
- 2026Physical Adversarial Attacks on AI Surveillance Systems:Detection, Tracking, and Visible--Infrared Evasion8 Apr 2026
- 2026Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modeling26 Mar 2026
- 2026Thermal Topology Collapse: Universal Physical Patch Attacks on Infrared Vision Systems23 Mar 2026
- 2025Learning Fourier shapes to probe the geometric world of deep neural networks7 Nov 2025
- 2025Human-Imperceptible Physical Adversarial Attack for NIR Face Recognition Models22 Apr 2025
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challenges1 Mar 2025
- 2025Adversarial Attacks on Event-Based Pedestrian Detectors: A Physical Approach1 Mar 2025
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessories26 Jan 2025
12 newest of 47 All 47 (JSON)