Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patches
Not on the map. Why?
Abstract (arXiv)
Deep learning has substantially boosted the performance of Monocular Depth Estimation (MDE), a critical component in fully vision-based autonomous driving (AD) systems (e.g., Tesla and Toyota). In this work, we develop an attack against learning-based MDE. In particular, we use an optimization-based method to systematically generate stealthy physical-object-oriented adversarial patches to attack depth estimation. We balance the stealth and effectiveness of our attack with object-oriented adversarial design, sensitive region localization, and natural style camouflage. Using real-world driving scenarios, we evaluate our attack on concurrent MDE models and a representative downstream task for AD (i.e., 3D object detection). Experimental results show that our method can generate stealthy, effective, and robust adversarial patches for different target objects and models and achieves more than 6 meters mean depth estimation error and 93% attack success rate (ASR) in object detection with a patch of 1/9 of the vehicle's rear area. Field tests on three different driving routes with a real vehicle indicate that we cause over 6 meters mean depth estimation error and reduce the object detection rate from 90.70% to 5.16% in continuous video frames.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Builds on 46 of its 72 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
46 of 72 references.
References · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 790
- 2017Adversarial Patchcited by 517
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 311
- 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 269
- 2019Fooling automated surveillance cameras: adversarial patches to attack person detectioncited by 268
34 more
- 2018Generating Adversarial Examples with Adversarial Networkscited by 258
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2016A study of the effect of JPG compression on adversarial imagescited by 197
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2017Deep Photo Style Transfercited by 168
- 2018Physical Adversarial Examples for Object Detectorscited by 163
- 2019AdvHat: Real-world adversarial attack on ArcFace Face ID systemcited by 163
- 2018ShapeShifter: Robust Physical Adversarial Attack on Faster R-CNN Object Detectorcited by 159
- 2019Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Drivingcited by 152
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2020Adversarial Camouflage: Hiding Physical-World Attacks with Natural Stylescited by 126
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 105
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2019SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editingcited by 93
- 2021SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentationcited by 87
- 2020Dirty Road Can Attack: Security of Deep Learning based Automated Lane Centering under Physical-World Attackcited by 64
- 2020MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Cameracited by 59
- 2020Adversarial Training against Location-Optimized Adversarial Patchescited by 50
- 2020Bidirectional Attention Network for Monocular Depth Estimationcited by 48
- 2019Attacking Optical Flowcited by 41
- 2020Targeted Adversarial Perturbations for Monocular Depth Predictioncited by 40
- 2021TF-Blender: Temporal Feature Blender for Video Object Detectioncited by 37
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2020DenserNet: Weakly Supervised Visual Localization Using Multi-scale Feature Aggregationcited by 33
- 2019Characterizing Attacks on Deep Reinforcement Learningcited by 31
- 2019Defending against Whitebox Adversarial Attacks via Randomized Discretizationcited by 29
- 2020Adversarial Patch Attacks on Monocular Depth Estimation Networkscited by 29
- 2020LM-Reloc: Levenberg-Marquardt Based Direct Visual Relocalizationcited by 28
- 2020Drift with Devil: Security of Multi-Sensor Fusion based Localization in High-Level Autonomous Driving under GPS Spoofing (Extended Version)cited by 25
- 2020Adversarial Attacks on Monocular Depth Estimationcited by 20
- 2018Injected and Delivered: Fabricating Implicit Control over Actuation Systems by Spoofing Inertial Sensorscited by 10
- 2019Fooling Detection Alone is Not Enough: First Adversarial Attack against Multiple Object Trackingcited by 9
- 2020Monocular Depth Estimators: Vulnerabilities and Attackscited by 7
Built on by
Citing papers per year: 2022: 8; 2023: 18; 2024: 18; 2025: 11; 2026: 2.
57 papers.
Sort:
By area:
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 67
- 2022Visual Recognition with Deep Nearest Centroidscited by 59
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 49
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
- 2023TransFlow: Transformer as Flow Learnercited by 32
- 2023CLUSTSEG: Clustering for Universal Segmentationcited by 32
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Drivingcited by 32
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 25
- 2022A Comprehensive Study of the Robustness for LiDAR-based 3D Object Detectors against Adversarial Attackscited by 22
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
- 2022Learning Equivariant Segmentation with Instance-Unique Queryingcited by 17
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attackscited by 17
38 more
- 2023Ensemble-based Blackbox Attacks on Dense Predictioncited by 16
- 2023The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimationcited by 13
- 2023SAAM: Stealthy Adversarial Attack on Monocular Depth Estimationcited by 12
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaborationcited by 11
- 2023Fusion is Not Enough: Single Modal Attacks on Fusion Models for 3D Object Detectioncited by 11
- 2023APARATE: Adaptive Adversarial Patch for CNN-based Monocular Depth Estimation for Autonomous Navigationcited by 10
- 2023Adversarial Examples in the Physical World: A Surveycited by 10
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2022Towards Unbiased Label Distribution Learning for Facial Pose Estimation Using Anisotropic Spherical Gaussiancited by 7
- 2023CBA: Contextual Background Attack against Optical Aerial Detection in the Physical Worldcited by 7
- 2024Flexible Physical Camouflage Generation Based on a Differential Approachcited by 7
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2024Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learningcited by 6
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2024ProMotion: Prototypes As Motion Learnerscited by 5
- 2024Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attackscited by 5
- 2023A Study on the Generality of Neural Network Structures for Monocular Depth Estimationcited by 4
- 2024SSAP: A Shape-Sensitive Adversarial Patch for Comprehensive Disruption of Monocular Depth Estimation in Autonomous Navigation Applicationscited by 4
- 2024On the Robustness of Language Guidance for Low-Level Vision Tasks: Findings from Depth Estimationcited by 4
- 2024Prototypical Transformer as Unified Motion Learnerscited by 4
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2023Attention-Based Real-Time Defenses for Physical Adversarial Attacks in Vision Applicationscited by 3
- 2024BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Taskscited by 3
- 2024Optical Lens Attack on Deep Learning Based Monocular Depth Estimationcited by 3
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networkscited by 2
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systemscited by 2
- 2023Holistic Prototype Attention Network for Few-Shot VOScited by 1
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Drivingcited by 1
- 2024MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agentscited by 1
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)cited by 1
- 2025Learning Fourier shapes to probe the geometric world of deep neural networkscited by 1
- 2025Guided Diffusion-based Generation of Adversarial Objects for Real-World Monocular Depth Estimation Attackscited by 1
- 2024Physical Adversarial Attack on Monocular Depth Estimation via Shape-Varying Patchescited by 0
- 2024PADetBench: Towards Benchmarking Physical Attacks against Object Detectioncited by 0
- 2024Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attackcited by 0
- 2024Natural Adversaries: Fuzzing Autonomous Vehicles with Realistic Roadside Object Placementscited by 0
50 most cited of 57 All 57 (JSON)
- 2026Adversarial Calibration Attack on Autonomous Vehicles28 Aug 2026
- 2026Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attacks12 Jun 2026
- 2025Projection-based Adversarial Attack using Physics-in-the-Loop Optimization for Monocular Depth Estimation31 Dec 2025
- 2025Guided Diffusion-based Generation of Adversarial Objects for Real-World Monocular Depth Estimation Attacks30 Dec 2025
- 2025Cheating Stereo Matching in Full-scale: Physical Adversarial Attack against Binocular Depth Estimation in Autonomous Driving18 Nov 2025
- 2025Learning Fourier shapes to probe the geometric world of deep neural networks7 Nov 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025DepthVanish: Optimizing Adversarial Interval Structures for Stereo-Depth-Invisible Patches20 Jun 2025
- 2025BadDepth: Backdoor Attacks Against Monocular Depth Estimation in the Physical World22 May 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
38 more
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks18 Feb 2025
- 2024MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agents11 Dec 2024
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
- 2024Optical Lens Attack on Deep Learning Based Monocular Depth Estimation25 Sep 2024
- 2024Natural Adversaries: Fuzzing Autonomous Vehicles with Realistic Roadside Object Placements13 Sep 2024
- 2024Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack27 Aug 2024
- 2024PADetBench: Towards Benchmarking Physical Attacks against Object Detection17 Aug 2024
- 2024Physical Adversarial Attack on Monocular Depth Estimation via Shape-Varying Patches24 Jul 2024
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
- 2024Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks9 Jun 2024
- 2024ProMotion: Prototypes As Motion Learners7 Jun 2024
- 2024Prototypical Transformer as Unified Motion Learners3 Jun 2024
- 2024On the Robustness of Language Guidance for Low-Level Vision Tasks: Findings from Depth Estimation12 Apr 2024
- 2024BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Tasks1 Apr 2024
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving26 Mar 2024
- 2024SSAP: A Shape-Sensitive Adversarial Patch for Comprehensive Disruption of Monocular Depth Estimation in Autonomous Navigation Applications18 Mar 2024
- 2024Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learning9 Mar 2024
- 2024Flexible Physical Camouflage Generation Based on a Differential Approach21 Feb 2024
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networks14 Jan 2024
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023
- 2023Attention-Based Real-Time Defenses for Physical Adversarial Attacks in Vision Applications19 Nov 2023
- 2023Adversarial Examples in the Physical World: A Survey1 Nov 2023
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptions23 Oct 2023
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlook11 Aug 2023
- 2023SAAM: Stealthy Adversarial Attack on Monocular Depth Estimation6 Aug 2023
- 2023The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimation27 Jul 2023
- 2023Holistic Prototype Attention Network for Few-Shot VOS16 Jul 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023CLUSTSEG: Clustering for Universal Segmentation3 May 2023
- 2023Fusion is Not Enough: Single Modal Attacks on Fusion Models for 3D Object Detection28 Apr 2023
- 2023TransFlow: Transformer as Flow Learner23 Apr 2023
- 2023Ensemble-based Blackbox Attacks on Dense Prediction25 Mar 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2023APARATE: Adaptive Adversarial Patch for CNN-based Monocular Depth Estimation for Autonomous Navigation2 Mar 2023
- 2023CBA: Contextual Background Attack against Optical Aerial Detection in the Physical World27 Feb 2023
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks31 Jan 2023
- 2023A Study on the Generality of Neural Network Structures for Monocular Depth Estimation9 Jan 2023
- 2022A Comprehensive Study of the Robustness for LiDAR-based 3D Object Detectors against Adversarial Attacks20 Dec 2022
50 newest of 57 All 57 (JSON)
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 67
- 2022Visual Recognition with Deep Nearest Centroidscited by 59
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 49
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
- 2023TransFlow: Transformer as Flow Learnercited by 32
- 2023CLUSTSEG: Clustering for Universal Segmentationcited by 32
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Drivingcited by 32
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 25
- 2022A Comprehensive Study of the Robustness for LiDAR-based 3D Object Detectors against Adversarial Attackscited by 22
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
- 2022Learning Equivariant Segmentation with Instance-Unique Queryingcited by 17
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attackscited by 17
12 most cited of 53 All 53 (JSON)
- 2026Adversarial Calibration Attack on Autonomous Vehicles28 Aug 2026
- 2026Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attacks12 Jun 2026
- 2025Projection-based Adversarial Attack using Physics-in-the-Loop Optimization for Monocular Depth Estimation31 Dec 2025
- 2025Cheating Stereo Matching in Full-scale: Physical Adversarial Attack against Binocular Depth Estimation in Autonomous Driving18 Nov 2025
- 2025Learning Fourier shapes to probe the geometric world of deep neural networks7 Nov 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025DepthVanish: Optimizing Adversarial Interval Structures for Stereo-Depth-Invisible Patches20 Jun 2025
- 2025BadDepth: Backdoor Attacks Against Monocular Depth Estimation in the Physical World22 May 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks18 Feb 2025
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
12 newest of 53 All 53 (JSON)