Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Monocular Depth Estimation (MDE) is a pivotal component of vision-based Autonomous Driving (AD) systems, enabling vehicles to estimate the depth of surrounding objects using a single camera image. This estimation guides essential driving decisions, such as braking before an obstacle or changing lanes to avoid collisions. In this paper, we explore vulnerabilities of MDE algorithms in AD systems, presenting LensAttack, a novel physical attack that strategically places optical lenses on the camera of an autonomous vehicle to manipulate the perceived object depths. LensAttack encompasses two attack formats: concave lens attack and convex lens attack, each utilizing different optical lenses to induce false depth perception. We first develop a mathematical model that outlines the parameters of the attack, followed by simulations and real-world evaluations to assess its efficacy on state-of-the-art MDE models. Additionally, we adopt an attack optimization method to further enhance the attack success rate by optimizing the attack focal length. To better evaluate the implications of LensAttack on AD, we conduct comprehensive end-to-end system simulations using the CARLA platform. The results reveal that LensAttack can significantly disrupt the depth estimation processes in AD systems, posing a serious threat to their reliability and safety. Finally, we discuss some potential defense methods to mitigate the effects of the proposed attack.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 66 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
38 of 66 references.
References · 38
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018Pyramid Stereo Matching Networkcited by 486
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2016Single-Image Depth Perception in the Wildcited by 179
26 more
- 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
- 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2017Augmented Reality Meets Computer Vision : Efficient Data Generation for Urban Driving Scenescited by 122
- 2014Deep Convolutional Neural Fields for Depth Estimation from a Single Imagecited by 106
- 2020Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systemscited by 100
- 2019How do neural networks see depth in single images?cited by 82
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64
- 2020Dirty Road Can Attack: Security of Deep Learning based Automated Lane Centering under Physical-World Attackcited by 64
- 2022Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patchescited by 57
- 2019AANet: Attribute Attention Network for Person Re-Identificationscited by 56
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
- 2020Targeted Adversarial Perturbations for Monocular Depth Predictioncited by 40
- 2021Depth Estimation from Monocular Images and Sparse radar using Deep Ordinal Regression Networkcited by 32
- 2020Adversarial Patch Attacks on Monocular Depth Estimation Networkscited by 29
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2020Adversarial Attacks on Monocular Depth Estimationcited by 20
- 2023Toward Wheeled Mobility on Vertically Challenging Terrain: Platforms, Datasets, and Algorithmscited by 16
- 2017Spatially-Varying Blur Detection Based on Multiscale Fused and Sorted Transform Coefficients of Gradient Magnitudescited by 15
- 2022Rolling Colors: Adversarial Laser Exploits against Traffic Light Recognitioncited by 15
- 2021DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systemscited by 10
- 2023Learning to Model and Plan for Wheeled Mobility on Vertically Challenging Terraincited by 9
- 2020GhostImage: Remote Perception Attacks against Camera-based Image Classification Systemscited by 5
- 2018Realistic Image Degradation with Measured PSFcited by 4
- 2020Black-box Adversarial Attacks on Monocular Depth Estimation Using Evolutionary Multi-objective Optimizationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Guided Diffusion-based Generation of Adversarial Objects for Real-World Monocular Depth Estimation Attacks
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks
- 2026AD2: Analysis and Detection of Adversarial Threats in Visual Perception for End-to-End Autonomous Driving Systems
- 2021Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous Vehicles
- 2023Exorcising ''Wraith'': Protecting LiDAR-based Object Detector in Automated Driving System from Appearing Attacks
- 2021Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles
- 2026Beyond Crash: Hijacking Your Autonomous Vehicle for Fun and Profit
- 2025Temporal Misalignment Attacks against Multimodal Perception in Autonomous Driving