DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systems
Not on the map. Why?
Abstract (arXiv)
Depth estimation-based obstacle avoidance has been widely adopted by autonomous systems (drones and vehicles) for safety purpose. It normally relies on a stereo camera to automatically detect obstacles and make flying/driving decisions, e.g., stopping several meters ahead of the obstacle in the path or moving away from the detected obstacle. In this paper, we explore new security risks associated with the stereo vision-based depth estimation algorithms used for obstacle avoidance. By exploiting the weaknesses of the stereo matching in depth estimation algorithms and the lens flare effect in optical imaging, we propose DoubleStar, a long-range attack that injects fake obstacle depth by projecting pure light from two complementary light sources. DoubleStar includes two distinctive attack formats: beams attack and orbs attack, which leverage projected light beams and lens flare orbs respectively to cause false depth perception. We successfully attack two commercial stereo cameras designed for autonomous systems (ZED and Intel RealSense). The visualization of fake depth perceived by the stereo cameras illustrates the false stereo matching induced by DoubleStar. We further use Ardupilot to simulate the attack and demonstrate its impact on drones. To validate the attack on real systems, we perform a real-world attack towards a commercial drone equipped with state-of-the-art obstacle avoidance algorithms. Our attack can continuously bring a flying drone to a sudden stop or drift it away across a long distance under various lighting conditions, even bypassing sensor fusion mechanisms. Specifically, our experimental results show that DoubleStar creates fake depth up to 15 meters in distance at night and up to 8 meters during the daytime. To mitigate this newly discovered threat, we provide discussions on potential countermeasures to defend against DoubleStar.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 16 of its 66 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
16 of 66 references.
References · 16
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2018Pyramid Stereo Matching Networkcited by 486
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2019Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Drivingcited by 151
- 2020Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasurescited by 95
- 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
- 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
- 2019Defending Against Physically Realizable Attacks on Image Classificationcited by 66
- 2020Dirty Road Can Attack: Security of Deep Learning based Automated Lane Centering under Physical-World Attackcited by 64
- 2017Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matchingcited by 63
4 more
- 2019AANet: Attribute Attention Network for Person Re-Identificationscited by 56
- 2019EdgeStereo: An Effective Multi-Task Learning Network for Stereo Matching and Edge Detectioncited by 39
- 2020Drift with Devil: Security of Multi-Sensor Fusion based Localization in High-Level Autonomous Driving under GPS Spoofing (Extended Version)cited by 25
- 2020GhostImage: Remote Perception Attacks against Camera-based Image Classification Systemscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3; 2026: 2.
10 papers.
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2024Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical Worldcited by 4
- 2024Optical Lens Attack on Deep Learning Based Monocular Depth Estimationcited by 3
- 2024Transient Adversarial 3D Projection Attacks on Object Detection in Autonomous Drivingcited by 0
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Drivingcited by 0
- 2025DepthVanish: Optimizing Adversarial Interval Structures for Stereo-Depth-Invisible Patchescited by 0
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimationcited by 0
- 2025Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detectioncited by 0
- 2026Beyond Crash: Hijacking Your Autonomous Vehicle for Fun and Profitcited by 0
- 2026Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attackscited by 0
- 2026Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attacks12 Jun 2026
- 2026Beyond Crash: Hijacking Your Autonomous Vehicle for Fun and Profit6 Feb 2026
- 2025Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection22 Oct 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025DepthVanish: Optimizing Adversarial Interval Structures for Stereo-Depth-Invisible Patches20 Jun 2025
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
- 2024Transient Adversarial 3D Projection Attacks on Object Detection in Autonomous Driving25 Sep 2024
- 2024Optical Lens Attack on Deep Learning Based Monocular Depth Estimation25 Sep 2024
- 2024Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical World30 Apr 2024
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023