Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures
Not on the map. Why?
Abstract (arXiv)
Perception plays a pivotal role in autonomous driving systems, which utilizes onboard sensors like cameras and LiDARs (Light Detection and Ranging) to assess surroundings. Recent studies have demonstrated that LiDAR-based perception is vulnerable to spoofing attacks, in which adversaries spoof a fake vehicle in front of a victim self-driving car by strategically transmitting laser signals to the victim's LiDAR sensor. However, existing attacks suffer from effectiveness and generality limitations. In this work, we perform the first study to explore the general vulnerability of current LiDAR-based perception architectures and discover that the ignored occlusion patterns in LiDAR point clouds make self-driving cars vulnerable to spoofing attacks. We construct the first black-box spoofing attack based on our identified vulnerability, which universally achieves around 80% mean success rates on all target models. We perform the first defense study, proposing CARLO to mitigate LiDAR spoofing attacks. CARLO detects spoofed data by treating ignored occlusion patterns as invariant physical features, which reduces the mean attack success rate to 5.5%. Meanwhile, we take the first step towards exploring a general architecture for robust LiDAR-based perception, and propose SVF that embeds the neglected physical features into end-to-end learning. SVF further reduces the mean attack success rate to around 2.3%.
Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 22; 2023: 17; 2024: 11; 2025: 16; 2026: 10.
95 papers.
Sort:
By area:
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptionscited by 78
- 2022Backdoor Defense with Machine Unlearningcited by 61
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 49
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
38 more
- 2021Scalable Certified Segmentation via Randomized Smoothingcited by 35
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 32
- 2021Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defensescited by 29
- 2023Unified Adversarial Patch for Cross-modal Attacks in the Physical Worldcited by 27
- 2021Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous Vehiclescited by 26
- 2021Fooling LiDAR Perception via Adversarial Trajectory Perturbationcited by 25
- 2022Imperceptible and Robust Backdoor Attack in 3D Point Cloudcited by 25
- 2022Isometric 3D Adversarial Examples in the Physical Worldcited by 25
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2022A Comprehensive Study of the Robustness for LiDAR-based 3D Object Detectors against Adversarial Attackscited by 22
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021They See Me Rollin': Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensorscited by 17
- 2024MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detectioncited by 17
- 2022PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognitioncited by 16
- 2021Object Removal Attacks on LiDAR-based 3D Object Detectorscited by 15
- 2023CALICO: Self-Supervised Camera-LiDAR Contrastive Pre-training for BEV Perceptioncited by 14
- 2022Illusory Attacks: Information-Theoretic Detectability Matters in Adversarial Attackscited by 12
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2023Fusion is Not Enough: Single Modal Attacks on Fusion Models for 3D Object Detectioncited by 11
- 2023On Data Fabrication in Collaborative Vehicular Perception: Attacks and Countermeasurescited by 11
- 2023VPA: Fully Test-Time Visual Prompt Adaptationcited by 11
- 2021DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systemscited by 10
- 2022TPC: Transformation-Specific Smoothing for Point Cloud Modelscited by 10
- 2022PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognitioncited by 10
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulationcited by 10
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weathercited by 10
- 2023LiDAR Spoofing Meets the New-Gen: Capability Improvements, Broken Assumptions, and New Attack Strategiescited by 9
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunitiescited by 9
- 2024Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusioncited by 9
- 2023State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systemscited by 8
- 2021Temporal Consistency Checks to Detect LiDAR Spoofing Attacks on Autonomous Vehicle Perceptioncited by 7
- 2021We Can Always Catch You: Detecting Adversarial Patched Objects WITH or WITHOUT Signaturecited by 6
- 2022Certified Adversarial Robustness via Anisotropic Randomized Smoothingcited by 6
- 2024Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attackscited by 6
- 2021Sensor Adversarial Traits: Analyzing Robustness of 3D Object Detection Sensor Fusion Modelscited by 5
- 2022Using 3D Shadows to Detect Object Hiding Attacks on Autonomous Vehicle Perceptioncited by 5
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2023ADoPT: LiDAR Spoofing Attack Detection Based on Point-Level Temporal Consistencycited by 5
50 most cited of 95 All 95 (JSON)
- 2026TACTIC: Temporal and Context-Aware LLM Tactical Planning for Roadside LiDAR Attacks30 Sep 2026
- 2026Adversarial Calibration Attack on Autonomous Vehicles28 Aug 2026
- 2026TwinIR: Coordinated Invisible Dual-Point Attacks on Online HD Map Construction5 Aug 2026
- 2026Explainability-Aware Frustum Attack: Exposing Structural Vulnerabilities in LiDAR-Based 3D Object Detectors29 Jun 2026
- 2026ATLAS: A Large-Scale Evaluation Benchmark for Adversarial LiDAR Perception1 Jun 2026
- 2026Systematic Discovery of Semantic Attacks in Online Map Construction through Conditional Diffusion14 May 2026
- 2026Adversarial Flow Matching for Imperceptible Attacks on End-to-End Autonomous Driving26 Apr 2026
- 2026Neural Reconstruction of LiDAR Point Clouds under Jamming Attacks via Full-Waveform Representation and Simultaneous Laser Sensing1 Apr 2026
- 2026RayD3D: Distilling Depth Knowledge Along the Ray for Robust Multi-View 3D Object Detection8 Mar 2026
- 2026Evasion of IoT Malware Detection via Dummy Code Injection9 Feb 2026
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2025Invisible Triggers, Visible Threats! Road-Style Adversarial Creation Attack for Visual 3D Detection in Autonomous Driving11 Nov 2025
38 more
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025OBJVanish: Physically Realizable Text-to-3D Adv. Generation of LiDAR-Invisible Objects8 Oct 2025
- 2025Efficient Model-Based Purification Against Adversarial Attacks for LiDAR Segmentation25 Aug 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025Generating Adversarial Point Clouds Using Diffusion Model25 Jul 2025
- 2025Revisiting Physically Realizable Adversarial Object Attack against LiDAR-based Detection: Clarifying Problem Formulation and Experimental Protocols24 Jul 2025
- 2025A workflow for generating synthetic LiDAR datasets in simulation environments20 Jun 2025
- 2025PaniCar: Securing the Perception of Advanced Driving Assistance Systems Against Emergency Vehicle Lighting8 May 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025SLACK: Attacking LiDAR-based SLAM with Adversarial Point Injections3 Apr 2025
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Driving21 Mar 2025
- 2025Probabilistic Segmentation for Robust Field of View Estimation10 Mar 2025
- 2025From Pixels to Trajectory: Universal Adversarial Example Detection via Temporal Imprints6 Mar 2025
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks18 Feb 2025
- 2024LiDAttack: Robust Black-box Attack on LiDAR-based Object Detection4 Nov 2024
- 2024Adversarial Attacks on LiDAR-Based Tracking Across Road Users: Robustness Evaluation and Target-Aware Black-Box Method28 Oct 2024
- 2024Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusion16 Oct 2024
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehicles30 Sep 2024
- 2024PhantomLiDAR: Cross-modality Signal Injection Attacks against LiDAR26 Sep 2024
- 2024Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attacks22 Sep 2024
- 2024A First Physical-World Trajectory Prediction Attack via LiDAR-induced Deceptions in Autonomous Driving17 Jun 2024
- 2024Adversarial 3D Virtual Patches using Integrated Gradients1 Jun 2024
- 2024Certifying Global Robustness for Deep Neural Networks31 May 2024
- 2024COMMIT: Certifying Robustness of Multi-Sensor Fusion Systems against Semantic Attacks4 Mar 2024
- 2024MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detection18 Feb 2024
- 2023FAKEPCD: Fake Point Cloud Detection via Source Attribution18 Dec 2023
- 2023ScAR: Scaling Adversarial Robustness for LiDAR Object Detection5 Dec 2023
- 2023Exploring Adversarial Robustness of LiDAR-Camera Fusion Model in Autonomous Driving3 Dec 2023
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation2 Nov 2023
- 2023ADoPT: LiDAR Spoofing Attack Detection Based on Point-Level Temporal Consistency23 Oct 2023
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities12 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023VPA: Fully Test-Time Visual Prompt Adaptation26 Sep 2023
- 2023On Data Fabrication in Collaborative Vehicular Perception: Attacks and Countermeasures22 Sep 2023
- 2023Unified Adversarial Patch for Cross-modal Attacks in the Physical World15 Jul 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023CALICO: Self-Supervised Camera-LiDAR Contrastive Pre-training for BEV Perception1 Jun 2023
- 2023FakeSwarm: Improving Fake News Detection with Swarming Characteristics30 May 2023
50 newest of 95 All 95 (JSON)
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2024Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attackscited by 6
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directionscited by 1
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2024Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attacks22 Sep 2024
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks17 Jun 2021
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptionscited by 78
- 2022Backdoor Defense with Machine Unlearningcited by 61
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 49
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Scalable Certified Segmentation via Randomized Smoothingcited by 35
12 most cited of 90 All 90 (JSON)
- 2026TACTIC: Temporal and Context-Aware LLM Tactical Planning for Roadside LiDAR Attacks30 Sep 2026
- 2026Adversarial Calibration Attack on Autonomous Vehicles28 Aug 2026
- 2026TwinIR: Coordinated Invisible Dual-Point Attacks on Online HD Map Construction5 Aug 2026
- 2026Explainability-Aware Frustum Attack: Exposing Structural Vulnerabilities in LiDAR-Based 3D Object Detectors29 Jun 2026
- 2026ATLAS: A Large-Scale Evaluation Benchmark for Adversarial LiDAR Perception1 Jun 2026
- 2026Systematic Discovery of Semantic Attacks in Online Map Construction through Conditional Diffusion14 May 2026
- 2026Neural Reconstruction of LiDAR Point Clouds under Jamming Attacks via Full-Waveform Representation and Simultaneous Laser Sensing1 Apr 2026
- 2026RayD3D: Distilling Depth Knowledge Along the Ray for Robust Multi-View 3D Object Detection8 Mar 2026
- 2026Evasion of IoT Malware Detection via Dummy Code Injection9 Feb 2026
- 2025Invisible Triggers, Visible Threats! Road-Style Adversarial Creation Attack for Visual 3D Detection in Autonomous Driving11 Nov 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025OBJVanish: Physically Realizable Text-to-3D Adv. Generation of LiDAR-Invisible Objects8 Oct 2025
12 newest of 90 All 90 (JSON)