Temporal Logic-Based Multi-Vehicle Backdoor Attacks against Offline RL Agents in End-to-end Autonomous Driving
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Assessing the safety of autonomous driving (AD) systems against security threats, particularly backdoor attacks, is a stepping stone for real-world deployment. However, existing works mainly focus on pixel-level triggers that are impractical to deploy in the real world. We address this gap by introducing a novel backdoor attack against the end-to-end AD systems that leverage one or more other vehicles' trajectories as triggers. To generate precise trigger trajectories, we first use temporal logic (TL) specifications to define the behaviors of attacker vehicles. Configurable behavior models are then used to generate these trajectories, which are quantitatively evaluated and iteratively refined based on the TL specifications. We further develop a negative training strategy by incorporating patch trajectories that are similar to triggers but are designated not to activate the backdoor. It enhances the stealthiness of the attack and refines the system's responses to trigger scenarios. Through extensive experiments on 5 offline reinforcement learning (RL) driving agents with 6 trigger patterns and target action combinations, we demonstrate the flexibility and effectiveness of our proposed attack, showing the under-exploration of existing end-to-end AD systems' vulnerabilities to such trajectory-based backdoor attacks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 60 of its 91 references that are in the map. First posted on arXiv 21 Sep 2025.
Builds on
60 of 91 references.
Closest ancestors · 2
Same direction, newest first
- 2024Physical Backdoor Attack can Jeopardize Driving with Vision-Large-Language Models19 Apr
- 2024Curiosity-driven Red-teaming for Large Language Models29 Feb
Other references · 58
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 353
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
- 2018Learning to Drive in a Daycited by 273
- 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 263
- 2019Adversarial Policies: Attacking Deep Reinforcement Learningcited by 214
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
38 more
- 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 166
- 2017Robust Deep Reinforcement Learning with Adversarial Attackscited by 154
- 2022Backdoor Defense via Decoupling the Training Processcited by 153
- 2019End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordancescited by 149
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 137
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 135
- 2022A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspectivecited by 105
- 2022How to Backdoor Diffusion Models?cited by 104
- 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 98
- 2020Deep Feature Space Trojan Attack of Neural Networks by Controlled Detoxificationcited by 95
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 90
- 2020On the Effectiveness of Mitigating Data Poisoning Attacks with Gradient Shapingcited by 83
- 2017Robust Physical-World Attacks on Deep Learning Modelscited by 72
- 2022COptiDICE: Offline Constrained Reinforcement Learning via Stationary Distribution Correction Estimationcited by 71
- 2023Constrained Decision Transformer for Offline Safe Reinforcement Learningcited by 69
- 2021BACKDOORL: Backdoor Attack against Competitive Reinforcement Learningcited by 68
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 66
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2021GRI: General Reinforced Imitation and its Application to Vision-Based Autonomous Drivingcited by 60
- 2023Datasets and Benchmarks for Offline Safe Reinforcement Learningcited by 59
- 2023Detecting Backdoors in Pre-trained Encoderscited by 55
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 49
- 2024When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Searchcited by 47
- 2024DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Drivingcited by 43
- 2020Stop-and-Go: Exploring Backdoor Attacks on Deep Reinforcement Learning-based Traffic Congestion Control Systemscited by 37
- 2022Physical Backdoor Attacks to Lane Detection Systems in Autonomous Drivingcited by 31
- 2023BadRL: Sparse Targeted Backdoor Attack Against Reinforcement Learningcited by 30
- 2021Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancementcited by 29
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2022BAFFLE: Hiding Backdoors in Offline Reinforcement Learning Datasetscited by 25
- 2024RL-JACK: Reinforcement Learning-powered Black-box Jailbreaking Attack against LLMscited by 23
- 2022Reward Poisoning Attacks on Offline Multi-Agent Reinforcement Learningcited by 20
- 2022PolicyCleanse: Backdoor Detection and Mitigation in Reinforcement Learningcited by 19
- 2023ParaFuzz: An Interpretability-Driven Technique for Detecting Poisoned Samples in NLPcited by 19
- 2019Requirements-driven Test Generation for Autonomous Vehicles with Machine Learning Componentscited by 18
- 2022Provable Defense against Backdoor Policies in Reinforcement Learningcited by 18
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Angel or Demon: Investigating the Plasticity Interventions' Impact on Backdoor Threats in Deep Reinforcement Learningcited by 1
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Trainingcited by 1
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
- 2026LogiC-Diff: Embedding Security Properties Into AI-Enabled Cyber-Physical Systemscited by 0
- 2026LogiC-Diff: Embedding Security Properties Into AI-Enabled Cyber-Physical Systems29 Sep 2026
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation2 Sep 2026
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training22 Jul 2026
- 2026Angel or Demon: Investigating the Plasticity Interventions' Impact on Backdoor Threats in Deep Reinforcement Learning14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2022Security of Deep Reinforcement Learning for Autonomous Driving: A Survey
- 2023Manipulating Trajectory Prediction with Backdoors
- 2026When Backdoors Meet Partial Observability: Attacking Real-World Reinforcement Learning
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events
- 2022Automatically Learning Fallback Strategies with Model-Free Reinforcement Learning in Safety-Critical Driving Scenarios
- 2026Securing Autonomous Vehicle Systems via Twin-Aware Federated Reinforcement Learning
- 2026BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Driving
- 2021Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns