Manipulating Neural Path Planners via Slight Perturbations
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Data-driven neural path planners are attracting increasing interest in the robotics community. However, their neural network components typically come as black boxes, obscuring their underlying decision-making processes. Their black-box nature exposes them to the risk of being compromised via the insertion of hidden malicious behaviors. For example, an attacker may hide behaviors that, when triggered, hijack a delivery robot by guiding it to a specific (albeit wrong) destination, trapping it in a predefined region, or inducing unnecessary energy expenditure by causing the robot to repeatedly circle a region. In this paper, we propose a novel approach to specify and inject a range of hidden malicious behaviors, known as backdoors, into neural path planners. Our approach provides a concise but flexible way to define these behaviors, and we show that hidden behaviors can be triggered by slight perturbations (e.g., inserting a tiny unnoticeable object), that can nonetheless significantly compromise their integrity. We also discuss potential techniques to identify these backdoors aimed at alleviating such risks. We demonstrate our approach on both sampling-based and search-based neural path planners.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 19 of its 35 references that are in the map. First posted on arXiv 27 Mar 2024.
Builds on
19 of 35 references.
References · 19
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2020Backdoor Learning: A Surveycited by 412
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2019Robust Anomaly Detection and Backdoor Attack Detection Via Differential Privacycited by 93
- 2020Trojaning Language Models for Fun and Profitcited by 80
- 2017Learning Sampling Distributions for Robot Motion Planningcited by 79
- 2018Motion Planning Networkscited by 78
- 2020DeepSweep: An Evaluation Framework for Mitigating DNN Backdoor Attacks using Data Augmentationcited by 75
- 2021BACKDOORL: Backdoor Attack against Competitive Reinforcement Learningcited by 66
7 more
- 2020Path Planning using Neural A* Searchcited by 51
- 2017Data-driven Planning via Imitation Learningcited by 36
- 2019Design of intentional backdoors in sequential modelscited by 20
- 2017Combining Neural Networks and Tree Search for Task and Motion Planning in Challenging Environmentscited by 19
- 2019Learning to Plan in High Dimensions via Neural Exploration-Exploitation Treescited by 18
- 2019Learned Critical Probabilistic Roadmaps for Robotic Motion Planningcited by 18
- 2018Learning Human-Aware Path Planning with Fully Convolutional Networkscited by 11
Built on by
Not cited yet.