Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities
Not on the map. Why?
Abstract (arXiv)
Robotics and Artificial Intelligence (AI) have been inextricably intertwined since their inception. Today, AI-Robotics systems have become an integral part of our daily lives, from robotic vacuum cleaners to semi-autonomous cars. These systems are built upon three fundamental architectural elements: perception, navigation and planning, and control. However, while the integration of AI-Robotics systems has enhanced the quality our lives, it has also presented a serious problem - these systems are vulnerable to security attacks. The physical components, algorithms, and data that make up AI-Robotics systems can be exploited by malicious actors, potentially leading to dire consequences. Motivated by the need to address the security concerns in AI-Robotics systems, this paper presents a comprehensive survey and taxonomy across three dimensions: attack surfaces, ethical and legal concerns, and Human-Robot Interaction (HRI) security. Our goal is to provide users, developers and other stakeholders with a holistic understanding of these areas to enhance the overall AI-Robotics system security. We begin by surveying potential attack surfaces and provide mitigating defensive strategies. We then delve into ethical issues, such as dependency and psychological impact, as well as the legal concerns regarding accountability for these systems. Besides, emerging trends such as HRI are discussed, considering privacy, integrity, safety, trustworthiness, and explainability concerns. Finally, we present our vision for future research directions in this dynamic and promising field.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 70 of its 255 references that are in the map. First posted on arXiv 12 Oct 2023.
Builds on
70 of 255 references.
References · 70
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 660
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 347
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
38 more
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2020Amnesiac Machine Learningcited by 305
- 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 219
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
- 2017Neural Trojanscited by 151
- 2019Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Drivingcited by 151
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2018Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approachcited by 117
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2020Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasurescited by 95
- 2016Learning from Untrusted Datacited by 90
- 2019Analyzing Information Leakage of Updates to Natural Language Modelscited by 89
- 2020CIAGAN: Conditional Identity Anonymization Generative Adversarial Networkscited by 88
- 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 84
- 2019Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attackscited by 79
- 2019Learning Decentralized Controllers for Robot Swarms with Graph Neural Networkscited by 62
- 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 62
- 2020Adversarial Machine Learning in Image Classification: A Survey Towards the Defender's Perspectivecited by 58
- 2021Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bitscited by 49
- 2015Learning Contact-Rich Manipulation Skills with Guided Policy Searchcited by 37
- 2016Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimationcited by 34
- 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recoverycited by 32
- 2021Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defensescited by 29
- 2020Drift with Devil: Security of Multi-Sensor Fusion based Localization in High-Level Autonomous Driving under GPS Spoofing (Extended Version)cited by 25
- 2021Fooling LiDAR Perception via Adversarial Trajectory Perturbationcited by 25
- 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
- 2021IdentityDP: Differential Private Identification Protection for Face Imagescited by 24
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box settingcited by 20
- 2019Verifiably Safe Off-Model Reinforcement Learningcited by 16
- 2020Enhanced Adversarial Strategically-Timed Attacks against Deep Reinforcement Learningcited by 13
- 2022Robust Adversarial Attacks Detection based on Explainable Deep Reinforcement Learning For UAV Guidance and Planningcited by 13
- 2020Modeling Trust in Human-Robot Interaction: A Surveycited by 12
- 2018Learning Human-Aware Path Planning with Fully Convolutional Networkscited by 11
- 2018Injected and Delivered: Fabricating Implicit Control over Actuation Systems by Spoofing Inertial Sensorscited by 10
- 2018Resilient Active Target Tracking with Multiple Robotscited by 10
- 2021Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learningcited by 10
- 2020Robot Navigation with Map-Based Deep Reinforcement Learningcited by 9
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 4.
9 papers.
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 32
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Roboticscited by 3
- 2026From Prompt to Physical Actuation: Holistic Threat Modeling of LLM-Enabled Robotic Systemscited by 3
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Modelscited by 1
- 2025Free Energy-Inspired Cognitive Risk Integration for AV Navigation in Pedestrian-Rich Environmentscited by 0
- 2025Cumplimiento del Reglamento (UE) 2024/1689 en rob'otica y sistemas aut'onomos: una revisi'on sistem'atica de la literaturacited by 0
- 2025Enhancing Social Robots through Resilient AIcited by 0
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-offcited by 0
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-off6 May 2026
- 2026From Prompt to Physical Actuation: Holistic Threat Modeling of LLM-Enabled Robotic Systems29 Apr 2026
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models30 Mar 2026
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning31 Jan 2026
- 2025Enhancing Social Robots through Resilient AI24 Oct 2025
- 2025Cumplimiento del Reglamento (UE) 2024/1689 en rob'otica y sistemas aut'onomos: una revisi'on sistem'atica de la literatura4 Sep 2025
- 2025Free Energy-Inspired Cognitive Risk Integration for AV Navigation in Pedestrian-Rich Environments28 Jul 2025
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks18 Feb 2025
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Robotics27 Jun 2024