Address Behaviour Vulnerabilities in the Next Generation of Autonomous Robots
Not on the map. Why?
Abstract (arXiv)
Robots applications in our daily life increase at an unprecedented pace. As robots will soon operate "out in the wild", we must identify the safety and security vulnerabilities they will face. Robotics researchers and manufacturers focus their attention on new, cheaper, and more reliable applications. Still, they often disregard the operability in adversarial environments where a trusted or untrusted user can jeopardize or even alter the robot's task. In this paper, we identify a new paradigm of security threats in the next generation of robots. These threats fall beyond the known hardware or network-based ones, and we must find new solutions to address them. These new threats include malicious use of the robot's privileged access, tampering with the robot sensors system, and tricking the robot's deliberation into harmful behaviors. We provide a taxonomy of attacks that exploit these vulnerabilities with realistic examples, and we outline effective countermeasures to prevent better, detect, and mitigate them.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 79 references that are in the map. First posted on arXiv 24 Mar 2021.
Builds on
11 of 79 references.
References · 11
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2017Behavior Trees in Robotics and AI: An Introductioncited by 105
- 2018Machine Teaching for Inverse Reinforcement Learning: Algorithms and Applicationscited by 28
- 2019Risk-Averse Planning Under Uncertaintycited by 11
- 2018Formal Specification and Verification of Autonomous Robotic Systems: A Surveycited by 9
- 2018A Survey of Challenges for Runtime Verification from Advanced Application Domains (Beyond Software)cited by 9
- 2018Evaluating Methods for End-User Creation of Robot Task Planscited by 4
- 2019A Summary of Formal Specification and Verification of Autonomous Robotic Systemscited by 4
- 2020Act, Perceive, and Plan in Belief Space for Robot Localizationcited by 2
- 2017A Survey of Runtime Monitoring Instrumentation Techniquescited by 1
- 2018Open Problems in Robotic Anomaly Detectioncited by 1
Built on by
Not cited yet.