Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels
Not on the map. Why?
Abstract (arXiv)
Embodied intelligence integrates learned perception and decision making with real-time computation, control, and physical interaction. Because failures can cause immediate physical or operational harm, task completion alone does not establish trustworthiness. We define trustworthy embodied intelligence as the sustained capacity to execute specified tasks reliably under environmental and system variation while maintaining risk within acceptable bounds. We term this objective sustained safe success. Its supporting mechanisms are organized into four interdependent layers. The model layer generates task-competent action proposals with calibrated uncertainty and explicit safety preferences. The system layer realizes authorized actions dependably through integrated sensing, computation, control, hardware safeguards, fault containment, and fallback. The evidence layer substantiates bounded claims through evaluation, verification, validation, traceability, and structured assurance arguments. The deployment layer maintains claim validity through runtime monitoring, authority management, intervention, incident response, and controlled updates. Because assumptions and failures propagate across these layers, neither model capability, isolated safeguards, nor benchmark performance alone can establish end-to-end trustworthiness. Drawing on embodied AI, robotics, control, dependable computing, distributed systems, and autonomous driving, we further propose a non-normative hierarchy of trustworthiness levels. This hierarchy grades the strength of bounded deployment claims across task capability, safety, system assurance, operational governance, and supporting evidence, providing a basis for bounded deployment, comparative evaluation, research prioritization, and future standardization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 93 of its 156 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
93 of 156 references.
References · 93
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2016Concrete Problems in AI Safetycited by 1,582
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
38 more
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Constrained Policy Optimizationcited by 928
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2017Adversarial Patchcited by 514
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2017Safe Reinforcement Learning via Shieldingcited by 427
- 2018Reward Constrained Policy Optimizationcited by 397
- 2019Deep Evidential Regressioncited by 354
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2020Integrated Task and Motion Planningcited by 281
- 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 249
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 190
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 186
- 2020Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimscited by 163
- 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
- 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2023Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmarkcited by 135
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
50 most cited of 93 All 93 (JSON)
Built on by
Not cited yet.