mlsanityData to 7 Oct 2026

Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels

arXiv 2607.26121 ↗First posted 28 Jul 2026cs.RO cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Embodied intelligence integrates learned perception and decision making with real-time computation, control, and physical interaction. Because failures can cause immediate physical or operational harm, task completion alone does not establish trustworthiness. We define trustworthy embodied intelligence as the sustained capacity to execute specified tasks reliably under environmental and system variation while maintaining risk within acceptable bounds. We term this objective sustained safe success. Its supporting mechanisms are organized into four interdependent layers. The model layer generates task-competent action proposals with calibrated uncertainty and explicit safety preferences. The system layer realizes authorized actions dependably through integrated sensing, computation, control, hardware safeguards, fault containment, and fallback. The evidence layer substantiates bounded claims through evaluation, verification, validation, traceability, and structured assurance arguments. The deployment layer maintains claim validity through runtime monitoring, authority management, intervention, incident response, and controlled updates. Because assumptions and failures propagate across these layers, neither model capability, isolated safeguards, nor benchmark performance alone can establish end-to-end trustworthiness. Drawing on embodied AI, robotics, control, dependable computing, distributed systems, and autonomous driving, we further propose a non-normative hierarchy of trustworthiness levels. This hierarchy grades the strength of bounded deployment claims across task capability, safety, system assurance, operational governance, and supporting evidence, providing a basis for bounded deployment, comparative evaluation, research prioritization, and future standardization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 93 of its 156 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

93 of 156 references.

References · 93

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  10. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  11. 2016Concrete Problems in AI Safetycited by 1,582
  12. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
38 more
  1. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  2. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  4. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  5. 2023Mastering Diverse Domains through World Modelscited by 1,193
  6. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  7. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  8. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  9. 2017Constrained Policy Optimizationcited by 928
  10. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  11. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  12. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
  13. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  14. 2017Adversarial Patchcited by 514
  15. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
  16. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  17. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  18. 2017Safe Reinforcement Learning via Shieldingcited by 427
  19. 2018Reward Constrained Policy Optimizationcited by 397
  20. 2019Deep Evidential Regressioncited by 354
  21. 2019Control Barrier Functions: Theory and Applicationscited by 332
  22. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  23. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
  24. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  25. 2020Integrated Task and Motion Planningcited by 281
  26. 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 249
  27. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
  28. 2021Trustworthy AI: From Principles to Practicescited by 206
  29. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 190
  30. 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
  31. 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 186
  32. 2020Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimscited by 163
  33. 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
  34. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  35. 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
  36. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  37. 2023Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmarkcited by 135
  38. 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132

50 most cited of 93 All 93 (JSON)

Built on by

Not cited yet.