mlsanityData to 7 Oct 2026

Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems

arXiv 2606.00090 ↗First posted 23 May 2026cs.RO cs.AIcited by 0

On the map: World models → World models for navigation

also in 1 more
Abstract (arXiv)

Physical AI systems increasingly map multimodal observations, language instructions, and learned world representations into physically consequential actions. Robotics foundation models, vision-language-action models, and world-model-based autonomous systems can condition decisions that move vehicles, robots, drones, and industrial machines. This transition exposes a safety problem that is not fully captured by conventional AI content moderation or by classical robot safety alone: a black-box model may issue a physically consequential action while appearing confident, plausible, and semantically aligned. The resulting failure can be silent, arising from sensor drift, occlusion, state-estimation error, distribution shift, hallucinated affordances, or invalid physical assumptions before downstream hardware controllers detect a violation. Across embodied foundation models, world models, robotics simulation, embodied safety benchmarks, safe control, runtime assurance, uncertainty estimation, verification, and guardrail evaluation, model capability and safety mechanisms have advanced along largely separate technical tracks. A recurring gap synthesized here is that no single stream surveyed in this review supplies a complete runtime authorization boundary between black-box Physical AI models and physical execution. The resulting analysis develops a bounded problem formulation, a definition of silent physical-action failure, a taxonomy of runtime guardrail functions, and evaluation requirements for comparing guardrails as Physical AI assurance mechanisms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 24 of its 118 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

24 of 118 references.

References · 24

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  2. 2023Mastering Diverse Domains through World Modelscited by 1,193
  3. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  4. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  5. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  6. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  7. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  8. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  9. 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 70
  10. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
  11. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Securitycited by 41
  12. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 39
12 more
  1. 2025Safety Guardrails for LLM-Enabled Robotscited by 30
  2. 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignmentcited by 23
  3. 2026Scaling World Model for Hierarchical Manipulation Policiescited by 15
  4. 2025EvoVLA: Self-Evolving Vision-Language-Action Modelcited by 11
  5. 2026Unifying Language-Action Understanding and Generation for Autonomous Drivingcited by 9
  6. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Enginescited by 6
  7. 2026Modular Safety Guardrails Are Necessary for Foundation-Model-Enabled Robots in the Real Worldcited by 5
  8. 2026Action Hallucination in Generative Vision-Language-Action Modelscited by 5
  9. 2026StyleVLA: Driving Style-Aware Vision Language Action Model for Autonomous Drivingcited by 5
  10. 2026Recursive Belief Vision Language Action Modelscited by 3
  11. 2026Judge, Then Drive: A Critic-Centric Vision Language Action Framework for Autonomous Drivingcited by 3
  12. 2026From Particles to Agents: Hallucination as a Metric for Cognitive Friction in Spatial Simulationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses
  2. 2025ANNIE: Be Careful of Your Robots
  3. 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks
  4. 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
  5. 2026Explicit World Models for Reliable Human-Robot Collaboration
  6. 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
  7. 2024SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systems
  8. 2025The Safety Challenge of World Models for Embodied AI Agents: A Review