Rethinking World Models for Safety-Critical Embodied Systems
On the map: World models → World models for navigation
Abstract (arXiv)
World models have progressed from compact latent dynamics to generative, controllable, and interactive simulators of embodied environments. However, high predictive likelihood and visual fidelity do not necessarily ensure that a model preserves the evidence required for safe decision-making. This perspective identifies three structural mismatches in current world modeling: likelihood versus risk, prediction versus intervention, and finite-horizon prediction versus accumulated consequences. We propose the Risk-Informed World Model (RIWM) as a decision-centric research direction for safety-critical embodied systems. RIWM organizes world modeling around consequences, intervention, epistemic uncertainty, and recoverability, and integrates four interdependent capabilities: decision-relevant representation, counterfactual reasoning, safety-critical episodic memory, and runtime safety assurance. It distinguishes physical, social, and operational consequences while using epistemic uncertainty to qualify the evidence supporting action. We further discuss open challenges in identifying consequential futures, validating counterfactual reasoning, maintaining revisable safety memories, translating learned consequences into executable constraints, and determining when evidence is sufficient to act. This perspective argues that future world models should move beyond predicting likely futures toward identifying which futures matter, revising judgments through experience, and recognizing when to act, revise, sense, defer, or abstain.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 5 of its 34 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
5 of 34 references.
References · 5
- 2018World Modelscited by 1,513
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2025Learning Humanoid Locomotion with World Model Reconstructioncited by 13
- 2026RISE: Adaptive Imagination for World Action Modelscited by 4
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous drivingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025The Safety Challenge of World Models for Embodied AI Agents: A Review
- 2026ICAT: Incident-Case-Grounded Adaptive Testing for Physical-Risk Prediction in Embodied World Models
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
- 2026Safety, Security, and Cognitive Risks in World Models
- 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable
- 2026When World Models Lie: Adaptive Safety Analysis Under Wrong Imaginations