Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Action-conditioned world models are increasingly used as learned simulators for policy evaluation and improvement, yet their effectiveness rests on an unverified assumption: generated futures faithfully reflect arbitrary valid actions. Existing benchmarks are typically confined to expert demonstrations, leaving off-expert action following inadequately evaluated. To address this gap, we introduce WorldEcho, which probes action following over a broader action distribution using visual integrity and SE(3) trajectory alignment. Our diagnosis shows that current world models reasonably execute expert actions but struggle with diverse off-expert trajectories, either ignoring the commanded actions or producing visually invalid rollouts. We further propose WorldSync, which strengthens action following along three complementary axes: distributional coverage, representational grounding, and intervention-effect alignment. It broadens the training distribution over action consequences, grounds intermediate video representations in action-induced robot dynamics through an Action-Forcing Expert, and aligns predicted changes under action interventions with the corresponding changes in ground-truth futures. Experiments on RoboTwin benchmarks and real-robot tasks show that WorldSync improves WorldEcho metrics and serves as a more reliable simulator for iterative policy improvement, enabling policies to achieve higher success rates.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 27 of its 49 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
27 of 49 references.
Closest ancestors · 18
Same direction, newest first
- 2026Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models5 Jul
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation1 Jul
- 2026Learning Transferable Dynamics Priors from Action to World Modeling28 Jun
- 2026Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation17 Jun
- 2026PiL-World: A Chunk-Wise World Model for VLA Policy-in-the-Loop Evaluation4 Jun
- 2026OSCAR: Omni-Embodiment Action-Conditioned World Model for Robotics3 Jun
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models28 May
- 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields7 May
- 2026Hi-WM: Human-in-the-World-Model for Scalable Robot Post-Training23 Apr
- 2026WM-DAgger: Enabling Efficient Data Aggregation for Imitation Learning with World Models13 Apr
- 2026PlayWorld: Learning Robot World Models from Autonomous Play9 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
6 more
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
- 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks3 Feb
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
- 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
Other references · 9
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2025AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulationcited by 23
- 2026SOP: A Scalable Online Post-Training System for Vision-Language-Action Modelscited by 21
- 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies
- 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry
- 2026Rethinking Representations for World-Action Modeling
- 2026The Planning Limits of Latent World Models
- 2026R2-WAM: Repair-and-Reject Post-Training for World Action Models
- 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation
- 2026Forward Dynamics Models
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models