Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
World Action Models (WAMs) offer a promising approach to embodied intelligence, yet existing methods rely heavily on video prediction as action priors and lack adaptive multimodal reasoning, limiting their effectiveness on long-horizon, complex tasks. We observe that WAMs require different multimodal reasoning modes under different execution contexts: textual reasoning is essential during task transitions to guide high-level action prediction, while visual reasoning is critical during fine-grained manipulation for precise control. Motivated by this observation, we propose AdaWAM, a world action model with adaptive multimodal reasoning abilities. AdaWAM integrates a lightweight dynamic router that autonomously triggers textual or visual reasoning as needed during task execution. Experiments on both simulated and real-world embodied tasks show that AdaWAM substantially improves inference efficiency while outperforming state-of-the-art embodied policies. Codes and demos are available at: https://adawam.github.io/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 28 of its 37 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
28 of 37 references.
Closest ancestors · 8
Same direction, newest first
- 2026World Action Models: The Next Frontier in Embodied AI12 May
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
Other references · 20
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
8 more
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
- 2025MM-ACT: Learn from Multimodal Parallel Generation to Actcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
- 2026HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoning
- 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning
- 2026Thinker-WM: A Unified World Model with Shared Multimodal Representations for Embodied Intelligence
- 2026Key-Gram: Extensible World Knowledge for Embodied Manipulation
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning