HarnessWAM: Bridging Prediction and Deliberation in World Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) jointly learn environmental dynamics and robot actions, introducing priors over physical evolution into embodied control. However, finite-horizon prediction and action generation are insufficient for complex embodied tasks that require global planning, cross-stage state maintenance, execution verification, and failure recovery. We refer to this mismatch as the prediction-deliberation gap of WAMs. To address this gap, we propose HarnessWAM, an agentic framework for WAMs. HarnessWAM employs a vision-language-model-based Task Manager to maintain an evidence-grounded scene belief and a structured task graph. A capability-conditioned executable-space projection further constrains open-ended semantic plans into sequences of atomic skills that satisfy task dependencies, embodiment-state constraints, and the capability boundary of the underlying WAM. During execution, HarnessWAM operates through an event-driven, dual-timescale feedback loop: a lightweight progress estimator continuously provides high-frequency execution evidence, while the Task Manager deliberates at salient milestones by jointly considering the current observation, task state, and interaction history to determine whether to advance the task, acquire additional observations, revise the plan, or initiate local recovery. This mechanism enables the robot to recover its state after a subtask failure and resume execution without discarding previously acquired scene knowledge. HarnessWAM achieves state-of-the-art full-task and subtask success rates of 59.6% and 69.9% on RoboMemArena, and an SR of 23.7% on RoboCerebra Ideal. These results demonstrate that model-external structured state maintenance and closed-loop agentic decision making can effectively extend the local control capabilities of WAMs into embodied task execution that is plannable, verifiable, and recoverable.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 18 of its 40 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
18 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun
- 2026HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation9 Jun
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
Other references · 13
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
- 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policiescited by 39
- 2025SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulationcited by 36
- 2026RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmarkcited by 21
1 more
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026HarnessPAI: An Evolving Harness for Physical AIcited by 1
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulationcited by 0
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agentscited by 0
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents30 Sep 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
- 2026HarnessPAI: An Evolving Harness for Physical AI24 Sep 2026
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulation17 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026Rethink Before You Execute: Adaptive Execution for World Action Models
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
- 2026SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space