mlsanityData to 7 Oct 2026

World Action Modeling with Progressive Visual Planning

arXiv 2610.02508 ↗First posted 1 Oct 2026cs.AI cs.CV cs.ROcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World action models (WAMs) have emerged as a promising paradigm for robotic control by jointly predicting future visual dynamics and actions from an initial observation and instruction. However, existing WAMs struggle with long-horizon prediction, as generating dense video rollouts is highly inefficient. Some recent WAMs address this by predicting a single future frame without generating the full video, but this approach neglects how to progress toward the goal. We present ProWAM, a progressive world action model that jointly predicts actions and an ordered sequence of sparse visual sub-goals, providing explicit visual guidance to anchor action generation throughout task execution. This design scales naturally, as sub-goal prediction can be learned from large-scale action-free videos, allowing the video backbone to offload complex visual planning from the action policy. For efficient action generation, ProWAM executes a single video-backbone forward pass to cache sparse sub-goal features, eliminating iterative full-video generation and requiring only lightweight action denoising during replanning. Across extensive evaluations, ProWAM achieves superior out-of-distribution robustness. On simulation benchmarks, it sets new state-of-the-art results on LIBERO-Plus (85.8%) and randomized RoboTwin (75.7%), outperforming the strongest baseline with relative gains of up to +35.9%. On RoboCasa365, ProWAM achieves a 48.1% success rate and 18.2% on the challenging Composite-Unseen split, ranking 4th overall. Crucially, in zero-shot real-world experiments, ProWAM achieves 70.0% success, outperforming the strongest baseline by +15.0 (from 55.0% to 70.0%, a +27.3% relative gain) in novel scenes. These results demonstrate the value of progress-indexed visual foresight for closed-loop control. Our program is in https://sii-ferenas.github.io/ProWAM-page.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 1 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?
  2. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
  3. 2026Foresight Without Seeing: Latent Futures for World Action Models
  4. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  5. 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
  6. 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
  7. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  8. 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models