mlsanityData to 14 Oct 2026

What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling

arXiv 2609.34981 ↗First posted 28 Sep 2026cs.CV cs.ROcited by 0

On the map: World models → Latent predictive world models also fits: Embodied and robot world models

Abstract (arXiv)

World action models (WAMs) predict the future alongside actions during training. Due to the heavy computation cost of video denoising, whether the future must still be generated during inference is disputed: Explicit WAMs denoise it into clean frames along with every action chunk, whereas Latent WAMs discard it entirely for acceleration. We find that latent WAMs, despite matching explicit ones on in-distribution tasks, fail to retain the generalization benefits that originally motivated WAMs. To demonstrate this, we evaluate generalization along three axes: environmental perturbation, data efficiency, and task generalization. Controlled comparisons with a matched backbone, training data, and budget reveal consistent degradation across all three axes when the action expert no longer conditions on future representations. Further analysis shows that the gap arises almost entirely from the first denoising step: the benefit comes from preparing the future, not generating it. We therefore propose Simple-WAM, which simplifies future modeling into a single forward pass of fully noised video tokens and adapts the training-time noise schedule to this inference behavior. Across simulation and real-world tasks, Simple-WAM achieves the best of both worlds, leading explicit WAMs in generalization performance with efficiency comparable to Latent WAMs. Project Page: https://zrporz.github.io/Simple-WAM-Web/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

30 of 32 references.

References · 30

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  7. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  8. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  9. 2026World Action Models are Zero-shot Policiescited by 465
  10. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  11. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  12. 2026Causal World Modeling for Robot Controlcited by 321
18 more
  1. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  2. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  3. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  4. 2025Motus: A Unified Latent Action World Modelcited by 251
  5. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
  6. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  7. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
  8. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  9. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 139
  10. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 75
  11. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 38
  12. 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 33
  13. 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decodingcited by 23
  14. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imaginationcited by 18
  15. 2026Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Modelscited by 17
  16. 2026MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Modelscited by 10
  17. 2025Benchmarking Vision, Language, & Action Models in Procedurally Generated, Open Ended Action Environmentscited by 6
  18. 2026Keep the Future, Drop the Rollout: RIFT for World Action Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Foresight Without Seeing: Latent Futures for World Action Models
  2. 2026World Action Models: A Survey
  3. 2026Predict Before You Deploy: Offline Prediction of Quantization-Induced Task Degradation for World Action Models
  4. 2026Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models
  5. 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models
  6. 2026DeltaWAM: Distilling Action Tangent Fields into World Action Models
  7. 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models
  8. 2026The DAWN of World-Action Interactive Models