mlsanityData to 14 Oct 2026

Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models

arXiv 2609.06578 ↗First posted 6 Sep 2026cs.CVcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

World Action Models (WAMs) extend Vision-Language-Action (VLA) models by incorporating future visual dynamics into action generation. However, existing WAMs often utilize imagined futures with limited adaptation to evolving execution progress, potentially introducing distracting or unreliable predictive cues. This limitation arises from two empirically identified forms of non-uniformity in future utility: (i) at the inter-progress level, the utility of imagined futures varies across execution stages as control demands change; and (ii) at the intra-progress level, individual future latents exhibit heterogeneous relevance within the same progress state. To address these limitations, we propose ProWAM, a Progress-Conditioned World Action Model that introduces execution progress as an explicit intermediate representation for adaptive imagination utilization. ProWAM comprises two tightly coupled components: (1) To obtain a reliable representation of execution progress, we propose the Self-Supervised Dual-Temporal Progress Encoder (SS-DTPE). SS-DTPE couples short-term action-observation interaction modeling with long-term recurrent progress aggregation to capture recent execution feedback and accumulated task history. (2) Conditioned on the progress representation from SS-DTPE, we propose the Hierarchical Progress-Conditioned Imagination Modulation (HPIM) to adapt imagination utilization to execution progress. HPIM operates at two complementary levels: an inter-progress global modulation mechanism adapts future utilization across execution stages, while an intra-progress relevance mechanism differentiates individual future latents within each progress state. Extensive experiments demonstrate consistent gains over strong VLA and WAM baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 82 of its 91 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

82 of 91 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026Rethink Before You Execute: Adaptive Execution for World Action Models10 Aug
  2. 2026FlowWAM: Optical Flow as a Unified Action Representation for World Action Models14 Jul
  3. 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data8 Jul
  4. 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time8 Jul
  5. 2026DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulation6 Jul
  6. 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory26 Jun
  7. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
  8. 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun
  9. 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models11 Jun
  10. 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding6 Jun
  11. 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models8 May
  12. 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models7 May
11 more
  1. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models7 May
  2. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
  3. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  4. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  5. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  6. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  7. 2026Causal World Modeling for Robot Control29 Jan
  8. 2025Motus: A Unified Latent Action World Model15 Dec
  9. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  10. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 59

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  9. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  10. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  11. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  12. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
38 more
  1. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  2. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  3. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  4. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  5. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  6. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  7. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  8. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
  9. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  10. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  11. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  12. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
  13. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  14. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
  15. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  16. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
  17. 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 64
  18. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
  19. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
  20. 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
  21. 2025Memory, Benchmark & Robots: A Benchmark for Solving Complex Tasks with Reinforcement Learningcited by 36
  22. 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
  23. 2025RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluationcited by 32
  24. 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 30
  25. 2025CronusVLA: Towards Efficient and Robust Manipulation via Multi-Frame Vision-Language-Action Modelingcited by 25
  26. 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
  27. 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
  28. 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
  29. 2025UniEmo: Unifying Emotional Understanding and Generation with Learnable Expert Queriescited by 18
  30. 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
  31. 2026PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric Recordscited by 16
  32. 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 16
  33. 2025STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantizationcited by 13
  34. 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
  35. 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11
  36. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
  37. 2026MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Modelscited by 10
  38. 2025CoEmoGen: Towards Semantically-Coherent and Scalable Emotional Image Content Generationcited by 9

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Foresight Without Seeing: Latent Futures for World Action Models
  2. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems
  3. 2026Event-Aligned Visual Action Reasoning for World Action Models
  4. 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models
  5. 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence
  6. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
  7. 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models
  8. 2026Self-Correcting VLA: Online Action Refinement via Sparse World Imagination