Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
World Action Models (WAMs) extend Vision-Language-Action (VLA) models by incorporating future visual dynamics into action generation. However, existing WAMs often utilize imagined futures with limited adaptation to evolving execution progress, potentially introducing distracting or unreliable predictive cues. This limitation arises from two empirically identified forms of non-uniformity in future utility: (i) at the inter-progress level, the utility of imagined futures varies across execution stages as control demands change; and (ii) at the intra-progress level, individual future latents exhibit heterogeneous relevance within the same progress state. To address these limitations, we propose ProWAM, a Progress-Conditioned World Action Model that introduces execution progress as an explicit intermediate representation for adaptive imagination utilization. ProWAM comprises two tightly coupled components: (1) To obtain a reliable representation of execution progress, we propose the Self-Supervised Dual-Temporal Progress Encoder (SS-DTPE). SS-DTPE couples short-term action-observation interaction modeling with long-term recurrent progress aggregation to capture recent execution feedback and accumulated task history. (2) Conditioned on the progress representation from SS-DTPE, we propose the Hierarchical Progress-Conditioned Imagination Modulation (HPIM) to adapt imagination utilization to execution progress. HPIM operates at two complementary levels: an inter-progress global modulation mechanism adapts future utilization across execution stages, while an intra-progress relevance mechanism differentiates individual future latents within each progress state. Extensive experiments demonstrate consistent gains over strong VLA and WAM baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 82 of its 91 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
82 of 91 references.
Closest ancestors · 23
Same direction, newest first
- 2026Rethink Before You Execute: Adaptive Execution for World Action Models10 Aug
- 2026FlowWAM: Optical Flow as a Unified Action Representation for World Action Models14 Jul
- 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data8 Jul
- 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time8 Jul
- 2026DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulation6 Jul
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory26 Jun
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun
- 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models11 Jun
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding6 Jun
- 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models8 May
- 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models7 May
11 more
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Models7 May
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 59
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
38 more
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 64
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
- 2025Memory, Benchmark & Robots: A Benchmark for Solving Complex Tasks with Reinforcement Learningcited by 36
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
- 2025RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluationcited by 32
- 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 30
- 2025CronusVLA: Towards Efficient and Robust Manipulation via Multi-Frame Vision-Language-Action Modelingcited by 25
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
- 2025UniEmo: Unifying Emotional Understanding and Generation with Learnable Expert Queriescited by 18
- 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
- 2026PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric Recordscited by 16
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 16
- 2025STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantizationcited by 13
- 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
- 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
- 2026MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Modelscited by 10
- 2025CoEmoGen: Towards Semantically-Coherent and Scalable Emotional Image Content Generationcited by 9
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems
- 2026Event-Aligned Visual Action Reasoning for World Action Models
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models
- 2026Self-Correcting VLA: Online Action Refinement via Sparse World Imagination