mlsanityData to 14 Oct 2026

WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models

arXiv 2609.03681 ↗First posted 3 Sep 2026cs.ROcited by 0

On the map: World models → Embodied and robot world models

also in 2 more
Abstract (arXiv)

Post-training VLA policies typically rely on supervised fine-tuning with costly expert demonstrations or reinforcement learning with expensive and potentially unstable real-world exploration. World models offer a promising alternative by evaluating candidate behaviors through imagined futures, yet effective post-training requires more than accurate prediction: imagination must be scheduled where it is useful, bounded within reliable horizons, and translated into trustworthy policy supervision. In robotic manipulation, the value of imagination varies substantially across execution stages, while extended rollouts can accumulate prediction errors and introduce unreliable learning signals. We introduce WISE (World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models), a unified framework that coordinates when and how world-model imagination is used during policy refinement. WISE selectively invokes imagination at interaction-relevant states, performs bounded multi-view rollouts, evaluates candidate futures using progress and completion signals, and uses their relative outcomes to refine actions generated from real interaction contexts. Extensive experiments with both π0 and π0.5 demonstrate consistent improvements across diverse manipulation tasks while reducing GPU computation time by approximately 80% compared with full imagination. Real-world evaluations further show substantial gains in robustness and generalization under diverse real-world distribution shifts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 32 of its 41 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

32 of 41 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
  2. 2026RISE: Self-Improving Robot Policy with Compositional World Model11 Feb
  3. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
  4. 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
  5. 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep

Other references · 27

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  10. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2023Mastering Diverse Domains through World Modelscited by 1,253
15 more
  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  2. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  3. 2024Genie: Generative Interactive Environmentscited by 747
  4. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  5. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  6. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  7. 2024Diffusion Policy Policy Optimizationcited by 280
  8. 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
  9. 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 176
  10. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 176
  11. 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policycited by 154
  12. 2025Improving Vision-Language-Action Model with Online Reinforcement Learningcited by 116
  13. 2022Interactive Imitation Learning in Robotics: A Surveycited by 55
  14. 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Modelscited by 49
  15. 2026World Model for Robot Learning: A Comprehensive Surveycited by 46

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models
  2. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL
  3. 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization
  4. 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learning
  5. 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models
  6. 2026Self-Correcting VLA: Online Action Refinement via Sparse World Imagination
  7. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation
  8. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation