mlsanityData to 7 Oct 2026

RISE: Adaptive Imagination for World Action Models

arXiv 2608.20430 ↗First posted 20 Aug 2026cs.CVcited by 3

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) improve planning by incorporating future world evolution into action generation, yet existing methods allocate a fixed imagination budget to every scene. We propose RISE (Refining Imagination through SElective Rollout), a system-level adaptive imagination framework that makes sequential textscRoll/textscStop decisions according to the expected planning benefit of continued rollout. At each step, a Latent Evaluator estimates the risk revealed by the current prefix and how much planning could improve if imagination continues, while a Rollout Gate weighs this expected benefit against additional computation cost. Since factual driving logs expose only one realized future, we further construct CounterDrive, a counterfactual dataset with diverse outcomes and risk levels, to enrich future dynamics and provide localized risk supervision. Each retained sample undergoes expert verification and annotation of trajectory validity, incident onset, and causal category, providing a reusable resource for safety-critical world-modeling research. Experiments on NAVSIM and nuScenes show that RISE achieves the best overall planning performance while reducing unnecessary rollout, with additional transfer results supporting its plug-in generality across WAM architectures.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 31 of its 40 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

31 of 40 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026World Action Models: A Survey18 Jun
  2. 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis4 Jun
  3. 2026World Action Models: The Next Frontier in Embodied AI12 May
  4. 2026The DAWN of World-Action Interactive Models12 May
  5. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  6. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  7. 2026World Action Models are Zero-shot Policies17 Feb
  8. 2026Causal World Modeling for Robot Control29 Jan
  9. 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction22 Oct
  10. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun

Other references · 21

  1. 2018World Modelscited by 1,444
  2. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  3. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  4. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  5. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 258
  6. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  7. 2025Unified Video Action Modelcited by 195
  8. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
  9. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 127
  10. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
  11. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
  12. 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 61
9 more
  1. 2025A Survey of World Models for Autonomous Drivingcited by 60
  2. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving Worldcited by 43
  3. 2025DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Drivingcited by 39
  4. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 27
  5. 2026Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Drivingcited by 26
  6. 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 21
  7. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
  8. 2026DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Drivingcited by 13
  9. 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Models
  2. 2026FLEX-WAM: Flexible Block-Causal World-Action Models for Long-Horizon Imagination and Planning
  3. 2026RISE: Self-Improving Robot Policy with Compositional World Model
  4. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models
  5. 2026Beyond Visual Quality: A Study of Test-Time Planning with World Action Models
  6. 2026ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games
  7. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  8. 2026MemWM: Memory-Augmented Text-Based World Model