mlsanityData to 7 Oct 2026

Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation

arXiv 2606.02486 ↗First posted 1 Jun 2026cs.ROcited by 9

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models generalize across static manipulation but fail when objects move during task execution. They map the current observation to an action and assume the scene is stationary between observation and execution, so at any non-trivial object speed the resulting latency exceeds the time available to grasp. We close this gap with AHEAD (Anticipatory Horizon Extrapolation with Adaptive Dynamics), a predict-then-act wrapper that augments a frozen VLA with a motion-aware latent world model. A small world model trained on manipulation video forecasts future patch tokens in the VLA's feature space, conditioned on per-token velocity and acceleration from optical flow. A language-and-motion saliency mask concentrates prediction on task-relevant patches, and the model rolls forward for an adaptive horizon, halting when prediction uncertainty crosses a threshold. The frozen action decoder then receives the predicted future tokens in place of the current ones. AHEAD adds 4.9M parameters to a frozen 7B OpenVLA and reaches 79 to 97% success across 20 dynamic simulation scenarios where the strongest baseline reaches 31 to 58%. On a physical UFactory xArm 7, AHEAD succeeds on 29/30 to 30/30 on three conveyor and rolling-ball tasks, 23/30 on paddle interception, and 19/30 on projectile catching where every baseline scores 0/30.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 27 of its 65 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

27 of 65 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model12 Feb
  2. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  3. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  5. 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  10. 2023Mastering Diverse Domains through World Modelscited by 1,193
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2020Mastering Atari with Discrete World Modelscited by 990
9 more
  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  2. 2024Genie: Generative Interactive Environmentscited by 706
  3. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  4. 2023Learning Interactive Real-World Simulatorscited by 440
  5. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  6. 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 288
  7. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  8. 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inferencecited by 54
  9. 2025ExpReS-VLA: Specializing Vision-Language-Action Models Through Experience Replay and Retrievalcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ForeTime-VLA: Causal Future-Token Distillation from a World Action Model for Conveyor-Belt Manipulation
  2. 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models
  3. 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models
  4. 2026World Pilot: Steering Vision-Language-Action Models with World-Action Priors
  5. 2026Towards Generalizable Robotic Manipulation in Dynamic Environments
  6. 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
  7. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  8. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation