Where Predictive Supervision Goes Shapes What VLA Policies Learn
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
Future prediction is increasingly used to improve vision-language-action (VLA) policies, based on the premise that anticipating scene evolution encourages representations useful for control. However, forecast quality alone does not establish that a policy has learned a better representation for action. This distinction matters under distribution shift, where successful control depends on preserving spatial state and likely scene change beyond familiar configurations. We study what determines whether predictive supervision improves the visual representation used by a VLA policy. Through controlled comparisons with matched target constructions, prediction horizons, and training conditions, we find that different prediction interfaces produce markedly different forecasts and visual representations, including in the spatial, dynamics, and action information that transfers beyond familiar scenes. We trace these differences to how predictive errors shape the policy's visual stream. Consistent with this controlled finding, VLA policies trained with more direct, scene-matched future supervision show stronger robustness under simulated and physical distribution shifts. Together, our results frame future prediction as a representation-learning design problem whose value for control depends on whether its supervision reaches the representations through which the policy acts.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 37 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
34 of 37 references.
References · 34
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
22 more
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2020Data-Efficient Reinforcement Learning with Self-Predictive Representationscited by 309
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2019Video Representation Learning by Dense Predictive Codingcited by 175
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 87
- 2024DINO-Foresight: Looking into the Future with DINOcited by 44
- 2026World Guidance: World Modeling in Condition Space for Action Generationcited by 32
- 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Modelscited by 30
- 2023DeepMIM: Deep Supervision for Masked Image Modelingcited by 16
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 14
- 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Modelscited by 10
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulationcited by 9
- 2026Colosseum V2: Benchmarking Generalization for Vision-Language-Action Modelscited by 3
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models
- 2026Anticipate Before Acting: Future-State-Conditioned Vision-Language Navigation
- 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
- 2026Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Grounding
- 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models