mlsanityData to 7 Oct 2026

RAF-VLA: Representation Alignment with the Future for End-to-End Autonomous Driving

arXiv 2609.17728 ↗First posted 15 Sep 2026cs.ROcited by 0

On the map: World models → World models for autonomous driving

also in 2 more
Abstract (arXiv)

Recent Vision-Language-Action (VLA) models for autonomous driving have incorporated world modeling by predicting future driving scenes alongside driving actions, demonstrating strong planning performance. Future driving scenes are utilized as dense supervision, encouraging the policy to learn rich internal representations useful for planning. However, these World-Modeling VLAs rely on explicit future generation to learn such representations, thereby introducing two key limitations: additional training burden and inference latency. To address these limitations, we propose RAF-VLA (Representation Alignment with the Future), a VLA-based autonomous driving framework that shapes planning-relevant internal representations through direct guidance from future-frame representations. RAF-VLA employs Future-Aligned Supervised Fine-Tuning, in which a straightforward regularization aligns the policy's hidden states with future-frame representations obtained from a pretrained world encoder while learning driving actions. This simple alignment allows RAF-VLA to avoid the training burden and inference latency associated with future generation. Extensive experiments on the NAVSIM benchmark show that RAF-VLA achieves competitive planning performance against state-of-the-art VLA planners with substantially fewer training samples seen. Moreover, RAF-VLA incurs only 3.8% training overhead and a negligible 1 ms inference overhead.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 21 of its 52 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

21 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving3 Apr

Other references · 20

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  8. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  9. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  10. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  11. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  12. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
8 more
  1. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  2. 2025Pseudo-Simulation for Autonomous Drivingcited by 141
  3. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
  4. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
  5. 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 34
  6. 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
  7. 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoningcited by 15
  8. 2026To View Transform or Not to View Transform: NeRF-based Pre-training Perspectivecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
  2. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  3. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
  4. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  5. 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
  6. 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
  7. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving
  8. 2026LWDrive: Layer-Wise World-Model-Guided Vision-Language Model Planning for Autonomous Driving