mlsanityData to 14 Oct 2026

MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving

arXiv 2605.12624 ↗First posted 12 May 2026cs.RO cs.CVcited by 6

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Autonomous driving has progressed from modular pipelines toward end-to-end unification, and Vision-Language-Action (VLA) models are a natural extension of this journey beyond Vision-to-Action (VA). In practice, driving VLAs have often trailed VA on planning quality, suggesting that the difficulty is not simply model scale but the interface through which semantic reasoning, temporal context, and continuous control are combined. We argue that this gap reflects how VLA has been built -- as isolated subtask improvements that fail to compose coherent driving capabilities -- rather than what VLA is. We present MindVLA-U1, the first unified streaming VLA architecture for autonomous driving. A unified VLM backbone produces AR language tokens (optional) and flow-matching continuous action trajectories in a single forward pass over one shared representation, preserving the natural output form of each modality. A full streaming design processes the driving video framewise rather than as fixed video-action chunks under costly temporal VLM modeling. Planned trajectories evolve smoothly across frames while a learned streaming memory channel carries temporal context and updates. The unified architecture enables fast/slow systems on dense & sparse MoT backbones via flexible self-attention context management, and exposes a measurable language-control path for action: language-predicted driving intents steers the action diffusion via classifier-free guidance (CFG), turning language-side intent into control signals for continuous action planning. On the long-tail WOD-E2E benchmark, MindVLA-U1 surpasses experienced human drivers for the first time (8.20 RFS vs. 8.13 GT RFS) with 2 diffusion steps, achieves state-of-the-art planning ADEs over prior VA/VLA by large margins, and matches VA latency (16 FPS vs. RAP's 18 FPS at 1B scale) while preserving natural language interfaces for human-vehicle interaction.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 70 of its 81 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

70 of 81 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Driving16 Mar
  2. 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoning30 Dec
  3. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
  4. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  5. 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving2 Sep
  6. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  7. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models29 May
  8. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving23 May

Other references · 62

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2025Qwen3 Technical Reportcited by 8,820
  9. 2020Scaling Laws for Neural Language Modelscited by 6,586
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2024Qwen2.5 Technical Reportcited by 4,942
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  8. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  9. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  13. 2025DINOv3cited by 1,414
  14. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  15. 2022Planning-oriented Autonomous Drivingcited by 1,087
  16. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  17. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  18. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  19. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  20. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  21. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  22. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  23. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  24. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
  25. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
  26. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  27. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  28. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
  29. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  30. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
  31. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  32. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 178
  33. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  34. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  35. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
  36. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
  37. 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 143
  38. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 141

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving
  2. 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving
  3. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
  4. 2026FIVE-VLA: Fast and EffectIVE Autonomous Driving with Recurrent Action Memory
  5. 2026WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA
  6. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
  7. 2026RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation
  8. 2026VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving