Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Chain-of-Thought (CoT) reasoning has become a powerful driver of trajectory prediction in VLA-based autonomous driving, yet its autoregressive nature imposes a latency cost that is prohibitive for real-time deployment. Latent CoT methods attempt to close this gap by compressing reasoning into continuous hidden states, but consistently fall short of their explicit counterparts. We suggest that this is due to purely linguistic latent representations compressing a symbolic abstraction of the world, rather than the causal dynamics that actually govern driving. Thus, we present OneVL (One-step latent reasoning and planning with Vision-Language explanations), a unified VLA and World Model framework that routes reasoning through compact latent tokens supervised by dual auxiliary decoders. Alongside a language decoder that reconstructs text CoT, we introduce a visual world model decoder that predicts future-frame tokens, forcing the latent space to internalize the causal dynamics of road geometry, agent motion, and environmental change. A three-stage training pipeline progressively aligns these latents with trajectory, language, and visual objectives, ensuring stable joint optimization. In inference, the auxiliary decoders are discarded, and all latent tokens are prefilled in a single parallel pass, matching the speed of answer-only prediction. Across four benchmarks, OneVL becomes the first latent CoT method to surpass explicit CoT, delivering superior accuracy at answer-only latency. These results show that with world model supervision, latent CoT produces more generalizable representations than verbose token-by-token reasoning. Code has been open-sourced to the community. Project Page: https://xiaomi-embodied-intelligence.github.io/OneVL
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 57 of its 119 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
57 of 119 references.
Closest ancestors · 3
Same direction, newest first
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
- 2025A Survey of World Models for Autonomous Driving20 Jan
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 54
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024OpenAI o1 System Cardcited by 1,220
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
38 more
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023Language Modeling Is Compressioncited by 225
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoningcited by 87
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025SIM-CoT: Supervised Implicit Chain-of-Thoughtcited by 63
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 40
- 2025Vision as LoRAcited by 37
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 37
- 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
- 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 35
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 34
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 26
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2024The RoboDrive Challenge: Drive Anytime Anywhere in Any Conditioncited by 23
- 2025GuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Drivingcited by 21
- 2025DVGT: Driving Visual Geometry Transformercited by 20
- 2026VGGDrive: Empowering Vision-Language Models with Cross-View Geometric Grounding for Autonomous Drivingcited by 19
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 17
- 2025NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anythingcited by 14
- 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policiescited by 12
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scalecited by 12
- 2024GaussianPretrain: A Simple Unified 3D Gaussian Representation for Visual Pre-training in Autonomous Drivingcited by 11
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresightcited by 11
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Casescited by 9
- 2026Language-Conditioned World Modeling for Visual Navigationcited by 9
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 14
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigationcited by 5
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Predictioncited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Drivingcited by 1
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planningcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planning22 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving23 Jul 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation29 Jun 2026
- 2026Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction4 Jun 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
- 2025Latent Chain-of-Thought World Modeling for End-to-End Driving
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving
- 2026Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving
- 2026DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning