LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic conflicts. Recent shifts toward latent reasoning attempt to bypass these bottlenecks by thinking in continuous hidden space. However, without explicit intermediate constraints, standard latent CoT often operates as a physics-agnostic representation. To address this, we propose the Latent Spatio-Temporal VLA (LaST-VLA), a framework shifting the reasoning paradigm from discrete symbolic processing into a physically grounded Latent Spatio-Temporal CoT. By implementing a dual-feature alignment mechanism, we distill geometric constraints from 3D foundation models and dynamic foresight from world models directly into the latent space. Coupled with a progressive SFT training strategy that transitions from feature alignment to trajectory generation, and refined via Reinforcement Learning with Group Relative Policy Optimization (GRPO) to ensure safety and rule compliance. method~setting a new record on NAVSIM v1 (91.3 PDMS) and NAVSIM v2 (87.1 EPDMS), while excelling in spatial-temporal reasoning on SURDS and NuDynamics benchmarks.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 41 of its 45 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
41 of 45 references.
Closest ancestors · 9
Same direction, newest first
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving17 Sep
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning23 Jun
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning6 Apr
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generation25 Mar
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
- 2024Making Large Language Models Better Planners with Reasoning-Decision Alignment25 Aug
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar
Other references · 32
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
20 more
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 201
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 166
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
- 2025Pseudo-Simulation for Autonomous Drivingcited by 150
- 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 134
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025Latent Visual Reasoningcited by 104
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
- 2025SIM-CoT: Supervised Implicit Chain-of-Thoughtcited by 70
- 2024Doe-1: Closed-Loop Autonomous Driving with Large World Modelcited by 51
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving Worldcited by 47
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Modelscited by 29
- 2025Mull-Tokens: Modality-Agnostic Latent Thinkingcited by 19
- 2026Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflictscited by 7
Built on by
Citing papers per year: 2026: 28.
28 papers.
Sort:
By area:
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 43
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 19
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 17
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scalecited by 13
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 12
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 10
- 2026DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Modelscited by 3
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026Post-Training in End-to-End Autonomous Drivingcited by 2
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Drivingcited by 1
16 more
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyondcited by 0
- 2026TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Drivingcited by 0
- 2026OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMscited by 0
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcingcited by 0
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAscited by 0
- 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligencecited by 0
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Drivingcited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0
- 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rolloutscited by 0
- 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Drivingcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Driving5 Oct 2026
- 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts29 Sep 2026
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving28 Sep 2026
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Driving25 Sep 2026
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligence21 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving3 Sep 2026
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAs2 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics18 Aug 2026
16 more
- 2026Post-Training in End-to-End Autonomous Driving9 Jul 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing22 Jun 2026
- 2026OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs21 Jun 2026
- 2026DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models15 Jun 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun 2026
- 2026TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Driving26 May 2026
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond25 May 2026
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model21 May 2026
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving11 May 2026
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook2 Apr 2026
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scale1 Apr 2026
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scalecited by 13
- 2026Post-Training in End-to-End Autonomous Drivingcited by 2
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyondcited by 0
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Drivingcited by 0
- 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Drivingcited by 0
- 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Driving5 Oct 2026
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Driving25 Sep 2026
- 2026Post-Training in End-to-End Autonomous Driving9 Jul 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond25 May 2026
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scale1 Apr 2026
- 2026DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Modelscited by 3
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Drivingcited by 1
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAscited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving3 Sep 2026
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAs2 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing22 Jun 2026
- 2026DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models15 Jun 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 19
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligencecited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving28 Sep 2026
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligence21 Sep 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics18 Aug 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 17
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 12
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 10
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
- 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
- 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rolloutscited by 0
- 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts29 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun 2026
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model21 May 2026
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving11 May 2026
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Latent Chain-of-Thought World Modeling for End-to-End Driving
- 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges
- 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving