Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models have advanced end-to-end autonomous driving by leveraging foundation models for semantic reasoning and long-tail generalization. However, their planning performance remains limited in complex driving environments because image-only representations inadequately capture planning-relevant road geometry and topology. In this paper, we propose Geo-VLA, a plug-and-play framework that enhances VLA models by learning geometry-aware visual representations. During training, Geo-VLA internalizes geometric map semantics to strengthen road-structure representations, while requiring no HD maps or additional lane information during inference. To support this approach, we introduce Geo-QA, a geometry-focused question-answering dataset that injects road geometry into vision-language representations through contrastive learning and instruction tuning. Experiments on NAVSIM v1 demonstrate that Geo-VLA consistently improves VLA planners with distinct action-generation architectures, achieving 92.1 PDMS and establishing a new state-of-the-art among single-camera VLA planners.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 19 of its 24 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
19 of 24 references.
Closest ancestors · 5
Same direction, newest first
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving16 Feb
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
Other references · 14
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
- 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving
- 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
- 2026S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
- 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving