mlsanityData to 14 Oct 2026

Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics

arXiv 2608.21440 ↗First posted 18 Aug 2026cs.RO cs.AIcited by 0

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models have advanced end-to-end autonomous driving by leveraging foundation models for semantic reasoning and long-tail generalization. However, their planning performance remains limited in complex driving environments because image-only representations inadequately capture planning-relevant road geometry and topology. In this paper, we propose Geo-VLA, a plug-and-play framework that enhances VLA models by learning geometry-aware visual representations. During training, Geo-VLA internalizes geometric map semantics to strengthen road-structure representations, while requiring no HD maps or additional lane information during inference. To support this approach, we introduce Geo-QA, a geometry-focused question-answering dataset that injects road geometry into vision-language representations through contrastive learning and instruction tuning. Experiments on NAVSIM v1 demonstrate that Geo-VLA consistently improves VLA planners with distinct action-generation architectures, achieving 92.1 PDMS and establishing a new state-of-the-art among single-camera VLA planners.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 19 of its 24 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

19 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar
  2. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar
  3. 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving16 Feb
  4. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
  5. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct

Other references · 14

  1. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  2. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  3. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
  4. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  5. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  6. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  7. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  8. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
  9. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
  10. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  11. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
  12. 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
2 more
  1. 2024Lane2Seq: Towards Unified Lane Detection via Sequence Generationcited by 5
  2. 2026ReflectDrive-2: Reinforcement-Learning-Aligned Self-Editing for Discrete Diffusion Drivingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving
  2. 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
  3. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
  4. 2026S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving
  5. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
  6. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
  7. 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
  8. 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving