mlsanityData to 14 Oct 2026

G3VLA: Geometric inductive bias for Vision-Language-Action Models

arXiv 2606.24472 ↗First posted 23 Jun 2026cs.RO cs.AIcited by 2

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Vision-language-action (VLA) models have rapidly advanced generalist robot manipulation by harnessing the semantic knowledge of pretrained vision-language backbones. However, their visual representations are typically grounded in 2D image coordinates rather than calibrated camera geometry. This limitation is especially pronounced in multi-camera systems, where views are coupled by known intrinsics and extrinsics but processed as independent images. We propose G3VLA, a camera-aware geometric module that injects calibrated structure into the visual-token stream of a pretrained VLA without altering its action space or original action-learning objective. G3VLA combines intrinsic-conditioned ray embeddings, projective positional encoding (PRoPE), and bidirectional cross-view fusion to establish geometrically consistent representations across camera views. Geometric supervision is provided by ground-truth point maps or confidence-gated π3X teacher predictions, enabling training without depth sensors or manual geometric annotations. On π0, G3VLA consistently improves performance on LIBERO and RoboCasa24 under both supervision regimes, while ground-truth supervision improves five-task RoboTwin2.0 averages with three cameras. Experiments on camera-shifted LIBERO-Goal and real robots demonstrate improved robustness to unseen camera viewpoints. Controlled calibration studies across π0 and π0.5 show that these gains depend on correct camera geometry while remaining stable under mild calibration perturbations. These results demonstrate that grounding VLA visual tokens in calibrated camera geometry provides a simple and general mechanism for improving geometric consistency, multi-view reasoning, and viewpoint robustness in pretrained robot policies.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 24 of its 25 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

24 of 25 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
  2. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar

Other references · 22

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
10 more
  1. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  2. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  3. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  4. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  5. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
  6. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
  7. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 138
  8. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
  9. 2025Cameras as Relative Positional Encodingcited by 105
  10. 2023PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulationcited by 56

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Model
  2. 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
  3. 2026GWM-VLA: Geometry-Aware Latent World Modeling for Vision-Language-Action Learning
  4. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  5. 2026LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment
  6. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models
  7. 2025E0: Enhancing Generalization and Fine-Grained Control in VLA Models via Tweedie Discrete Diffusion
  8. 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models