mlsanityData to 7 Oct 2026

StereoVLA: Enhancing Vision-Language-Action Models with Stereo Vision

arXiv 2512.21970 ↗First posted 26 Dec 2025cs.ROcited by 16

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

While Vision-Language-Action (VLA) models excel in generalist manipulation, they often lack fine-grained spatial awareness and show limited viewpoint robustness. This limitation largely stems from the reliance on pretrained RGB encoders, which lack explicit geometric cues and prioritize semantic alignment over geometric representation. We argue that effective visual representations for VLA models must jointly encode both semantic and geometric information. In this paper, we introduce StereoVLA, the first VLA model to incorporate rich geometric cues from large-scale synthetic stereo data. StereoVLA employs a Geometric-and-Semantic (GeoSem) vision encoder that extracts geometric cues from subtle stereo-view disparities for precise spatial perception, while simultaneously capturing semantic features from pixel observations to support language-conditioned manipulation. Additionally, we introduce two synergistic co-training objectives: Interaction-Region Depth Estimation for precise spatial reasoning, and Camera Parameter Estimation to implicitly align perception and action coordinate systems. Compared with baselines that employ various input modalities, StereoVLA achieves a 33.4% absolute gain in success rate in real-world experiments and demonstrates robustness to near-hemispheric camera perspectives. Project page: https://shengliangd.github.io/StereoVLA-Webpage.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 67 of its 85 references that are in the map. First posted on arXiv 26 Dec 2025.

Builds on

67 of 85 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoning15 Oct
  2. 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understanding1 Jul
  3. 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibration27 Jun
  4. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
  5. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
  7. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar

Other references · 60

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
  1. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  2. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  3. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  4. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  5. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  7. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  9. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  10. 2024InternLM2 Technical Reportcited by 391
  11. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  12. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  13. 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
  14. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  15. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  16. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  17. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
  18. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  19. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
  20. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  21. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
  22. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
  23. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
  24. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  25. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  26. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  27. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
  28. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
  29. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
  30. 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 78
  31. 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 64
  32. 2020PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matchingcited by 62
  33. 2024Generalizable Humanoid Manipulation with 3D Diffusion Policiescited by 49
  34. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
  35. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  36. 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
  37. 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 45
  38. 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 42

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
  2. 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
  3. 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 7
  4. 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
  5. 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learningcited by 3
  6. 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulationcited by 3
  7. 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
  8. 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Modelcited by 3
  9. 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
  10. 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
  11. 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 1
  12. 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Modelscited by 0
4 more
  1. 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulationcited by 0
  2. 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardwarecited by 0
  3. 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routingcited by 0
  4. 2026WARP-VLA: Wrist-Camera Adaptation for View-Robust Policy Execution in Vision-Language-Action Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models
  2. 2025GeoAware-VLA: Implicit Geometry Aware Vision-Language-Action Model
  3. 2026ExStereo: Lifting 2D Vision-Language-Action Models to 3D with Explicit Stereo Representations
  4. 2026GaussVLA: Geometry-Aware Spatial Reasoning for Vision-Language-Action Model
  5. 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models
  6. 2026AugVLA-3D: Depth-Driven Feature Augmentation for Vision-Language-Action Models
  7. 20263DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding
  8. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model