StereoVLA: Enhancing Vision-Language-Action Models with Stereo Vision
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
While Vision-Language-Action (VLA) models excel in generalist manipulation, they often lack fine-grained spatial awareness and show limited viewpoint robustness. This limitation largely stems from the reliance on pretrained RGB encoders, which lack explicit geometric cues and prioritize semantic alignment over geometric representation. We argue that effective visual representations for VLA models must jointly encode both semantic and geometric information. In this paper, we introduce StereoVLA, the first VLA model to incorporate rich geometric cues from large-scale synthetic stereo data. StereoVLA employs a Geometric-and-Semantic (GeoSem) vision encoder that extracts geometric cues from subtle stereo-view disparities for precise spatial perception, while simultaneously capturing semantic features from pixel observations to support language-conditioned manipulation. Additionally, we introduce two synergistic co-training objectives: Interaction-Region Depth Estimation for precise spatial reasoning, and Camera Parameter Estimation to implicitly align perception and action coordinate systems. Compared with baselines that employ various input modalities, StereoVLA achieves a 33.4% absolute gain in success rate in real-world experiments and demonstrates robustness to near-hemispheric camera perspectives. Project page: https://shengliangd.github.io/StereoVLA-Webpage.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 67 of its 85 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
67 of 85 references.
Closest ancestors · 7
Same direction, newest first
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoning15 Oct
- 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understanding1 Jul
- 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibration27 Jun
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
Other references · 60
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2024InternLM2 Technical Reportcited by 391
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 78
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 64
- 2020PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matchingcited by 62
- 2024Generalizable Humanoid Manipulation with 3D Diffusion Policiescited by 49
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
- 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 45
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 42
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 7
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
- 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learningcited by 3
- 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulationcited by 3
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Modelcited by 3
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 1
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Modelscited by 0
4 more
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulationcited by 0
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardwarecited by 0
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routingcited by 0
- 2026WARP-VLA: Wrist-Camera Adaptation for View-Robust Policy Execution in Vision-Language-Action Modelscited by 0
- 2026WARP-VLA: Wrist-Camera Adaptation for View-Robust Policy Execution in Vision-Language-Action Models8 Oct 2026
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing21 Sep 2026
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware16 Sep 2026
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulation26 Aug 2026
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Models5 Aug 2026
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model6 Jul 2026
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model28 Jun 2026
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination9 Jun 2026
- 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation20 May 2026
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model14 May 2026
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization12 May 2026
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception11 May 2026
4 more
- 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May 2026
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenes6 Apr 2026
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference11 Mar 2026
- 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learning31 Jan 2026
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
- 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learningcited by 3
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Modelcited by 3
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Modelscited by 0
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routingcited by 0
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing21 Sep 2026
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Models5 Aug 2026
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model6 Jul 2026
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model28 Jun 2026
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination9 Jun 2026
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model14 May 2026
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenes6 Apr 2026
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference11 Mar 2026
- 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learning31 Jan 2026
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
Similar, not cited
Close in wording, no citation either way
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models
- 2025GeoAware-VLA: Implicit Geometry Aware Vision-Language-Action Model
- 2026ExStereo: Lifting 2D Vision-Language-Action Models to 3D with Explicit Stereo Representations
- 2026GaussVLA: Geometry-Aware Spatial Reasoning for Vision-Language-Action Model
- 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models
- 2026AugVLA-3D: Depth-Driven Feature Augmentation for Vision-Language-Action Models
- 20263DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model