Bridge3D: Enabling Vision-Language-Action Models to See and Act in 3D
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models have demonstrated remarkable generalization in robotic manipulation via large-scale multimodal pretraining. However, VLA models are mainly trained on 2D-centric observations, which inherently constrains their capacity for precise spatial manipulation. Previous methods enhance 3D awareness by introducing implicit spatial priors, but still lack explicit geometry guidance. In this paper, we propose Bridge3D that integrates both implicit and explicit 3D geometry guidance into pre-trained 2D VLA models, enabling them to ''see'' and ''act'' in 3D. Bridge3D introduces two strategies: 1) Implicit Fusion, which enriches visual tokens with features from 3D foundation models to improve ''seeing'' in 3D; 2) Explicit Conditioning, which integrates action denoising with an explicit 3D semantic field to achieve ''acting'' in 3D. Furthermore, we utilize the proposed layer-wise linear probing to improve learning efficiency. Experiments show that Bridge3D achieves superior performance against state-of-the-art methods. On the RoboTwin 2.0 benchmark, Bridge3D exceeds π0 by 14.0 percentage points, while in real-world experiments, it outperforms Spatial Forcing by 11.7 percentage points. These results demonstrate Bridge3D's strong capabilities in high-precision and spatial-sensitive manipulation tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 40 of its 48 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
40 of 48 references.
Closest ancestors · 5
Same direction, newest first
- 20263D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Action Models through 3D Trajectory Guidance30 Jun
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model14 Oct
- 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understanding1 Jul
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
Other references · 35
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
23 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 58
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
- 2024GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policycited by 25
- 2025AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulationcited by 21
- 2026Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models
- 20263DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding
- 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Tasks
- 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation
- 20263D-Mix for VLA: A Plug-and-Play Module for Integrating VGGT-based 3D Information into Vision-Language-Action Models
- 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
- 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interaction