mlsanityData to 7 Oct 2026

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

arXiv 2606.04436 ↗First posted 3 Jun 2026cs.CV cs.ROcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction. Our core insight is that 3D geometry perception and 3D spatial reasoning are distinct capabilities that can be disentangled and injected at different feature hierarchies. During training, three tightly coupled components work in concert primarily within the latent space: (1) To gain geometric priors, a latent 3D geometry perception module aligns intermediate visual features with a 3D foundation model, acquiring low-level geometric cues without architectural modifications to the VLM backbone. (2) Complementing this, an online 3D reasoning distillation module mitigates the prompt-induced reasoning gap via a shared reasoning anchor token. During 3D VLM co-training, this anchor is emitted as the first output token to robustly encode spatial priors. During VLA training, it serves as an input token inserted between the task and action instructions, transferring high-level spatial thinking from explicit teacher reasoning prompts to student action prompts without chain-of-thought text generation. (3) These disentangled geometric and reasoning features are then united by a spatially augmented action integration, which jointly injects them into the action-query tokens as hierarchical spatial conditions to prevent action shortcuts. At deployment, our method retains only its lightweight adapters to perform implicit 3D reasoning, discarding the 3D foundation model and the teacher branch used for supervision. Consequently, it operates purely on 2D images without 3D sensors, external models, or explicit text generation while preventing catastrophic forgetting of the pretrained VLM, achieving state-of-the-art performance on LIBERO, LIBERO-PLUS, SimplerEnv, and real-world manipulation tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 46 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

37 of 46 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models23 Mar
  2. 2025Unifying Perception and Action: A Hybrid-Modality Pipeline with Implicit Visual Chain-of-Thought for Robotic Action Generation25 Nov
  3. 2025From Spatial to Actions: Grounding Vision-Language-Action Model in Spatial Foundation Priors20 Oct
  4. 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoning15 Oct
  5. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
  6. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  7. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar

Other references · 30

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  7. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  8. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  9. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  10. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  11. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
  12. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
18 more
  1. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
  2. 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 72
  3. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 68
  4. 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibrationcited by 55
  5. 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
  6. 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Modelscited by 38
  7. 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 31
  8. 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Taskscited by 30
  9. 2025Pre-training Auto-regressive Robotic Models with 4D Representationscited by 27
  10. 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 27
  11. 2025GeoAware-VLA: Implicit Geometry Aware Vision-Language-Action Modelcited by 24
  12. 2025QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Modelscited by 19
  13. 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
  14. 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillationcited by 11
  15. 2025Spatial-Aware VLA Pretraining through Visual-Physical Alignment from Human Videoscited by 10
  16. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulationcited by 6
  17. 2026EvoDriveVLA: Evolving Driving VLA Models via Collaborative Perception-Planning Distillationcited by 3
  18. 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views
  2. 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Models
  3. 2026Think3D: Thinking with Space for Spatial Reasoning
  4. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
  5. 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
  6. 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes
  7. 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
  8. 2026Reinforcing Dual-Path Reasoning in Spatial Vision Language Models