See like a Robot: Robot-Centric Pointmaps for VLA Models
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models require 3D spatial reasoning, yet RGB observations encode robot-object geometry only implicitly. Lifting depth with camera intrinsics makes this geometry explicit as dense, image-aligned pointmaps, but their camera-frame coordinates depend on camera placement. We propose SeeR-VLA, which transforms pointmaps into a robot-centric frame with an end-effector origin and robot-base-aligned axes. An encoder initialized from pretrained RGB weights extracts pointmap features, which are added to corresponding RGB tokens without increasing the token count. Across 24 RoboCasa tasks and four real-world tasks, SeeR-VLA improves average success over RGB-only π0.5 by 6.4 and 32.5 percentage points, respectively. It also exceeds the strongest evaluated 3D-augmented baseline, PointVLA, by 3.5 and 23.7 percentage points, respectively. Beyond these gains, our ablations clarify how coordinate choices affect VLA performance, showing that end-effector centering is most effective with robot-base-aligned axes. The benefits grow as training viewpoints diversify, highlighting the importance of using robot-frame pointmaps when learning from diverse camera configurations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 51 of its 55 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
51 of 55 references.
Closest ancestors · 2
Same direction, newest first
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoning15 Oct
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
Other references · 49
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
37 more
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Modelscited by 77
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 68
- 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibrationcited by 55
- 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understandingcited by 55
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
- 2020Grasping with Chopsticks: Combating Covariate Shift in Model-free Imitation Learning for Fine Manipulationcited by 37
- 2022Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Cloudscited by 31
- 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 31
- 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Taskscited by 30
- 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matchingcited by 23
- 2024RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulationcited by 20
- 20253D FlowMatch Actor: Unified 3D Policy for Single- and Dual-Arm Manipulationcited by 19
- 2025Adapt3R: Adaptive 3D Scene Representation for Domain Transfer in Imitation Learningcited by 16
- 2025Do You Know Where Your Camera Is? View-Invariant Policy Learning with Camera Conditioningcited by 14
- 2025OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Modelcited by 13
- 2026Any3D-VLA: Enhancing VLA Robustness via Diverse Point Cloudscited by 13
- 2025PointMapPolicy: Structured Point Cloud Processing for Multi-Modal Imitation Learningcited by 10
- 2024Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Framescited by 9
- 2026Demystifying Action Space Design for Robotic Manipulation Policiescited by 9
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policycited by 8
- 2026PoseVLA: Universal Pose Pretraining for Generalizable Vision-Language-Action Policiescited by 7
- 2025Canonical Policy: Learning Canonical 3D Representation for SE(3)-Equivariant Policycited by 6
- 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interactioncited by 6
- 20263D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Action Models through 3D Trajectory Guidancecited by 3
- 2026ReMAP-DP: Reprojected Multi-view Aligned PointMaps for Diffusion Policycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
- 2025Spatial-Aware VLA Pretraining through Visual-Physical Alignment from Human Videos
- 2025cVLA: Towards Efficient Camera-Space VLAs
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Models
- 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model
- 2026The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection