Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle interfaces between multimodal reasoning and robot execution. We present Pointing-VLA, a typed hidden-state spatial readout built on Embodied-R1. Geometry-specific heads predict normalized points, object-functional grounding (OFG) heatmaps, and visual trajectories without serializing geometry as text. For the evaluated Bridge/WidowX and physical pick-place deployments, an explicit execution contract assigns PICK to source-conditioned OFG and PLACE to Pointing, providing direct stage-aligned spatial targets. Pointing-VLA achieves SOTA performance on Bridge/WidowX, averaging 72.9% across the evaluated four-task set without Bridge-specific finetuning under collision-enabled CuRobo execution. Pointing and OFG show complementary strengths across native and cross-dataset evaluations. The OFG/contact readout transfers to NORA-1.5, preserving or improving success while reducing recorded controller time by more than 20×; typed heads are also 6.68--6.90× faster than Embodied-R1 text decoding on a shared external suite. When integrated as spatial guidance for a π0.5 action policy, Pointing-VLA raises autonomous real-robot success from 52.7% to 80.7% across three visual contexts. These results establish typed spatial readouts as an efficient, inspectable interface between embodied reasoning and robot execution.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 13 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
9 of 13 references.
Closest ancestors · 2
Same direction, newest first
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May
Other references · 7
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Spa-Bench: A Real-Robot Benchmark for Spatial Grounding in Vision-Language-Action Models
- 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
- 2026SpatialPoint: Spatial-aware Point Prediction for Embodied Localization
- 2026Direct Action-Head Injection of A Grounded 3D Point Unlocks Spatial and Task Generalization
- 2025Point What You Mean: Visually Grounded Instruction Policy
- 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interaction
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors
- 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation