mlsanityData to 14 Oct 2026

Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation

arXiv 2608.23138 ↗First posted 24 Aug 2026cs.RO cs.AI cs.CVcited by 2

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle interfaces between multimodal reasoning and robot execution. We present Pointing-VLA, a typed hidden-state spatial readout built on Embodied-R1. Geometry-specific heads predict normalized points, object-functional grounding (OFG) heatmaps, and visual trajectories without serializing geometry as text. For the evaluated Bridge/WidowX and physical pick-place deployments, an explicit execution contract assigns PICK to source-conditioned OFG and PLACE to Pointing, providing direct stage-aligned spatial targets. Pointing-VLA achieves SOTA performance on Bridge/WidowX, averaging 72.9% across the evaluated four-task set without Bridge-specific finetuning under collision-enabled CuRobo execution. Pointing and OFG show complementary strengths across native and cross-dataset evaluations. The OFG/contact readout transfers to NORA-1.5, preserving or improving success while reducing recorded controller time by more than 20×; typed heads are also 6.68--6.90× faster than Embodied-R1 text decoding on a shared external suite. When integrated as spatial guidance for a π0.5 action policy, Pointing-VLA raises autonomous real-robot success from 52.7% to 80.7% across three visual contexts. These results establish typed spatial readouts as an efficient, inspectable interface between embodied reasoning and robot execution.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 13 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

9 of 13 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug
  2. 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May

Other references · 7

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  6. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  7. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Spa-Bench: A Real-Robot Benchmark for Spatial Grounding in Vision-Language-Action Models
  2. 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
  3. 2026SpatialPoint: Spatial-aware Point Prediction for Embodied Localization
  4. 2026Direct Action-Head Injection of A Grounded 3D Point Unlocks Spatial and Task Generalization
  5. 2025Point What You Mean: Visually Grounded Instruction Policy
  6. 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interaction
  7. 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors
  8. 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation