mlsanityData to 7 Oct 2026

Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models

arXiv 2605.13632 ↗First posted 13 May 2026cs.RO cs.CVcited by 3

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing VLA models learn a direct "Sense-to-Act" mapping from multimodal observations to robot actions. While effective within the training distribution, such tightly coupled policies are brittle under out-of-domain (OOD) shifts and difficult to correct when failures occur. Although recent embodied Chain-of-Thought (CoT) approaches expose intermediate reasoning, they still lack a mechanism for incorporating human spatial guidance, limiting their ability to resolve visual ambiguities or recover from mistakes. To address this gap, our framework allows users to optionally guide the policy with spatial priors, such as affordance points, boxes, and traces, which the subsequent reasoning process can directly condition on. Based on these inputs, the model generates a unified spatial-visual Chain-of-Thought that integrates external guidance with internal task planning, aligning human visual intent with autonomous decision-making. For practical deployment, we further couple the reasoning module with a lightweight reactive action head for efficient action execution. Extensive experiments demonstrate the effectiveness of our approach. On the in-domain SimplerEnv WidowX benchmark, our framework achieves a state-of-the-art 81.2% success rate. Under OOD visual shifts and spatial ambiguities, a single visual interaction substantially improves task success over existing methods, highlighting the value of interactive reasoning for failure recovery in embodied control. More details of the project can be found here: https://github.com/FutianLabs/GTA-VLA.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 38 of its 41 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

38 of 41 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning14 Jan
  2. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  4. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul

Other references · 34

  1. 2023Segment Anythingcited by 8,158
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
22 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  3. 2025SAM 3: Segment Anything with Conceptscited by 835
  4. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  5. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  6. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
  7. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  9. 2025Seed1.5-VL Technical Reportcited by 367
  10. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  11. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  12. 2024RT-H: Action Hierarchies Using Languagecited by 204
  13. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  14. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  15. 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
  16. 2025Unified Vision-Language-Action Modelcited by 128
  17. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
  18. 2025GR-3 Technical Reportcited by 110
  19. 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
  20. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  21. 2025Detect Anything via Next Point Predictioncited by 66
  22. 2025Mind to Hand: Purposeful Robotic Control via Embodied Reasoningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
  2. 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
  3. 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models
  4. 2025IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction
  5. 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control
  6. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
  7. 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
  8. 2025EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks