Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
Abstract (arXiv)
In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing VLA models learn a direct "Sense-to-Act" mapping from multimodal observations to robot actions. While effective within the training distribution, such tightly coupled policies are brittle under out-of-domain (OOD) shifts and difficult to correct when failures occur. Although recent embodied Chain-of-Thought (CoT) approaches expose intermediate reasoning, they still lack a mechanism for incorporating human spatial guidance, limiting their ability to resolve visual ambiguities or recover from mistakes. To address this gap, our framework allows users to optionally guide the policy with spatial priors, such as affordance points, boxes, and traces, which the subsequent reasoning process can directly condition on. Based on these inputs, the model generates a unified spatial-visual Chain-of-Thought that integrates external guidance with internal task planning, aligning human visual intent with autonomous decision-making. For practical deployment, we further couple the reasoning module with a lightweight reactive action head for efficient action execution. Extensive experiments demonstrate the effectiveness of our approach. On the in-domain SimplerEnv WidowX benchmark, our framework achieves a state-of-the-art 81.2% success rate. Under OOD visual shifts and spatial ambiguities, a single visual interaction substantially improves task success over existing methods, highlighting the value of interactive reasoning for failure recovery in embodied control. More details of the project can be found here: https://github.com/FutianLabs/GTA-VLA.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 38 of its 41 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
38 of 41 references.
Closest ancestors · 4
Same direction, newest first
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning14 Jan
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 34
- 2023Segment Anythingcited by 8,158
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
22 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2025GR-3 Technical Reportcited by 110
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2025Detect Anything via Next Point Predictioncited by 66
- 2025Mind to Hand: Purposeful Robotic Control via Embodied Reasoningcited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
- 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models
- 2025IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction
- 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
- 2025EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks