ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their advancements, VLAs often overlook explicit reasoning and learn the functional input-action mappings, omitting crucial logical steps, which are especially pronounced in interpretability and generalization for complex, long-horizon manipulation tasks. In this work, we propose ReFineVLA, a multimodal reasoning-aware framework that fine-tunes VLAs with teacher-guided reasons. We first augment robotic datasets with reasoning rationales generated by an expert teacher model, guiding VLA models to learn to reason about their actions. Then, we fine-tune pre-trained VLAs with the reasoning-enriched datasets with ReFineVLA, while maintaining the underlying generalization abilities and boosting reasoning capabilities. We also conduct attention map visualization to analyze the alignment among visual observation, linguistic prompts, and to-be-executed actions of ReFineVLA, reflecting the model is ability to focus on relevant tasks and actions. Through this additional step, we explore that ReFineVLA-trained models exhibit a meaningful agreement between vision-language and action domains, highlighting the enhanced multimodal understanding and generalization. Evaluated across a suite of simulated manipulation benchmarks on SimplerEnv with both WidowX and Google Robot tasks, ReFineVLA achieves state-of-the-art performance, in success rate over the second-best method on the both the WidowX benchmark and Google Robot Tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 62 of its 72 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
62 of 72 references.
Closest ancestors · 5
Same direction, newest first
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoning12 Dec
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought24 May
Other references · 57
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
38 more
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2022A Generalist Agentcited by 802
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2015Policy Distillationcited by 414
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2023Faithful Chain-of-Thought Reasoningcited by 285
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2023Any-point Trajectory Modeling for Policy Learningcited by 207
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2015Actor-Mimic: Deep Multitask and Transfer Reinforcement Learningcited by 176
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2023Language-Driven Representation Learning for Roboticscited by 163
- 2023Vision-Language Models as Success Detectorscited by 138
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2023SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inferencecited by 89
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
- 2024BAKU: An Efficient Transformer for Multi-Task Policy Learningcited by 80
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 72
- 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillingscited by 68
- 2023Contrastive Chain-of-Thought Promptingcited by 52
- 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Modelscited by 51
- 2023VCoder: Versatile Vision Encoders for Multimodal Large Language Modelscited by 42
- 2024Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasetscited by 23
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning
- 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Action
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification