mlsanityData to 7 Oct 2026

ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning

arXiv 2604.17800 ↗First posted 20 Apr 2026cs.RO cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their advancements, VLAs often overlook explicit reasoning and learn the functional input-action mappings, omitting crucial logical steps, which are especially pronounced in interpretability and generalization for complex, long-horizon manipulation tasks. In this work, we propose ReFineVLA, a multimodal reasoning-aware framework that fine-tunes VLAs with teacher-guided reasons. We first augment robotic datasets with reasoning rationales generated by an expert teacher model, guiding VLA models to learn to reason about their actions. Then, we fine-tune pre-trained VLAs with the reasoning-enriched datasets with ReFineVLA, while maintaining the underlying generalization abilities and boosting reasoning capabilities. We also conduct attention map visualization to analyze the alignment among visual observation, linguistic prompts, and to-be-executed actions of ReFineVLA, reflecting the model is ability to focus on relevant tasks and actions. Through this additional step, we explore that ReFineVLA-trained models exhibit a meaningful agreement between vision-language and action domains, highlighting the enhanced multimodal understanding and generalization. Evaluated across a suite of simulated manipulation benchmarks on SimplerEnv with both WidowX and Google Robot tasks, ReFineVLA achieves state-of-the-art performance, in success rate over the second-best method on the both the WidowX benchmark and Google Robot Tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 62 of its 72 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

62 of 72 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  2. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
  3. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
  4. 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoning12 Dec
  5. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought24 May

Other references · 57

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
38 more
  1. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  2. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  3. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  4. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  5. 2022A Generalist Agentcited by 802
  6. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  7. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  8. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  9. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  11. 2015Policy Distillationcited by 414
  12. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  13. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  14. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  15. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  16. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  17. 2023Faithful Chain-of-Thought Reasoningcited by 285
  18. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  19. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
  20. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  21. 2023Any-point Trajectory Modeling for Policy Learningcited by 207
  22. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  23. 2015Actor-Mimic: Deep Multitask and Transfer Reinforcement Learningcited by 176
  24. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  25. 2023Language-Driven Representation Learning for Roboticscited by 163
  26. 2023Vision-Language Models as Success Detectorscited by 138
  27. 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
  28. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  29. 2023SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inferencecited by 89
  30. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
  31. 2024BAKU: An Efficient Transformer for Multi-Task Policy Learningcited by 80
  32. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
  33. 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 72
  34. 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillingscited by 68
  35. 2023Contrastive Chain-of-Thought Promptingcited by 52
  36. 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Modelscited by 51
  37. 2023VCoder: Versatile Vision Encoders for Multimodal Large Language Modelscited by 42
  38. 2024Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasetscited by 23

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning
  2. 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Action
  3. 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
  4. 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
  5. 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
  6. 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space
  7. 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation
  8. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification