GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Compared with relying solely on initial observations and language instructions, predicting goal images with generative models as high-level visual guidance can significantly enhance the robustness of Vision-Language-Action (VLA) models. However, most existing foundation models have not systematically incorporated goal image conditioning due to the high computational training cost. To this end, we propose Goal-Injected Fine-Tuning (GIFT), a lightweight and efficient fine-tuning framework that seamlessly integrates generated goal images into multiple representative pretrained VLA models. Our approach introduces goal image features into observations via a zero-initialized convolution which progressively grows parameters from zero and prevents harmful noise from disrupting the pretrained policy during fine-tuning. As training proceeds, goal information is gradually incorporated, enabling efficient goal understanding without disrupting model stability. We further introduce a refined image editing method to generate semantically and visually consistent goal images from initial observations and task instructions. Experiments show that goal-aware VLA models achieve substantial performance gains across tasks: with only a single epoch of fine-tuning, GIFT outperforms the base model by 6.0% and 13.4% on two SIMPLER settings, and by 4.7% on LIBERO, demonstrating both efficiency and effectiveness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 30 of its 36 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
30 of 36 references.
Closest ancestors · 1
Same direction, newest first
- 2025π*0.6: a VLA That Learns From Experience18 Nov
Other references · 29
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
17 more
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 269
- 2025Motus: A Unified Latent Action World Modelcited by 251
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 118
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 61
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulationcited by 43
- 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusioncited by 28
- 2024TurboEdit: Instant text-based image editingcited by 26
- 2025GraphCoT-VLA: A 3D Spatial-Aware Reasoning Vision-Language-Action Model for Robotic Manipulation with Ambiguous Instructionscited by 19
- 2024GHIL-Glue: Hierarchical Control with Filtered Subgoal Imagescited by 15
- 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulationcited by 15
- 2024Learning with Language-Guided State Abstractionscited by 11
- 2024Streamlining Image Editing with Layered Diffusion Brushescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation
- 2026What to Ignore, What to React: Visually Robust RL Fine-Tuning of VLA Models
- 2026TEMPO: Semantic-Action Decoupled RL Post-Training for Vision-Language-Action Models
- 2026Scaling World Model for Hierarchical Manipulation Policies
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
- 2026Offline Semantic Guidance for Efficient Vision-Language-Action Policy Distillation
- 2026Axiom-0: Hierarchical Self-Refinement for Vision-Language-Action Policies
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy