CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
While robot foundation models are growing increasingly capable, the strongest models are typically trained on proprietary data and remain closed-source, limiting downstream users' ability to adapt them to new tasks, embodiments, and deployment settings. Following the LLM community, an emerging access paradigm for closed-weight robot foundation models is the managed supervised fine-tuning (SFT) API, where users submit training data and receive a tuned policy without access to model weights, gradients, or training internals. While such APIs let downstream users leverage powerful proprietary foundation models, they restrict policy improvement to pure imitation, ruling out reinforcement learning and other closed-loop methods that rely on internal training signals. This limitation is particularly acute for agile, contact-rich humanoid manipulation, where the gap between policy outputs and deployed behavior is large due to novel states, action tracking dynamics, latency, and controller-specific failure modes. We study how effective this managed-API regime is for humanoid adaptation, and how closed-loop improvement can be realized within it to push policies toward task mastery. We conduct one of the first empirical studies of managed-API adaptation on a real humanoid, instantiated on Gemini Robotics On-Device (GROD). We find that direct SFT through the API substantially outperforms a leading open-weight VLA trained on the same demonstrations, yet still falls short of deployment-level mastery on agile, contact-rich tasks. To close this gap, we introduce CLIFT: Closed-Loop Iterative Fine-Tuning, which turns deployment-time reward feedback into API-compatible supervised data and enables closed-loop policy improvement without accessing weights, gradients, likelihoods, or losses-pushing GROD to near-perfect success after two flywheel cycles, all without "opening the model box."
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
18 of 24 references.
References · 18
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025DINOv3cited by 1,297
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 750
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2025Steering Your Diffusion Policy with Latent Space Reinforcement Learningcited by 149
- 2024Vision Language Models are In-Context Value Learnerscited by 84
- 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 72
- 2025Diffusion Guidance Is a Controllable Policy Improvement Operatorcited by 51
6 more
- 2025Robo-Dopamine: General Process Reward Modeling for High-Precision Robotic Manipulationcited by 37
- 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 25
- 2025Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulationcited by 22
- 2026Tune to Learn: How Controller Gains Shape Robot Policy Learningcited by 7
- 2024Maximizing Alignment with Minimal Feedback: Efficiently Learning Rewards for Visuomotor Robot Policy Alignmentcited by 6
- 2026Position: Good Embodied Reward Models Need Bad Behavior Datacited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Self-Improving Embodied Foundation Models
- 2026MetaWorld-X: Hierarchical World Modeling via VLM-Orchestrated Experts for Humanoid Loco-Manipulation
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation
- 2026Scaling Tasks, Not Samples: Mastering Humanoid Control through Multi-Task Model-Based Reinforcement Learning
- 2024Data-Efficient Approach to Humanoid Control via Fine-Tuning a Pre-Trained GPT on Action Data
- 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Control