I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning also fits: Real-world robot offline RL
Abstract (arXiv)
Policies trained offline from teleoperated demonstrations can degrade outside their training distribution. This gap is particularly acute in long-horizon whole-body mobile manipulation, where long horizons amplify compounding errors and coordinated arm, torso, and base motion makes exhaustive demonstration coverage impractical. We introduce I3L, an integrated hardware and learning system that combines whole-body correction with iterative policy refinement to address this last-mile reliability gap. Its low-cost, open-source JoyLo+ interface uses policy-tracking leader arms and touch-triggered takeover to enable coordinated corrections across the body parts, while iterative deployment and retraining allow operators to target failures of the updated policy. We evaluate I3L across three robot embodiments and eight simulated and real-world tasks, including four long-horizon whole-body mobile manipulation tasks. Controlled simulation experiments show that four-round HG-DAgger achieves the highest final success on both tasks. Under this protocol, I3L improves autonomous success over the base policies by an average of 68.3 percentage points and achieves at least 90% success on every task, outperforming demonstration-only training by 35.6 percentage points on average with the same number of training trajectories. Averaged across tasks, takeover duration per episode decreases by 72% over four rounds. Together, these results show that I3L helps close the last-mile gap between offline training and reliable deployment and provides practical insights into collecting and using corrections for long-horizon whole-body mobile manipulation. Videos, visualizations, and appendix are at https://i-3l.github.io/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 56 of its 63 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
56 of 63 references.
Closest ancestors · 14
Same direction, newest first
- 2026Human-Robot Copilot for Data-Efficient Imitation Learning4 Apr
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulation10 Mar
- 2024TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot Learning11 Dec
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedback1 Jul
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learning24 Oct
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors20 Oct
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learning14 Oct
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb
- 2021LazyDAgger: Reducing Context Switching in Interactive Imitation Learning31 Mar
2 more
Other references · 42
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2018Group Normalizationcited by 1,524
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
30 more
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
- 2017DART: Noise Injection for Robust Imitation Learningcited by 191
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
- 2022Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deploymentcited by 108
- 2024UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllerscited by 75
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 66
- 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 63
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
- 2022Interactive Imitation Learning in Robotics: A Surveycited by 55
- 2023cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generationcited by 52
- 2024Multi-Task Interactive Robot Fleet Learning with Visual World Modelscited by 36
- 2024ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperationcited by 34
- 2025FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learningcited by 34
- 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activitiescited by 31
- 2024TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulationcited by 30
- 2025Compliant Residual DAgger: Improving Real-World Contact-Rich Manipulation with Human Correctionscited by 29
- 2026HoMMI: Learning Whole-Body Mobile Manipulation from Human Demonstrationscited by 16
- 2024BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulationcited by 14
- 2025HACTS: a Human-As-Copilot Teleoperation System for Robot Learningcited by 8
- 2026FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulationcited by 7
- 2026DexHiL: A Human-in-the-Loop Framework for Vision-Language-Action Model Post-Training in Dexterous Manipulationcited by 6
- 2026Universal Manipulation Exoskeleton: Learning Compliant Whole-body Policies with Real-time Torque Feedbackcited by 2
- 2026Scaling Bimanual Household Manipulation from 1,500 hours of Demonstrations to On-Policy Correctionscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HoMeR: Learning In-the-Wild Mobile Manipulation via Hybrid Imitation and Whole-Body Control
- 2023Plan-Guided Reinforcement Learning for Whole-Body Manipulation
- 2025A Framework for Deploying Learning-based Quadruped Loco-Manipulation ↗
- 2026Whole-Body Mobile Manipulation using Offline Reinforcement Learning on Sub-optimal Controllers
- 2025EMMA: Scaling Mobile Manipulation via Egocentric Human Data
- 2025Kinematics-Aware Diffusion Policy with Consistent 3D Observation and Action Space for Whole-Arm Robotic Manipulation
- 2026DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
- 2026DexRoam: Learning Mobile Bimanual Dexterous Manipulation from Egocentric Whole-Body Human Demonstrations ↗