mlsanityData to 14 Oct 2026

RoboPocket: Improve Robot Policies Instantly with Your Phone

arXiv 2603.05504 ↗First posted 5 Mar 2026cs.RO cs.AI cs.LGcited by 4

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

Scaling imitation learning is fundamentally constrained by the efficiency of data collection. While handheld interfaces have emerged as a scalable solution for in-the-wild data acquisition, they predominantly operate in an open-loop manner: operators blindly collect demonstrations without knowing the underlying policy's weaknesses, leading to inefficient coverage of critical state distributions. Conversely, interactive methods like DAgger effectively address covariate shift but rely on physical robot execution, which is costly and difficult to scale. To reconcile this trade-off, we introduce RoboPocket, a portable system that enables Robot-Free Instant Policy Iteration using single consumer smartphones. Its core innovation is a Remote Inference framework that visualizes the policy's predicted trajectory via Augmented Reality (AR) Visual Foresight. This immersive feedback allows collectors to proactively identify potential failures and focus data collection on the policy's weak regions without requiring a physical robot. Furthermore, we implement an asynchronous Online Finetuning pipeline that continuously updates the policy with incoming data, effectively closing the learning loop in minutes. Extensive experiments demonstrate that RoboPocket adheres to data scaling laws and doubles the data efficiency compared to offline scaling strategies, overcoming their long-standing efficiency bottleneck. Moreover, our instant iteration loop also boosts sample efficiency by up to 2× in distributed environments a small number of interactive corrections per person. Project page and videos: https://robo-pocket.github.io.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 45 of its 51 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

45 of 51 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons5 Mar
  2. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation4 Mar
  3. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation24 Oct
  4. 2024ARCap: Collecting High-quality Human Demonstrations for Robot Learning with Augmented Reality Feedback11 Oct
  5. 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation10 Oct
  6. 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning3 Jul
  7. 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedback1 Jul
  8. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
  9. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan
  10. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
  12. 2020Human-in-the-Loop Imitation Learning using Remote Teleoperation12 Dec
1 more
  1. 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation7 Nov

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  6. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  7. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
  8. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  9. 2020AWAC: Accelerating Online Reinforcement Learning with Offline Datasetscited by 671
  10. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
  11. 2023Efficient Online Reinforcement Learning with Offline Datacited by 363
  12. 2025π*0.6: a VLA That Learns From Experiencecited by 303
20 more
  1. 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
  2. 2023Cal-QL: Calibrated Offline RL Pre-Training for Efficient Online Fine-Tuningcited by 237
  3. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
  4. 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 136
  5. 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
  6. 2022Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deploymentcited by 108
  7. 2023On Bringing Robots Homecited by 101
  8. 2018EnsembleDAgger: A Bayesian Approach to Safe Imitation Learningcited by 100
  9. 2017Uncertainty-Aware Reinforcement Learning for Collision Avoidancecited by 88
  10. 2016Query-Efficient Imitation Learning for End-to-End Autonomous Drivingcited by 84
  11. 2018Shared Autonomy via Deep Reinforcement Learningcited by 66
  12. 2025RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learningcited by 59
  13. 2023AirExo: Low-Cost Exoskeletons for Learning Whole-Arm Manipulation in the Wildcited by 47
  14. 2024FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Datasetcited by 40
  15. 2023Model-Based Runtime Monitoring with Interactive Imitation Learningcited by 38
  16. 2026SOP: A Scalable Online Post-Training System for Vision-Language-Action Modelscited by 21
  17. 2025DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulationcited by 19
  18. 2021Corrective Shared Autonomy for Addressing Task Variabilitycited by 5
  19. 2021Visualizing Robot Intent for Object Handovers with Augmented Realitycited by 3
  20. 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesis
  2. 2026RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data
  3. 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvement
  4. 2026WorldToken: Time-First Sequence Modeling for Robotic Imitation Learning
  5. 2025Control Your Robot: A Unified System for Robot Control and Policy Deployment ↗
  6. 2026RoboPrompt: Intuitive Robot Policy Steering with Sparse Human Input
  7. 2024So You Think You Can Scale Up Autonomous Robot Data Collection?
  8. 2024VITAL: Interactive Few-Shot Imitation Learning via Visual Human-in-the-Loop Corrections