Does Imitation Learning Preserve Temporal Robustness in Dexterous Manipulation? An Expert-Learner Comparison Across Task Execution Speeds
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Dexterous manipulation policies learned by imitation are typically evaluated for robustness to variation in scenes, objects, or instructions, but their performance across task execution speeds is less often examined. This leaves open how much temporal robustness a learner retains relative to the expert it imitates. We compare an expert and learner under the same task conditions, initial-condition draws, and speedup factors. We instantiate the evaluation in ParcelStow, a contact-rich task in which the robot acquires, reorients, and inserts a parcel. The demonstrations span the speedup range for the manipulation phases after parcel acquisition. A scripted expert and an Action Chunking with Transformers (ACT) policy trained from the expert's demonstrations both achieve 100 percent task success at nominal speed. Their success rates diverge within the demonstrated range: at its maximum, expert success is 84 percent and ACT success is 53 percent. Two ACT policies with different parameter initializations show similar degradation, decreasing by 34 and 48 percentage points from nominal speed to the maximum demonstrated speed, compared with 16 points for the expert. Stage-level analysis shows that 35 of ACT's 47 failures at the maximum demonstrated speed are insertion misalignments. Under the relative-motion handoff, every ACT acquisition retains the parcel through reorientation and transfer in free space, but only 64 percent complete the overall task, compared with 95 percent after expert acquisition. Across all evaluated policies and speeds, none of the 414 acquisitions without force closure completes the task. Equal nominal task success therefore does not imply preservation of expert performance across execution speeds. Code, data, and evaluation scripts are available at https://github.com/coenwerem/parcelstow.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 43 of its 50 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
43 of 50 references.
Closest ancestors · 5
Same direction, newest first
- 2025SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies13 Jun
- 2025DemoSpeedup: Accelerating Visuomotor Policies via Entropy-Guided Demonstration Acceleration5 Jun
- 2024Instant Policy: In-Context Imitation Learning via Graph Diffusion19 Nov
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
- 2022Behavior Transformers: Cloning k modes with one stone22 Jun
Other references · 38
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 715
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2018Learning Dexterous In-Hand Manipulationcited by 687
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
26 more
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
- 2018Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approachcited by 120
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 48
- 2023DexPBT: Scaling up Dexterous Manipulation for Hand-Arm Systems with Population Based Trainingcited by 29
- 2024One-Shot Imitation under Mismatched Executioncited by 12
- 2024Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulationcited by 10
- 2025X-IL: Exploring the Design Space of Imitation Learning Policiescited by 10
- 2023FRoGGeR: Fast Robust Grasp Generation via the Min-Weight Metriccited by 8
- 2026PACE: Phase-Aware Chunk Execution for Robot Policies with Action Chunkingcited by 8
- 2026What Are We Actually Benchmarking in Robot Manipulation?cited by 7
- 2025SpeedAug: Policy Acceleration via Tempo-Enriched Policy and RL Fine-Tuningcited by 4
- 2026Grasp to Act: Dexterous Grasping for Tool Use in Dynamic Settingscited by 4
- 2026Variational Neural Belief Parameterizations for Robust Dexterous Grasping under Multimodal Uncertaintycited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flowscited by 1
- 2026FIRMGrasp: A Friction-Informed Risk Margin for Robust Grasp Synthesiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulation
- 2025Dexterous Manipulation through Imitation Learning: A Survey
- 2026The Curse of Precision: A Data Scaling Law for High-Precision Robotic Manipulation
- 2026DexPIE: Stable Dexterous Policy Improvement from Real-World Experience
- 2026It's Not Just More Demos: Counterfactual Action Sensitivity Coverage for Data-Efficient Robust Robot Imitation
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulation
- 2019Benchmark for Skill Learning from Demonstration: Impact of User Experience, Task Complexity, and Start Configuration on Performance
- 2026Beyond the Majority: Long-tail Imitation Learning for Robotic Manipulation