One-Shot Robust Imitation Learning for Long-Horizon Visuomotor Tasks from Unsegmented Demonstrations
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
In contrast to single-skill tasks, long-horizon tasks play a crucial role in our daily life, e.g., a pouring task requires a proper concatenation of reaching, grasping and pouring subtasks. As an efficient solution for transferring human skills to robots, imitation learning has achieved great progress over the last two decades. However, when learning long-horizon visuomotor skills, imitation learning often demands a large amount of semantically segmented demonstrations. Moreover, the performance of imitation learning could be susceptible to external perturbation and visual occlusion. In this paper, we exploit dynamical movement primitives and meta-learning to provide a new framework for imitation learning, called Meta-Imitation Learning with Adaptive Dynamical Primitives (MiLa). MiLa allows for learning unsegmented long-horizon demonstrations and adapting to unseen tasks with a single demonstration. MiLa can also resist external disturbances and visual occlusion during task execution. Real-world robotic experiments demonstrate the superiority of MiLa, irrespective of visual occlusion and random perturbations on robots.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 18 of its 31 references that are in the map. First posted on arXiv 2 Oct 2024.
Builds on
18 of 31 references.
Closest ancestors · 7
Same direction, newest first
- 2024RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches5 Mar
- 2023XSkill: Cross Embodiment Skill Discovery19 Jul
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play24 Feb
- 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learning20 Oct
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrations13 Mar
- 2019Third-Person Visual Imitation Learning via Decoupled Hierarchical Controller21 Nov
- 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks25 Oct
Other references · 11
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2019Learning Latent Plans from Playcited by 310
- 2017One-Shot Imitation Learningcited by 232
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 225
- 2018One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learningcited by 146
- 2020Neural Dynamic Policies for End-to-End Sensorimotor Learningcited by 56
- 2021Dynamic Movement Primitives in Robotics: A Tutorial Surveycited by 45
- 2017Kernelized Movement Primitivescited by 37
- 2021Hierarchical Neural Dynamic Policiescited by 17
- 2024One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skillcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulation
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation
- 2021Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation
- 2022Transfering Hierarchical Structure with Dual Meta Imitation Learning
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learning
- 2024M2Distill: Multi-Modal Distillation for Lifelong Imitation Learning
- 2021Towards More Generalizable One-shot Visual Imitation Learning
- 2026AdaTempo: Learning Shared Relative Tempo from Demonstrations for Faster Robot Manipulation