mlsanityData to 7 Oct 2026

Continual Learning from Demonstration of Robotics Skills

arXiv 2202.06843 ↗First posted 14 Feb 2022cs.RO cs.LGcited by 11

On the map: Offline RL and imitation learning from data → Robot learning from demonstration

Abstract (arXiv)

Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Robot learning from demonstration, one of 13 directions in Offline RL and imitation learning from data. Builds on 25 of its 47 references that are in the map. First posted on arXiv 14 Feb 2022.

Builds on

25 of 47 references.

Closest ancestors · 1

Same direction, newest first

  1. 2019Towards Orientation Learning and Adaptation in Cartesian Space9 Jul

Other references · 24

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  3. 2016Progressive Neural Networkscited by 1,332
  4. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  5. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  6. 2017Continual Learning with Deep Generative Replaycited by 1,152
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  8. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  9. 2016HyperNetworkscited by 1,003
  10. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  11. 2019Continual learning with hypernetworkscited by 267
  12. 2018Don't forget, there is more than forgetting: new metrics for Continual Learningcited by 113
12 more
  1. 2020Learning Stable Deep Dynamics Modelscited by 110
  2. 2017Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstrationcited by 100
  3. 2018Learning unknown ODE models with Gaussian processescited by 54
  4. 2020Model-Based Inverse Reinforcement Learning from Visual Demonstrationscited by 52
  5. 2021Dynamic Movement Primitives in Robotics: A Tutorial Surveycited by 45
  6. 2020Continual Model-Based Reinforcement Learning with Hypernetworkscited by 41
  7. 2021Lifelong Robotic Reinforcement Learning by Retaining Experiencescited by 34
  8. 2020ImitationFlow: Learning Deep Stable Stochastic Dynamic Systems by Normalizing Flowscited by 33
  9. 2021CRIL: Continual Robot Imitation Learning via Generative and Prediction Modelcited by 23
  10. 2020Merging Position and Orientation Motion Primitivescited by 12
  11. 2021Ergodic imitation: Learning from what to do and what not to docited by 8
  12. 2020An Energy-based Approach to Ensure the Stability of Learned Dynamical Systemscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 3; 2025: 4; 2026: 1.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2018Auto-conditioned Recurrent Mixture Density Networks for Learning Generalizable Robot Skills
  2. 2021Similarity-Aware Skill Reproduction based on Multi-Representational Learning from Demonstration
  3. 2026Can Vision-Language-Action Models Learn from Real-World Data Continually without Forgetting?
  4. 2024Consistency Matters: Defining Demonstration Data Quality Metrics in Robot Learning from Demonstration
  5. 2023LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery
  6. 2022Learning and Extrapolation of Robotic Skills using Task-Parameterized Equation Learner Networks
  7. 2026World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays
  8. 2024Learning from Demonstration with Implicit Nonlinear Dynamics Models