Continual Learning from Demonstration of Robotics Skills
On the map: Offline RL and imitation learning from data → Robot learning from demonstration
Abstract (arXiv)
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Robot learning from demonstration, one of 13 directions in Offline RL and imitation learning from data. Builds on 25 of its 47 references that are in the map. First posted on arXiv 14 Feb 2022.
Builds on
25 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2016Progressive Neural Networkscited by 1,332
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2016HyperNetworkscited by 1,003
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2019Continual learning with hypernetworkscited by 267
- 2018Don't forget, there is more than forgetting: new metrics for Continual Learningcited by 113
12 more
- 2020Learning Stable Deep Dynamics Modelscited by 110
- 2017Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstrationcited by 100
- 2018Learning unknown ODE models with Gaussian processescited by 54
- 2020Model-Based Inverse Reinforcement Learning from Visual Demonstrationscited by 52
- 2021Dynamic Movement Primitives in Robotics: A Tutorial Surveycited by 45
- 2020Continual Model-Based Reinforcement Learning with Hypernetworkscited by 41
- 2021Lifelong Robotic Reinforcement Learning by Retaining Experiencescited by 34
- 2020ImitationFlow: Learning Deep Stable Stochastic Dynamic Systems by Normalizing Flowscited by 33
- 2021CRIL: Continual Robot Imitation Learning via Generative and Prediction Modelcited by 23
- 2020Merging Position and Orientation Motion Primitivescited by 12
- 2021Ergodic imitation: Learning from what to do and what not to docited by 8
- 2020An Energy-based Approach to Ensure the Stability of Learned Dynamical Systemscited by 7
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 4; 2026: 1.
11 papers.
- 2025Robust Finetuning of Vision-Language-Action Robot Policies via Parameter Mergingcited by 19
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Modelcited by 6
- 2023Effect of Optimizer, Initializer, and Architecture of Hypernetworks on Continual Learning from Demonstrationcited by 2
- 2024Optimizing BioTac Simulation for Realistic Tactile Perceptioncited by 2
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1
- 2025Safe Continual Domain Adaptation after Sim2Real Transfer of Reinforcement Learning Policies in Roboticscited by 1
- 2023Evaluating Pretrained models for Deployable Lifelong Learningcited by 0
- 2024Imitation Learning-based Direct Visual Servoing using the Large Projection Formulationcited by 0
- 2025Monte Carlo Functional Regularisation for Continual Learningcited by 0
- 2025Stable Robot Motions on Manifolds: Learning Lyapunov-Constrained Neural Manifold ODEscited by 0
- 2026GaitSpan: Growing Humanoid Locomotion from Walking to Runningcited by 0
- 2026GaitSpan: Growing Humanoid Locomotion from Walking to Running13 Jul 2026
- 2025Robust Finetuning of Vision-Language-Action Robot Policies via Parameter Merging9 Dec 2025
- 2025Stable Robot Motions on Manifolds: Learning Lyapunov-Constrained Neural Manifold ODEs7 Oct 2025
- 2025Monte Carlo Functional Regularisation for Continual Learning18 Aug 2025
- 2025Safe Continual Domain Adaptation after Sim2Real Transfer of Reinforcement Learning Policies in Robotics13 Mar 2025
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation3 Oct 2024
- 2024Imitation Learning-based Direct Visual Servoing using the Large Projection Formulation13 Jun 2024
- 2024Optimizing BioTac Simulation for Realistic Tactile Perception16 Apr 2024
- 2023Effect of Optimizer, Initializer, and Architecture of Hypernetworks on Continual Learning from Demonstration31 Dec 2023
- 2023Evaluating Pretrained models for Deployable Lifelong Learning22 Nov 2023
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model6 Nov 2023
Similar, not cited
Close in wording, no citation either way
- 2018Auto-conditioned Recurrent Mixture Density Networks for Learning Generalizable Robot Skills
- 2021Similarity-Aware Skill Reproduction based on Multi-Representational Learning from Demonstration
- 2026Can Vision-Language-Action Models Learn from Real-World Data Continually without Forgetting?
- 2024Consistency Matters: Defining Demonstration Data Quality Metrics in Robot Learning from Demonstration
- 2023LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery
- 2022Learning and Extrapolation of Robotic Skills using Task-Parameterized Equation Learner Networks
- 2026World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays
- 2024Learning from Demonstration with Implicit Nonlinear Dynamics Models