Continual Reinforcement Learning deployed in Real-life using Policy Distillation and Sim2Real Transfer
Not on the map. Why?
Abstract (arXiv)
We focus on the problem of teaching a robot to solve tasks presented sequentially, i.e., in a continual learning scenario. The robot should be able to solve all tasks it has encountered, without forgetting past tasks. We provide preliminary work on applying Reinforcement Learning to such setting, on 2D navigation tasks for a 3 wheel omni-directional robot. Our approach takes advantage of state representation learning and policy distillation. Policies are trained using learned features as input, rather than raw observations, allowing better sample efficiency. Policy distillation is used to combine multiple policies into a single one that solves all encountered tasks.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 5; 2024: 5; 2025: 3; 2026: 1.
26 papers.
Sort:
By area:
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
- 2022Continual Learning with Foundation Models: An Empirical Study of Latent Replaycited by 61
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
- 2021Reinforcement Learning for Ridesharing: An Extended Surveycited by 35
- 2021Continuum: Simple Management of Complex Continual Learning Scenarioscited by 33
- 2021CRIL: Continual Robot Imitation Learning via Generative and Prediction Modelcited by 24
- 2025A Survey of Continual Reinforcement Learningcited by 18
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfercited by 12
- 2022Beyond Supervised Continual Learning: a Reviewcited by 11
- 2022Cyclic Policy Distillation: Sample-Efficient Sim-to-Real Reinforcement Learning with Domain Randomizationcited by 8
- 2024Continual Domain Randomizationcited by 8
14 more
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learningcited by 7
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learningcited by 7
- 2023A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Drivingcited by 7
- 2022Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agentscited by 3
- 2022On the Verge of Solving Rocket League using Deep Reinforcement Learning and Sim-to-sim Transfercited by 2
- 2023Vision-based DRL Autonomous Driving Agent with Sim2Real Transfercited by 2
- 2023Robust Navigation with Cross-Modal Fusion and Knowledge Transfercited by 2
- 2024Data-Driven Simulator for Mechanical Circulatory Support with Domain Adversarial Neural Processcited by 2
- 2025Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learningcited by 2
- 2021Offline RL With Resource Constrained Online Deploymentcited by 1
- 2023Using Curiosity for an Even Representation of Tasks in Continual Offline Reinforcement Learningcited by 1
- 2024Whisker-Inspired Tactile Sensing: A Sim2Real Approach for Precise Underwater Contact Trackingcited by 1
- 2025Learning more with the same effort: how randomization improves the robustness of a robotic deep reinforcement learning agentcited by 1
- 2026CIDER: Continual Interactive Distillation for Embodied Reinforcement Learningcited by 1
- 2026CIDER: Continual Interactive Distillation for Embodied Reinforcement Learning22 Aug 2026
- 2025A Survey of Continual Reinforcement Learning27 Jun 2025
- 2025Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learning24 May 2025
- 2025Learning more with the same effort: how randomization improves the robustness of a robotic deep reinforcement learning agent24 Jan 2025
- 2024Whisker-Inspired Tactile Sensing: A Sim2Real Approach for Precise Underwater Contact Tracking17 Oct 2024
- 2024Flow as the Cross-Domain Manipulation Interface21 Jul 2024
- 2024Data-Driven Simulator for Mechanical Circulatory Support with Domain Adversarial Neural Process28 May 2024
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer11 Apr 2024
- 2024Continual Domain Randomization18 Mar 2024
- 2023Using Curiosity for an Even Representation of Tasks in Continual Offline Reinforcement Learning5 Dec 2023
- 2023Robust Navigation with Cross-Modal Fusion and Knowledge Transfer23 Sep 2023
- 2023Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer19 May 2023
14 more
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulation2 May 2023
- 2023A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving14 Apr 2023
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learning31 Dec 2022
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representations13 Oct 2022
- 2022Beyond Supervised Continual Learning: a Review30 Aug 2022
- 2022Cyclic Policy Distillation: Sample-Efficient Sim-to-Real Reinforcement Learning with Domain Randomization29 Jul 2022
- 2022On the Verge of Solving Rocket League using Deep Reinforcement Learning and Sim-to-sim Transfer10 May 2022
- 2022Continual Learning with Foundation Models: An Empirical Study of Latent Replay30 Apr 2022
- 2022Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agents16 Mar 2022
- 2021Offline RL With Resource Constrained Online Deployment7 Oct 2021
- 2021CRIL: Continual Robot Imitation Learning via Generative and Prediction Model17 Jun 2021
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learning31 May 2021
- 2021Reinforcement Learning for Ridesharing: An Extended Survey3 May 2021
- 2021Continuum: Simple Management of Complex Continual Learning Scenarios11 Feb 2021
- 2025A Survey of Continual Reinforcement Learningcited by 18
- 2024Continual Domain Randomizationcited by 8
- 2025Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learningcited by 2
- 2025Learning more with the same effort: how randomization improves the robustness of a robotic deep reinforcement learning agentcited by 1
- 2026CIDER: Continual Interactive Distillation for Embodied Reinforcement Learningcited by 1
- 2026CIDER: Continual Interactive Distillation for Embodied Reinforcement Learning22 Aug 2026
- 2025A Survey of Continual Reinforcement Learning27 Jun 2025
- 2025Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learning24 May 2025
- 2025Learning more with the same effort: how randomization improves the robustness of a robotic deep reinforcement learning agent24 Jan 2025
- 2024Continual Domain Randomization18 Mar 2024
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
- 2022Continual Learning with Foundation Models: An Empirical Study of Latent Replaycited by 61
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
- 2021Reinforcement Learning for Ridesharing: An Extended Surveycited by 35
- 2021Continuum: Simple Management of Complex Continual Learning Scenarioscited by 33
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfercited by 12
- 2022Beyond Supervised Continual Learning: a Reviewcited by 11
- 2022Cyclic Policy Distillation: Sample-Efficient Sim-to-Real Reinforcement Learning with Domain Randomizationcited by 8
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learningcited by 7
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learningcited by 7
- 2022Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agentscited by 3
12 most cited of 15 All 15 (JSON)
- 2024Whisker-Inspired Tactile Sensing: A Sim2Real Approach for Precise Underwater Contact Tracking17 Oct 2024
- 2024Flow as the Cross-Domain Manipulation Interface21 Jul 2024
- 2024Data-Driven Simulator for Mechanical Circulatory Support with Domain Adversarial Neural Process28 May 2024
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer11 Apr 2024
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulation2 May 2023
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learning31 Dec 2022
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representations13 Oct 2022
- 2022Beyond Supervised Continual Learning: a Review30 Aug 2022
- 2022Cyclic Policy Distillation: Sample-Efficient Sim-to-Real Reinforcement Learning with Domain Randomization29 Jul 2022
- 2022On the Verge of Solving Rocket League using Deep Reinforcement Learning and Sim-to-sim Transfer10 May 2022
- 2022Continual Learning with Foundation Models: An Empirical Study of Latent Replay30 Apr 2022
- 2022Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agents16 Mar 2022
12 newest of 15 All 15 (JSON)