Learning Curriculum Policies for Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired to the target task. Automatically choosing a sequence of such tasks (i.e. a curriculum) is an open problem that has been the subject of much recent work in this area. In this paper, we build upon a recent method for curriculum design, which formulates the curriculum sequencing problem as a Markov Decision Process. We extend this model to handle multiple transfer learning algorithms, and show for the first time that a curriculum policy over this MDP can be learned from experience. We explore various representations that make this possible, and evaluate our approach by learning curriculum policies for multiple agents in two different domains. The results show that our method produces curricula that can train agents to perform on a target task as fast or faster than existing methods.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 7; 2022: 9; 2023: 6; 2024: 3; 2025: 4; 2026: 5.
35 papers.
Sort:
By area:
- 2021Curriculum Learning: A Surveycited by 259
- 2021Autonomous Reinforcement Learning via Subgoal Curriculacited by 33
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learningcited by 32
- 2021A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learningcited by 22
- 2023Proximal Curriculum for Reinforcement Learning Agentscited by 20
- 2021RLOps: Development Life-cycle of Reinforcement Learning Aided Open RANcited by 15
- 2022Robust Reinforcement Learning via Genetic Curriculumcited by 10
- 2023Cross-Episodic Curriculum for Transformer Agentscited by 10
- 2021Curriculum Design for Teaching via Demonstrations: Theory and Applicationscited by 9
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skillscited by 9
- 2022Relational Abstractions for Generalized Reinforcement Learning on Symbolic Problemscited by 7
- 2024Proximal Curriculum with Task Correlations for Deep Reinforcement Learningcited by 7
23 more
- 2022Learning to Transfer Role Assignment Across Team Sizescited by 5
- 2023Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learningcited by 4
- 2021Investigating Value of Curriculum Reinforcement Learning in Autonomous Driving Under Diverse Road and Weather Conditionscited by 3
- 2021Learning Multi-Objective Curricula for Robotic Policy Learningcited by 3
- 2022Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planningcited by 3
- 2025Heterogeneous Adversarial Play in Interactive Environmentscited by 3
- 2026ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuningcited by 3
- 2022Teacher-student curriculum learning for reinforcement learningcited by 2
- 2023A Comprehensive Study of Privacy Risks in Curriculum Learningcited by 2
- 2024Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansioncited by 2
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learningcited by 2
- 2025AURA: Autonomous Upskilling with Retrieval-Augmented Agentscited by 2
- 2022Reinforcement Teachingcited by 1
- 2022Multi-Phase Multi-Objective Dexterous Manipulation with Adaptive Hierarchical Curriculumcited by 1
- 2023Towards Transferring Tactile-based Continuous Force Control Policies from Simulation to Robotcited by 1
- 2024Direct Preference Optimization for Primitive-Enabled Hierarchical RL: A Bilevel Approachcited by 1
- 2025ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulationcited by 1
- 2020Interaction-limited Inverse Reinforcement Learningcited by 0
- 2022Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependenciescited by 0
- 2026Decoupling Task and Behavior: A Two-Stage Reward Curriculum in Reinforcement Learning for Roboticscited by 0
- 2026Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learningcited by 0
- 2026A Single Diffusion-Policy Controller for Multi-Task Block Pushing with Zero-Shot Sim-to-Real Transfercited by 0
- 2026Anticipating the Consequences of Curriculum Decisions with Large Language Modelscited by 0
- 2026Anticipating the Consequences of Curriculum Decisions with Large Language Models3 Oct 2026
- 2026A Single Diffusion-Policy Controller for Multi-Task Block Pushing with Zero-Shot Sim-to-Real Transfer12 Jul 2026
- 2026ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning9 Apr 2026
- 2026Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learning19 Mar 2026
- 2026Decoupling Task and Behavior: A Two-Stage Reward Curriculum in Reinforcement Learning for Robotics5 Mar 2026
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025AURA: Autonomous Upskilling with Retrieval-Augmented Agents3 Jun 2025
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learning2 Apr 2025
- 2025ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulation11 Mar 2025
- 2024Direct Preference Optimization for Primitive-Enabled Hierarchical RL: A Bilevel Approach1 Nov 2024
- 2024Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion19 Aug 2024
- 2024Proximal Curriculum with Task Correlations for Deep Reinforcement Learning3 May 2024
23 more
- 2023Towards Transferring Tactile-based Continuous Force Control Policies from Simulation to Robot13 Nov 2023
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skills30 Oct 2023
- 2023A Comprehensive Study of Privacy Risks in Curriculum Learning16 Oct 2023
- 2023Cross-Episodic Curriculum for Transformer Agents12 Oct 2023
- 2023Proximal Curriculum for Reinforcement Learning Agents25 Apr 2023
- 2023Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learning7 Feb 2023
- 2022Teacher-student curriculum learning for reinforcement learning31 Oct 2022
- 2022Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planning28 Jun 2022
- 2022Multi-Phase Multi-Objective Dexterous Manipulation with Adaptive Hierarchical Curriculum26 May 2022
- 2022Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependencies16 May 2022
- 2022Relational Abstractions for Generalized Reinforcement Learning on Symbolic Problems27 Apr 2022
- 2022Reinforcement Teaching25 Apr 2022
- 2022Learning to Transfer Role Assignment Across Team Sizes17 Apr 2022
- 2022Robust Reinforcement Learning via Genetic Curriculum17 Feb 2022
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learning21 Jan 2022
- 2021RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN12 Nov 2021
- 2021Learning Multi-Objective Curricula for Robotic Policy Learning6 Oct 2021
- 2021Autonomous Reinforcement Learning via Subgoal Curricula27 Jul 2021
- 2021Curriculum Design for Teaching via Demonstrations: Theory and Applications8 Jun 2021
- 2021Investigating Value of Curriculum Reinforcement Learning in Autonomous Driving Under Diverse Road and Weather Conditions14 Mar 2021
- 2021A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learning25 Feb 2021
- 2021Curriculum Learning: A Survey25 Jan 2021
- 2020Interaction-limited Inverse Reinforcement Learning1 Jul 2020
- 2021Curriculum Learning: A Surveycited by 259
- 2021Autonomous Reinforcement Learning via Subgoal Curriculacited by 33
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learningcited by 32
- 2021A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learningcited by 22
- 2023Proximal Curriculum for Reinforcement Learning Agentscited by 20
- 2021RLOps: Development Life-cycle of Reinforcement Learning Aided Open RANcited by 15
- 2022Robust Reinforcement Learning via Genetic Curriculumcited by 10
- 2023Cross-Episodic Curriculum for Transformer Agentscited by 10
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skillscited by 9
- 2022Relational Abstractions for Generalized Reinforcement Learning on Symbolic Problemscited by 7
- 2022Learning to Transfer Role Assignment Across Team Sizescited by 5
- 2023Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learningcited by 4
12 most cited of 23 All 23 (JSON)
- 2026Anticipating the Consequences of Curriculum Decisions with Large Language Models3 Oct 2026
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulation11 Mar 2025
- 2024Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion19 Aug 2024
- 2023Towards Transferring Tactile-based Continuous Force Control Policies from Simulation to Robot13 Nov 2023
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skills30 Oct 2023
- 2023A Comprehensive Study of Privacy Risks in Curriculum Learning16 Oct 2023
- 2023Cross-Episodic Curriculum for Transformer Agents12 Oct 2023
- 2023Proximal Curriculum for Reinforcement Learning Agents25 Apr 2023
- 2023Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learning7 Feb 2023
- 2022Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planning28 Jun 2022
- 2022Multi-Phase Multi-Objective Dexterous Manipulation with Adaptive Hierarchical Curriculum26 May 2022
12 newest of 23 All 23 (JSON)