Reinforcement Learning for Education: Opportunities and Challenges
Not on the map. Why?
Abstract (arXiv)
This survey article has grown out of the RL4ED workshop organized by the authors at the Educational Data Mining (EDM) 2021 conference. We organized this workshop as part of a community-building effort to bring together researchers and practitioners interested in the broad areas of reinforcement learning (RL) and education (ED). This article aims to provide an overview of the workshop activities and summarize the main research directions in the area of RL for ED.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 12 of its 54 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
12 of 54 references.
References · 12
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2020PCGRL: Procedural Content Generation via Reinforcement Learningcited by 90
- 2020Policy Teaching via Environment Poisoning: Training-time Adversarial Attacks against Reinforcement Learningcited by 81
- 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 79
- 2020Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 64
- 2018An Overview of Machine Teachingcited by 63
- 2018Deconfounding Reinforcement Learning in Observational Settingscited by 36
- 2021Adversarial Reinforcement Learning for Procedural Content Generationcited by 36
- 2019Interactive Teaching Algorithms for Inverse Reinforcement Learningcited by 24
- 2018Teaching Inverse Reinforcement Learners via Features and Demonstrationscited by 19
- 2020Synthesizing Tasks for Block-based Programmingcited by 19
- 2019Learner-aware Teaching: Inverse Reinforcement Learning with Preferences and Constraintscited by 18
Built on by
Citing papers per year: 2022: 8; 2023: 7; 2024: 5; 2025: 5.
25 papers.
Sort:
By area:
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problemscited by 231
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectorycited by 36
- 2023Near-Minimax-Optimal Risk-Sensitive Reinforcement Learning with CVaRcited by 32
- 2023The Generalization Gap in Offline Reinforcement Learningcited by 26
- 2022Future-Dependent Value-Based Off-Policy Evaluation in POMDPscited by 21
- 2023Neural Task Synthesis for Visual Programmingcited by 13
- 2023Boosting Offline Reinforcement Learning with Action Preference Querycited by 12
- 2022Learning to Learn: How to Continuously Teach Humans and Machinescited by 9
- 2022From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Taskscited by 8
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confoundingcited by 7
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineeringcited by 6
- 2024Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMscited by 4
13 more
- 2022Transfer Q-learningcited by 3
- 2024Return-Aligned Decision Transformercited by 3
- 2022Equity and Fairness of Bayesian Knowledge Tracingcited by 2
- 2022Offline Equilibrium Findingcited by 2
- 2025Personalized Learning Path Planning with Goal-Driven Learner State Modelingcited by 2
- 2025Evolutionary Reinforcement Learning based AI tutor for Socratic Interdisciplinary Instructioncited by 2
- 2023Synthesizing a Progression of Subtasks for Block-Based Visual Programming Taskscited by 1
- 2023PCGPT: Procedural Content Generation via Transformerscited by 1
- 2024To Switch or Not to Switch? Balanced Policy Switching in Offline Reinforcement Learningcited by 1
- 2024Auditing an Automatic Grading Model with deep Reinforcement Learningcited by 0
- 2025Learning to Optimize Feedback for One Million Students: Insights from Multi-Armed and Contextual Bandits in Large-Scale Online Tutoringcited by 0
- 2025Synthetic Data is Sufficient for Zero-Shot Visual Generalization from Offline Datacited by 0
- 2025Offline Clustering of Preference Learning with Active-data Augmentationcited by 0
- 2025Evolutionary Reinforcement Learning based AI tutor for Socratic Interdisciplinary Instruction12 Dec 2025
- 2025Offline Clustering of Preference Learning with Active-data Augmentation30 Oct 2025
- 2025Personalized Learning Path Planning with Goal-Driven Learner State Modeling15 Oct 2025
- 2025Synthetic Data is Sufficient for Zero-Shot Visual Generalization from Offline Data17 Aug 2025
- 2025Learning to Optimize Feedback for One Million Students: Insights from Multi-Armed and Contextual Bandits in Large-Scale Online Tutoring1 Aug 2025
- 2024To Switch or Not to Switch? Balanced Policy Switching in Offline Reinforcement Learning1 Jul 2024
- 2024Auditing an Automatic Grading Model with deep Reinforcement Learning11 May 2024
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineering6 May 2024
- 2024Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs29 Apr 2024
- 2024Return-Aligned Decision Transformer6 Feb 2024
- 2023The Generalization Gap in Offline Reinforcement Learning10 Dec 2023
- 2023PCGPT: Procedural Content Generation via Transformers3 Oct 2023
13 more
- 2023Boosting Offline Reinforcement Learning with Action Preference Query6 Jun 2023
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding1 Jun 2023
- 2023Synthesizing a Progression of Subtasks for Block-Based Visual Programming Tasks27 May 2023
- 2023Neural Task Synthesis for Visual Programming26 May 2023
- 2023Near-Minimax-Optimal Risk-Sensitive Reinforcement Learning with CVaR7 Feb 2023
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectory29 Dec 2022
- 2022Learning to Learn: How to Continuously Teach Humans and Machines28 Nov 2022
- 2022Future-Dependent Value-Based Off-Policy Evaluation in POMDPs26 Jul 2022
- 2022Offline Equilibrium Finding12 Jul 2022
- 2022Equity and Fairness of Bayesian Knowledge Tracing4 May 2022
- 2022From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Tasks3 May 2022
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problems2 Mar 2022
- 2022Transfer Q-learning9 Feb 2022
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problemscited by 231
- 2023The Generalization Gap in Offline Reinforcement Learningcited by 26
- 2023Boosting Offline Reinforcement Learning with Action Preference Querycited by 12
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confoundingcited by 7
- 2022Transfer Q-learningcited by 3
- 2024Return-Aligned Decision Transformercited by 3
- 2022Offline Equilibrium Findingcited by 2
- 2023PCGPT: Procedural Content Generation via Transformerscited by 1
- 2024To Switch or Not to Switch? Balanced Policy Switching in Offline Reinforcement Learningcited by 1
- 2025Synthetic Data is Sufficient for Zero-Shot Visual Generalization from Offline Datacited by 0
- 2025Synthetic Data is Sufficient for Zero-Shot Visual Generalization from Offline Data17 Aug 2025
- 2024To Switch or Not to Switch? Balanced Policy Switching in Offline Reinforcement Learning1 Jul 2024
- 2024Return-Aligned Decision Transformer6 Feb 2024
- 2023The Generalization Gap in Offline Reinforcement Learning10 Dec 2023
- 2023PCGPT: Procedural Content Generation via Transformers3 Oct 2023
- 2023Boosting Offline Reinforcement Learning with Action Preference Query6 Jun 2023
- 2023Delphic Offline Reinforcement Learning under Nonidentifiable Hidden Confounding1 Jun 2023
- 2022Offline Equilibrium Finding12 Jul 2022
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problems2 Mar 2022
- 2022Transfer Q-learning9 Feb 2022
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectorycited by 36
- 2023Near-Minimax-Optimal Risk-Sensitive Reinforcement Learning with CVaRcited by 32
- 2022Future-Dependent Value-Based Off-Policy Evaluation in POMDPscited by 21
- 2023Neural Task Synthesis for Visual Programmingcited by 13
- 2022Learning to Learn: How to Continuously Teach Humans and Machinescited by 9
- 2022From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Taskscited by 8
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineeringcited by 6
- 2022Equity and Fairness of Bayesian Knowledge Tracingcited by 2
- 2025Personalized Learning Path Planning with Goal-Driven Learner State Modelingcited by 2
- 2023Synthesizing a Progression of Subtasks for Block-Based Visual Programming Taskscited by 1
- 2025Learning to Optimize Feedback for One Million Students: Insights from Multi-Armed and Contextual Bandits in Large-Scale Online Tutoringcited by 0
- 2025Personalized Learning Path Planning with Goal-Driven Learner State Modeling15 Oct 2025
- 2025Learning to Optimize Feedback for One Million Students: Insights from Multi-Armed and Contextual Bandits in Large-Scale Online Tutoring1 Aug 2025
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineering6 May 2024
- 2023Synthesizing a Progression of Subtasks for Block-Based Visual Programming Tasks27 May 2023
- 2023Neural Task Synthesis for Visual Programming26 May 2023
- 2023Near-Minimax-Optimal Risk-Sensitive Reinforcement Learning with CVaR7 Feb 2023
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectory29 Dec 2022
- 2022Learning to Learn: How to Continuously Teach Humans and Machines28 Nov 2022
- 2022Future-Dependent Value-Based Off-Policy Evaluation in POMDPs26 Jul 2022
- 2022Equity and Fairness of Bayesian Knowledge Tracing4 May 2022
- 2022From {Solution Synthesis} to {Student Attempt Synthesis} for Block-Based Visual Programming Tasks3 May 2022