Some Considerations on Learning to Explore via Meta-Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We consider the problem of exploration in meta reinforcement learning. Two new meta reinforcement learning algorithms are suggested: E-MAML and E-RL2. Results are presented on a novel environment we call `Krazy World' and a set of maze environments. We show E-MAML and E-RL2 deliver better performance on tasks where exploration is important.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 12; 2022: 8; 2023: 8; 2024: 6; 2025: 6; 2026: 3.
44 papers.
Sort:
By area:
- 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 138
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 123
- 2025Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thoughtcited by 109
- 2021A Survey of Exploration Methods in Reinforcement Learningcited by 73
- 2024Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Datacited by 63
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
- 2021Bootstrapped Meta-Learningcited by 45
- 2023AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agentscited by 41
- 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agentscited by 36
- 2022Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learningcited by 35
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Rewardcited by 28
- 2025Meta-RL Induces Exploration in Language Agentscited by 21
32 more
- 2024In-context Exploration-Exploitation for Reinforcement Learningcited by 16
- 2021CoMPS: Continual Meta Policy Searchcited by 15
- 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformerscited by 15
- 2021Context Meta-Reinforcement Learning via Neuromodulationcited by 11
- 2023Meta-Reinforcement Learning Based on Self-Supervised Task Representation Learningcited by 10
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learningcited by 9
- 2021Meta-Reinforcement Learning by Tracking Task Non-stationaritycited by 8
- 2021Hindsight Task Relabelling: Experience Replay for Sparse Reward Meta-RLcited by 8
- 2026Meta-Reinforcement Learning with Self-Reflection for Agentic Searchcited by 8
- 2021On the Practical Consistency of Meta-Reinforcement Learning Algorithmscited by 6
- 2021Unifying Gradient Estimators for Meta-Reinforcement Learning via Off-Policy Evaluationcited by 5
- 2022Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Taskscited by 5
- 2022An Investigation of the Bias-Variance Tradeoff in Meta-Gradientscited by 5
- 2021Hindsight Foresight Relabeling for Meta-Reinforcement Learningcited by 4
- 2023Meta-Reinforcement Learning via Exploratory Task Clusteringcited by 4
- 2023First-Explore, then Exploit: Meta-Learning to Solve Hard Exploration-Exploitation Trade-Offscited by 4
- 2022Variational Meta Reinforcement Learning for Social Roboticscited by 3
- 2022Meta Reinforcement Learning with Successor Feature Based Contextcited by 3
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparatorcited by 2
- 2022On the Convergence Theory of Meta Reinforcement Learning with Personalized Policiescited by 1
- 2022Enhanced Meta Reinforcement Learning using Demonstrations in Sparse Reward Environmentscited by 1
- 2023Meta Generative Flow Networks with Personalization for Task-Specific Adaptationcited by 1
- 2024Memory Sequence Length of Data Sampling Impacts the Adaptation of Meta-Reinforcement Learning Agentscited by 1
- 2024Black Box Meta-Learning Intrinsic Rewardscited by 1
- 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Reviewcited by 1
- 2026In-Context Reinforcement Learning under Non-Stationarity: A Surveycited by 1
- 2021Behaviour-conditioned policies for cooperative reinforcement learning taskscited by 0
- 2022Reusable Options through Gradient-based Meta Learningcited by 0
- 2023RL3: Boosting Meta Reinforcement Learning via RL inside RL2cited by 0
- 2025Adaptive Policy Backbone via Shared Networkcited by 0
- 2025An Information-Theoretic Analysis of OOD Generalization in Meta-Reinforcement Learningcited by 0
- 2026Connect the Dots: Training LLMs for Long-Lifecycle Agents with Cross-Domain Generalization Via Reinforcement Learningcited by 0
- 2026In-Context Reinforcement Learning under Non-Stationarity: A Survey1 Jul 2026
- 2026Connect the Dots: Training LLMs for Long-Lifecycle Agents with Cross-Domain Generalization Via Reinforcement Learning18 Jun 2026
- 2026Meta-Reinforcement Learning with Self-Reflection for Agentic Search11 Mar 2026
- 2025Meta-RL Induces Exploration in Language Agents18 Dec 2025
- 2025An Information-Theoretic Analysis of OOD Generalization in Meta-Reinforcement Learning27 Oct 2025
- 2025Adaptive Policy Backbone via Shared Network26 Sep 2025
- 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Review12 May 2025
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning10 Mar 2025
- 2025Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thought8 Jan 2025
- 2024Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Data10 Dec 2024
- 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers17 Nov 2024
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator13 Oct 2024
32 more
- 2024Black Box Meta-Learning Intrinsic Rewards31 Jul 2024
- 2024Memory Sequence Length of Data Sampling Impacts the Adaptation of Meta-Reinforcement Learning Agents18 Jun 2024
- 2024In-context Exploration-Exploitation for Reinforcement Learning11 Mar 2024
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX19 Dec 2023
- 2023AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents15 Oct 2023
- 2023First-Explore, then Exploit: Meta-Learning to Solve Hard Exploration-Exploitation Trade-Offs5 Jul 2023
- 2023RL3: Boosting Meta Reinforcement Learning via RL inside RL228 Jun 2023
- 2023Meta Generative Flow Networks with Personalization for Task-Specific Adaptation16 Jun 2023
- 2023Meta-Reinforcement Learning Based on Self-Supervised Task Representation Learning29 Apr 2023
- 2023Meta-Reinforcement Learning via Exploratory Task Clustering15 Feb 2023
- 2023Human-Timescale Adaptation in an Open-Ended Task Space18 Jan 2023
- 2022Reusable Options through Gradient-based Meta Learning22 Dec 2022
- 2022Enhanced Meta Reinforcement Learning using Demonstrations in Sparse Reward Environments26 Sep 2022
- 2022An Investigation of the Bias-Variance Tradeoff in Meta-Gradients22 Sep 2022
- 2022On the Convergence Theory of Meta Reinforcement Learning with Personalized Policies21 Sep 2022
- 2022Meta Reinforcement Learning with Successor Feature Based Context29 Jul 2022
- 2022Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks19 Jul 2022
- 2022Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learning21 Jun 2022
- 2022Variational Meta Reinforcement Learning for Social Robotics7 Jun 2022
- 2021CoMPS: Continual Meta Policy Search8 Dec 2021
- 2021Hindsight Task Relabelling: Experience Replay for Sparse Reward Meta-RL2 Dec 2021
- 2021On the Practical Consistency of Meta-Reinforcement Learning Algorithms1 Dec 2021
- 2021Context Meta-Reinforcement Learning via Neuromodulation30 Oct 2021
- 2021Behaviour-conditioned policies for cooperative reinforcement learning tasks4 Oct 2021
- 2021Hindsight Foresight Relabeling for Meta-Reinforcement Learning18 Sep 2021
- 2021Bootstrapped Meta-Learning9 Sep 2021
- 2021A Survey of Exploration Methods in Reinforcement Learning1 Sep 2021
- 2021Unifying Gradient Estimators for Meta-Reinforcement Learning via Off-Policy Evaluation24 Jun 2021
- 2021Meta-Reinforcement Learning by Tracking Task Non-stationarity18 May 2021
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning10 Mar 2021
- 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agents4 Feb 2021
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Reward7 Jun 2019
- 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformerscited by 15
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparatorcited by 2
- 2024Memory Sequence Length of Data Sampling Impacts the Adaptation of Meta-Reinforcement Learning Agentscited by 1
- 2024Black Box Meta-Learning Intrinsic Rewardscited by 1
- 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Reviewcited by 1
- 2026In-Context Reinforcement Learning under Non-Stationarity: A Surveycited by 1
- 2025Adaptive Policy Backbone via Shared Networkcited by 0
- 2025An Information-Theoretic Analysis of OOD Generalization in Meta-Reinforcement Learningcited by 0
- 2026In-Context Reinforcement Learning under Non-Stationarity: A Survey1 Jul 2026
- 2025An Information-Theoretic Analysis of OOD Generalization in Meta-Reinforcement Learning27 Oct 2025
- 2025Adaptive Policy Backbone via Shared Network26 Sep 2025
- 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Review12 May 2025
- 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers17 Nov 2024
- 2024Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator13 Oct 2024
- 2024Black Box Meta-Learning Intrinsic Rewards31 Jul 2024
- 2024Memory Sequence Length of Data Sampling Impacts the Adaptation of Meta-Reinforcement Learning Agents18 Jun 2024
- 2024Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Datacited by 63
- 2022Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learningcited by 35
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Rewardcited by 28
- 2024In-context Exploration-Exploitation for Reinforcement Learningcited by 16
- 2024Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Data10 Dec 2024
- 2024In-context Exploration-Exploitation for Reinforcement Learning11 Mar 2024
- 2022Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learning21 Jun 2022
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Reward7 Jun 2019
- 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 138
- 2021A Survey of Exploration Methods in Reinforcement Learningcited by 73
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
- 2021Bootstrapped Meta-Learningcited by 45
- 2023AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agentscited by 41
- 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agentscited by 36
- 2021CoMPS: Continual Meta Policy Searchcited by 15
- 2021Context Meta-Reinforcement Learning via Neuromodulationcited by 11
- 2023Meta-Reinforcement Learning Based on Self-Supervised Task Representation Learningcited by 10
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learningcited by 9
- 2021Meta-Reinforcement Learning by Tracking Task Non-stationaritycited by 8
- 2021Hindsight Task Relabelling: Experience Replay for Sparse Reward Meta-RLcited by 8
12 most cited of 27 All 27 (JSON)
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX19 Dec 2023
- 2023AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents15 Oct 2023
- 2023First-Explore, then Exploit: Meta-Learning to Solve Hard Exploration-Exploitation Trade-Offs5 Jul 2023
- 2023RL3: Boosting Meta Reinforcement Learning via RL inside RL228 Jun 2023
- 2023Meta Generative Flow Networks with Personalization for Task-Specific Adaptation16 Jun 2023
- 2023Meta-Reinforcement Learning Based on Self-Supervised Task Representation Learning29 Apr 2023
- 2023Meta-Reinforcement Learning via Exploratory Task Clustering15 Feb 2023
- 2023Human-Timescale Adaptation in an Open-Ended Task Space18 Jan 2023
- 2022Reusable Options through Gradient-based Meta Learning22 Dec 2022
- 2022Enhanced Meta Reinforcement Learning using Demonstrations in Sparse Reward Environments26 Sep 2022
- 2022An Investigation of the Bias-Variance Tradeoff in Meta-Gradients22 Sep 2022
- 2022On the Convergence Theory of Meta Reinforcement Learning with Personalized Policies21 Sep 2022
12 newest of 27 All 27 (JSON)