mlsanityData to 14 Oct 2026

Gotta Learn Fast: A New Benchmark for Generalization in RL

arXiv 1804.03720 ↗First posted 10 Apr 2018cs.LG stat.MLcited by 59

Not on the map. Why?

Abstract (arXiv)

In this report, we present a new reinforcement learning (RL) benchmark based on the Sonic the Hedgehog (TM) video game franchise. This benchmark is intended to measure the performance of transfer learning and few-shot learning algorithms in the RL domain. We also present and evaluate some baseline algorithms on the new benchmark.

Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 24; 2022: 10; 2023: 7; 2024: 8; 2025: 8; 2026: 2.

59 papers.

Sort:

By area:

  1. 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 114
  2. 2021Why Generalization in RL is Difficult: Epistemic POMDPs and Implicit Partial Observabilitycited by 109
  3. 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Researchcited by 97
  4. 2021Decoupling Value and Policy for Generalization in Reinforcement Learningcited by 82
  5. 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
  6. 2022Atari-5: Distilling the Arcade Learning Environment down to Five Gamescited by 44
  7. 2021The MineRL 2020 Competition on Sample Efficient Reinforcement Learning using Human Priorscited by 41
  8. 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agentscited by 36
  9. 2021Procedural Generalization by Planning with Self-Supervised World Modelscited by 31
  10. 2023On the Importance of Exploration for Generalization in Reinforcement Learningcited by 31
  11. 2021Core Challenges in Embodied Vision-Language Planningcited by 30
  12. 2021Rank the Episodes: A Simple Approach for Exploration in Procedurally-Generated Environmentscited by 28
38 more
  1. 2021How to Stay Curious while Avoiding Noisy TVs using Aleatoric Uncertainty Estimationcited by 27
  2. 2023The Generalization Gap in Offline Reinforcement Learningcited by 26
  3. 2021Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen Benchmarkcited by 23
  4. 2021When Is Generalizable Reinforcement Learning Tractable?cited by 20
  5. 2021TeachMyAgent: a Benchmark for Automatic Curriculum Learning in Deep RLcited by 18
  6. 2021The Neural MMO Platform for Massively Multiagent Researchcited by 17
  7. 2025Horizon Generalization in Reinforcement Learningcited by 17
  8. 2022Towards Understanding How Machines Can Learn Causal Overhypothesescited by 14
  9. 2024FightLadder: A Benchmark for Competitive Multi-Agent Reinforcement Learningcited by 13
  10. 2024HackAtari: Atari Learning Environments for Robust and Continual Reinforcement Learningcited by 11
  11. 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
  12. 2021Fast and Data-Efficient Training of Rainbow: an Experimental Study on Ataricited by 10
  13. 2022Local Feature Swapping for Generalization in Reinforcement Learningcited by 9
  14. 2023ContraBAR: Contrastive Bayes-Adaptive Deep RLcited by 9
  15. 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
  16. 2022On the Generalization and Adaption Performance of Causal Modelscited by 8
  17. 2022Learning Causal Overhypotheses through Exploration in Children and Computational Modelscited by 7
  18. 2022Goal-Aware Generative Adversarial Imitation Learning from Imperfect Demonstration for Robotic Cloth Manipulationcited by 7
  19. 2024Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inferencecited by 7
  20. 2021Transfer of Fully Convolutional Policy-Value Networks Between Games and Game Variantscited by 6
  21. 2021Scenic4RL: Programmatic Modeling and Generation of Reinforcement Learning Environmentscited by 6
  22. 2021Lifetime policy reuse and the importance of task capacitycited by 4
  23. 2022The Game of Hidden Rules: A New Kind of Benchmark Challenge for Machine Learningcited by 4
  24. 2022DIAMBRA Arena: a New Reinforcement Learning Platform for Research and Experimentationcited by 4
  25. 2025Imagined Autocurriculacited by 4
  26. 2021rl_reach: Reproducible Reinforcement Learning Experiments for Robotic Reaching Taskscited by 3
  27. 2021Extending Environments To Measure Self-Reflection In Reinforcement Learningcited by 3
  28. 2025Provable Zero-Shot Generalization in Offline Reinforcement Learningcited by 3
  29. 2026Odysseus: Scaling VLMs to 100+ Turn Decision-Making in Games via Reinforcement Learningcited by 3
  30. 2021Towards robust and domain agnostic reinforcement learning competitionscited by 2
  31. 2023Adversarial Style Transfer for Robust Policy Optimization in Deep Reinforcement Learningcited by 2
  32. 2024RRLS : Robust Reinforcement Learning Suitecited by 2
  33. 2025A Conceptual Framework for AI-based Decision Systems in Critical Infrastructurescited by 2
  34. 2021Sparse Attention Guided Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement Learningcited by 1
  35. 2024AMaze: An intuitive benchmark generator for fast prototyping of generalizable agentscited by 1
  36. 2025State Combinatorial Generalization In Decision Making With Conditional Diffusion Modelscited by 1
  37. 2025Robust Agents in Open-Ended Worldscited by 1
  38. 2021Meta Arcade: A Configurable Environment Suite for Meta-Learningcited by 0

50 most cited of 59 All 59 (JSON)