mlsanityData to 14 Oct 2026

Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks

arXiv 2306.13831 ↗First posted 24 Jun 2023cs.LGcited by 327

Not on the map. Why?

Cited by 160 in Deep reinforcement learning methods, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present the Minigrid and Miniworld libraries which provide a suite of goal-oriented 2D and 3D environments. The libraries were explicitly created with a minimalistic design paradigm to allow users to rapidly develop new environments for a wide range of research-specific needs. As a result, both have received widescale adoption by the RL community, facilitating research in a wide range of areas. In this paper, we outline the design philosophy, environment details, and their world generation API. We also showcase the additional capabilities brought by the unified API between Minigrid and Miniworld through case studies on transfer learning (for both RL agents and humans) between the different observation spaces. The source code of Minigrid and Miniworld can be found at https://github.com/Farama-Foundation/{Minigrid, Miniworld} along with their documentation at https://{minigrid, miniworld}.farama.org/.

Key facts. Cited by 327 papers in the map (data through 14 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 24 Jun 2023.

Builds on

31 of 39 references.

References · 31

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  4. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  5. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
  6. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  7. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  8. 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 384
  9. 2020dm_control: Software and Tasks for Continuous Controlcited by 375
  10. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  11. 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 245
  12. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
19 more
  1. 2018Unity: A General Platform for Intelligent Agentscited by 236
  2. 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 215
  3. 2021Benchmarking the Spectrum of Agent Capabilitiescited by 200
  4. 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 179
  5. 2022Evolving Curricula with Regret-Based Environment Designcited by 173
  6. 2021State Entropy Maximization with Random Encoders for Efficient Explorationcited by 108
  7. 2019Generalization in Reinforcement Learning with Selective Noise Injection and Information Bottleneckcited by 101
  8. 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 99
  9. 2020Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without Sacrificescited by 59
  10. 2020Griddly: A platform for AI research in gamescited by 31
  11. 2021How to Stay Curious while Avoiding Noisy TVs using Aleatoric Uncertainty Estimationcited by 27
  12. 2021A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learningcited by 27
  13. 2021Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domainscited by 18
  14. 2022Avalon: A Benchmark for RL Generalization Using Procedurally Generated Worldscited by 17
  15. 2020Information-theoretic Task Selection for Meta-Reinforcement Learningcited by 10
  16. 2021Safe Policy Optimization with Local Generalized Linear Function Approximationscited by 10
  17. 2022A Hierarchical Bayesian Approach to Inverse Reinforcement Learning with Symbolic Reward Machinescited by 9
  18. 2015MazeBase: A Sandbox for Learning from Gamescited by 4
  19. 2020Pre-trained Word Embeddings for Goal-conditional Transfer Learning in Reinforcement Learningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 18; 2024: 93; 2025: 110; 2026: 106.

327 papers.

Sort:

By area:

  1. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environmentcited by 107
  2. 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
  3. 2024Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learningcited by 88
  4. 2023Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraftcited by 61
  5. 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
  6. 2024Bridging State and History Representations: Understanding Self-Predictive RLcited by 54
  7. 2023Multi-Task Reinforcement Learning with Mixture of Orthogonal Expertscited by 49
  8. 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agentscited by 46
  9. 2024Gymnasium: A Standard Interface for Reinforcement Learning Environmentscited by 46
  10. 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 45
  11. 2024Code as Reward: Empowering Reinforcement Learning with VLMscited by 39
  12. 2024No Regrets: Investigating and Improving Regret Approximations for Curriculum Discoverycited by 31
38 more
  1. 2023Large Language Model as a Policy Teacher for Training Reinforcement Learning Agentscited by 30
  2. 2024Closing the Gap between TD Learning and Supervised Learning -- A Generalisation Point of Viewcited by 27
  3. 2025A Comprehensive Survey on Multi-Agent Cooperative Decision-Making: Scenarios, Approaches, Challenges and Perspectivescited by 27
  4. 2025Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agentscited by 24
  5. 2023Mini-BEHAVIOR: A Procedurally Generated Benchmark for Long-horizon Decision-Making in Embodied AIcited by 23
  6. 2025Learning to Reason at the Frontier of Learnabilitycited by 23
  7. 2025Continuous Thought Machinescited by 22
  8. 2024Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedbackcited by 21
  9. 2024Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agentcited by 21
  10. 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 20
  11. 2025Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspectivecited by 20
  12. 2023Selective Visual Representations Improve Convergence and Generalization for Embodied AIcited by 19
  13. 2025StateSpaceDiffuser: Bringing Long Context to Diffusion World Modelscited by 19
  14. 2024Discovering Temporally-Aware Reinforcement Learning Algorithmscited by 18
  15. 2024NAVIX: Scaling MiniGrid Environments with JAXcited by 18
  16. 2025A Survey of Continual Reinforcement Learningcited by 18
  17. 2024Open RL Benchmark: Comprehensive Tracked Experiments for Reinforcement Learningcited by 17
  18. 2025Episodic Novelty Through Temporal Distancecited by 16
  19. 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformerscited by 15
  20. 2024XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learningcited by 14
  21. 2024Can Learned Optimization Make Reinforcement Learning Less Difficult?cited by 14
  22. 2025Synthesizing world models for bilevel planningcited by 14
  23. 2025LLM-Guided Probabilistic Program Induction for POMDP Model Estimationcited by 12
  24. 2023Harnessing Discrete Representations For Continual Reinforcement Learningcited by 11
  25. 2024JaxUED: A simple and useable UED library in Jaxcited by 11
  26. 2024Reward Machines for Deep RL in Noisy and Uncertain Environmentscited by 11
  27. 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
  28. 2025A Snapshot of Influence: A Local Data Attribution Framework for Online Reinforcement Learningcited by 11
  29. 2024Towards Principled Representation Learning from Videos for Reinforcement Learningcited by 10
  30. 2024RLeXplore: Accelerating Research in Intrinsically-Motivated Reinforcement Learningcited by 10
  31. 2024Baba Is AI: Break the Rules to Beat the Benchmarkcited by 10
  32. 2024Adversarial Environment Design via Regret-Guided Diffusion Modelscited by 10
  33. 2024Learning Successor Features the Simple Waycited by 10
  34. 2025From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Taskcited by 10
  35. 2025Expected Free Energy-based Planning as Variational Inferencecited by 10
  36. 2025An Optimisation Framework for Unsupervised Environment Designcited by 10
  37. 2025One Life to Learn: Inferring Symbolic World Models for Stochastic Environments from Unguided Explorationcited by 10
  38. 2023Exploitation-Guided Exploration for Semantic Embodied Navigationcited by 9

50 most cited of 327 All 327 (JSON)