mlsanityData to 14 Oct 2026

XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX

arXiv 2312.12044 ↗First posted 19 Dec 2023cs.LGcited by 55

Not on the map. Why?

Cited by 35 in Deep reinforcement learning methods, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Inspired by the diversity and depth of XLand and the simplicity and minimalism of MiniGrid, we present XLand-MiniGrid, a suite of tools and grid-world environments for meta-reinforcement learning research. Written in JAX, XLand-MiniGrid is designed to be highly scalable and can potentially run on GPU or TPU accelerators, democratizing large-scale experimentation with limited resources. Along with the environments, XLand-MiniGrid provides pre-sampled benchmarks with millions of unique tasks of varying difficulty and easy-to-use baselines that allow users to quickly start training adaptive agents. In addition, we have conducted a preliminary analysis of scaling and generalization, showing that our baselines are capable of reaching millions of steps per second during training and validating that the proposed benchmarks are challenging. XLand-MiniGrid is open-source and available at https://github.com/dunnolab/xland-minigrid.

Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). Builds on 54 of its 71 references that are in the map. First posted on arXiv 19 Dec 2023.

Builds on

54 of 71 references.

References · 54

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2016OpenAI Gymcited by 1,736
  7. 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,427
  8. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  9. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
  10. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  11. 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 883
  12. 2017Deep Reinforcement Learning that Matterscited by 754
38 more
  1. 2019Large Batch Optimization for Deep Learning: Training BERT in 76 minutescited by 674
  2. 2016RL2: Fast Reinforcement Learning via Slow Reinforcement Learningcited by 503
  3. 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
  4. 2016Learning to reinforcement learncited by 377
  5. 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 327
  6. 2018Distributed Prioritized Experience Replaycited by 269
  7. 2019VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learningcited by 217
  8. 2021Benchmarking the Spectrum of Agent Capabilitiescited by 200
  9. 2022In-context Reinforcement Learning with Algorithm Distillationcited by 190
  10. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 182
  11. 2020What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Studycited by 162
  12. 2023Supervised Pretraining Can Learn In-Context Reinforcement Learningcited by 139
  13. 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 138
  14. 2023Revisiting the Minimalist Approach to Offline Reinforcement Learningcited by 126
  15. 2023Structured State Space Models for In-Context Reinforcement Learningcited by 111
  16. 2022Discovered Policy Optimisationcited by 104
  17. 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 93
  18. 2018A Dissection of Overfitting and Generalization in Continuous Reinforcement Learningcited by 87
  19. 2017Towards Generalization and Simplicity in Continuous Controlcited by 68
  20. 2023Learning to Model the World with Languagecited by 68
  21. 2022EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Enginecited by 62
  22. 2023Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAXcited by 58
  23. 2021Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learningcited by 45
  24. 2018Some Considerations on Learning to Explore via Meta-Reinforcement Learningcited by 44
  25. 2021The MineRL 2020 Competition on Sample Efficient Reinforcement Learning using Human Priorscited by 41
  26. 2018Accelerated Methods for Deep Reinforcement Learningcited by 40
  27. 2022History Compression via Language Models in Reinforcement Learningcited by 39
  28. 2021Podracer architectures for scalable Reinforcement Learningcited by 38
  29. 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agentscited by 36
  30. 2020BeBold: Exploration Beyond the Boundary of Explored Regionscited by 33
  31. 2020Griddly: A platform for AI research in gamescited by 31
  32. 2022Q-Ensemble for Offline RL: Don't Scale the Ensemble, Scale the Batch Sizecited by 21
  33. 2021Megaverse: Simulating Embodied Agents at One Million Experiences per Secondcited by 20
  34. 2021Large Batch Simulation for Deep Reinforcement Learningcited by 19
  35. 2022NovGrid: A Flexible Grid World for Evaluating Agent Response to Noveltycited by 14
  36. 2023JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for tradingcited by 14
  37. 2023minimax: Efficient Baselines for Autocurricula in JAXcited by 10
  38. 2022IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agentscited by 9

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 16; 2025: 24; 2026: 14.

55 papers.

Sort:

By area:

  1. 2024Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learningcited by 88
  2. 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 45
  3. 2025Meta-World+: An Improved, Standardized, RL Benchmarkcited by 43
  4. 2024No Regrets: Investigating and Improving Regret Approximations for Curriculum Discoverycited by 31
  5. 2023In-Context Reinforcement Learning for Variable Action Spacescited by 24
  6. 2025Learning to Reason at the Frontier of Learnabilitycited by 23
  7. 2024Retrieval-Augmented Decision Transformer: External Memory for In-context RLcited by 21
  8. 2024NAVIX: Scaling MiniGrid Environments with JAXcited by 18
  9. 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformerscited by 15
  10. 2024XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learningcited by 14
  11. 2024A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Taskscited by 14
  12. 2025Cross-environment Cooperation Enables Zero-shot Multi-agent Coordinationcited by 14
38 more
  1. 2025Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewritingcited by 13
  2. 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
  3. 2025Yes, Q-learning Helps Offline In-Context RLcited by 10
  4. 2025An Optimisation Framework for Unsupervised Environment Designcited by 10
  5. 2025Partially Observable Reinforcement Learning with Memory Tracescited by 9
  6. 2025SocialJax: An Evaluation Suite for Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 8
  7. 2025Zero-Shot Adaptation of Behavioral Foundation Models to Unseen Dynamicscited by 8
  8. 2025Mixture-of-Experts Meets In-Context Reinforcement Learningcited by 8
  9. 2024N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needscited by 7
  10. 2024Benchmarking General-Purpose In-Context Learningcited by 6
  11. 2025Octax: Accelerated CHIP-8 Arcade Environments for Reinforcement Learning in JAXcited by 5
  12. 2025ARM-FM: Automated Reward Machines via Foundation Models for Compositional Reinforcement Learningcited by 5
  13. 2025Towards Large-Scale In-Context Reinforcement Learning by Meta-Training in Randomized Worldscited by 4
  14. 2025Deep RL Needs Deep Behavior Analysis: Exploring Implicit Planning by Model-Free Agents in Open-Ended Environmentscited by 4
  15. 2025PuzzleJAX: A Benchmark for Reasoning and Learningcited by 4
  16. 2024ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learningcited by 3
  17. 2025The Yokai Learning Environment: Tracking Beliefs Over Space and Timecited by 3
  18. 2025gfnx: Fast and Scalable Library for Generative Flow Networks in JAXcited by 3
  19. 2025Staggered Environment Resets Improve Massively Parallel On-Policy Reinforcement Learningcited by 3
  20. 2026Preventing Learning Stagnation in PPO by Scaling to 1 Million Parallel Environmentscited by 3
  21. 2024RobocupGym: A challenging continuous control benchmark in Robocupcited by 2
  22. 2024Syllabus: Portable Curricula for Reinforcement Learning Agentscited by 2
  23. 2025Multi-Agent Craftax: Benchmarking Open-Ended Multi-Agent Reinforcement Learning at the Hyperscalecited by 2
  24. 2025Beyond Fixed Tasks: Unsupervised Environment Design for Task-Level Pairscited by 2
  25. 2026Temporal Representations for Exploration: Learning Complex Exploratory Behavior without Extrinsic Rewardscited by 2
  26. 2026Discovering Reinforcement Learning Interfaces with Large Language Modelscited by 2
  27. 2026CRAX: Fast Safe Reinforcement Learning Benchmarkingcited by 2
  28. 2024A Batch Sequential Halving Algorithm without Performance Degradationcited by 1
  29. 2025NiceWebRL: a Python library for human subject experiments with reinforcement learning environmentscited by 1
  30. 2024Massively Multiagent Minigames for Training Generalist Agentscited by 0
  31. 2025Thinking agents for zero-shot generalization to qualitatively novel taskscited by 0
  32. 2025PB2: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learningcited by 0
  33. 2025Chargax: A JAX Accelerated EV Charging Simulatorcited by 0
  34. 2026KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learningcited by 0
  35. 2026Unsupervised Learning of Efficient Exploration: Pre-training Adaptive Policies via Self-Imposed Goalscited by 0
  36. 2026TABX: A High-Throughput Sandbox Battle Simulator for Multi-Agent Reinforcement Learningcited by 0
  37. 2026Goal-Conditioned Agents that Learn Everything All at Oncecited by 0
  38. 2026Task diversity produces systematic transfer but inhibits continual reinforcement learningcited by 0

50 most cited of 55 All 55 (JSON)