Quantifying Generalisation in Imitation Learning
On the map: Offline RL and imitation learning from data → Imitation learning methods
Abstract (arXiv)
Imitation learning benchmarks often lack sufficient variation between training and evaluation, limiting meaningful generalisation assessment. We introduce Labyrinth, a benchmarking environment designed to test generalisation with precise control over structure, start and goal positions, and task complexity. It enables verifiably distinct training, evaluation, and test settings. Labyrinth provides a discrete, fully observable state space and known optimal actions, supporting interpretability and fine-grained evaluation. Its flexible setup allows targeted testing of generalisation factors and includes variants like partial observability, key-and-door tasks, and ice-floor hazards. By enabling controlled, reproducible experiments, Labyrinth advances the evaluation of generalisation in imitation learning and provides a valuable tool for developing more robust agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 18 of its 29 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
18 of 29 references.
Closest ancestors · 6
Same direction, newest first
- 2024Explorative Imitation Learning: A Path Signature Approach for Continuous Environments5 Jul
- 2024Imitation Learning Datasets: A Toolkit For Creating Datasets, Training Agents and Benchmarking1 Mar
- 2023MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations30 Mar
- 2021Off-Policy Imitation Learning from Observations25 Feb
- 2020Imitating Unknown Policies via Exploration13 Aug
- 2018Behavioral Cloning from Observation4 May
Other references · 12
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2016Generative Adversarial Imitation Learningcited by 1,597
- 2018DeepMind Control Suitecited by 956
- 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
- 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 327
- 2021Benchmarking the Spectrum of Agent Capabilitiescited by 200
- 2018Playing hard exploration games by watching YouTubecited by 99
- 2025Meta-World+: An Improved, Standardized, RL Benchmarkcited by 43
- 2023Is Imitation All You Need? Generalized Decision-Making with Dual-Phase Trainingcited by 18
- 2024DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learningcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Generalization Capability for Imitation Learning
- 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulation
- 2020The MAGICAL Benchmark for Robust Imitation
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrations
- 2025Imitation Learning in the Deep Learning Era: A Novel Taxonomy and Recent Advances
- 2026Beyond Mimicry: Toward Lifelong Adaptability in Imitation Learning
- 2021Imitation Learning: Progress, Taxonomies and Challenges
- 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations