Illuminating Mario Scenes in the Latent Space of a Generative Adversarial Network
Not on the map. Why?
Abstract (arXiv)
Generative adversarial networks (GANs) are quickly becoming a ubiquitous approach to procedurally generating video game levels. While GAN generated levels are stylistically similar to human-authored examples, human designers often want to explore the generative design space of GANs to extract interesting levels. However, human designers find latent vectors opaque and would rather explore along dimensions the designer specifies, such as number of enemies or obstacles. We propose using state-of-the-art quality diversity algorithms designed to optimize continuous spaces, i.e. MAP-Elites with a directional variation operator and Covariance Matrix Adaptation MAP-Elites, to efficiently explore the latent space of a GAN to extract levels that vary across a set of specified gameplay measures. In the benchmark domain of Super Mario Bros, we demonstrate how designers may specify gameplay measures to our system and extract high-quality (playable) levels with a diverse range of level mechanics, while still maintaining stylistic similarity to human authored examples. An online user study shows how the different mechanics of the automatically generated levels affect subjective ratings of their perceived difficulty and appearance.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 10; 2023: 16; 2024: 6; 2025: 5; 2026: 6.
51 papers.
Sort:
By area:
- 2021Differentiable Quality Diversitycited by 71
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2021On the Importance of Environments in Human-Robot Coordinationcited by 37
- 2021Illuminating Diverse Neural Cellular Automata for Level Generationcited by 35
- 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Modelscited by 31
- 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimizationcited by 29
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2022Covariance Matrix Adaptation MAP-Annealingcited by 24
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousingcited by 17
- 2021Illuminating the Space of Beatable Lode Runner Levels Produced By Various Generative Adversarial Networkscited by 14
38 more
- 2022Accelerated Quality-Diversity through Massive Parallelismcited by 14
- 2022Heterogeneous Multi-agent Zero-Shot Coordination by Coevolutioncited by 12
- 2022Benchmarking Quality-Diversity Algorithms on Neuroevolution for Reinforcement Learningcited by 10
- 2023Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimizationcited by 10
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automatacited by 9
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarioscited by 8
- 2025Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Modelscited by 8
- 2022Learning to Walk Autonomously via Reset-Free Quality-Diversitycited by 7
- 2023Diversity from Human Feedbackcited by 5
- 2024Measuring Diversity of Game Scenarioscited by 5
- 2023Evolving Flying Machines in Minecraft Using Quality Diversitycited by 4
- 2023Gradient-Informed Quality Diversity for the Illumination of Discrete Spacescited by 4
- 2023Quality-Diversity Generative Sampling for Learning with Synthetic Datacited by 4
- 2021Using Multiple Generative Adversarial Networks to Build Better-Connected Levels for Mega Mancited by 3
- 2021Fast Game Content Adaptation Through Bayesian-based Player Modellingcited by 3
- 2022Tackling Neural Architecture Search With Quality Diversity Optimizationcited by 3
- 2023Don't Bet on Luck Alone: Enhancing Behavioral Reproducibility of Quality-Diversity Solutions in Uncertain Domainscited by 3
- 2025AutoQD: Automatic Discovery of Diverse Behaviors with Quality-Diversity Optimizationcited by 3
- 2022Efficient Learning of Locomotion Skills through the Discovery of Diverse Environmental Trajectory Generator Priorscited by 2
- 2023Rigorous Runtime Analysis of Diversity Optimization with GSEMO on OneMinMaxcited by 2
- 20233D GANs and Latent Space: A comprehensive surveycited by 1
- 2024Quality-Diversity with Limited Resourcescited by 1
- 2024Algorithmic Scenario Generation as Quality Diversity Optimizationcited by 1
- 2024QD-MAPPER: A Quality Diversity Framework to Automatically Evaluate Multi-Agent Path Finding Algorithms in Diverse Mapscited by 1
- 2025Soft Quality-Diversity Optimizationcited by 1
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spacescited by 1
- 2026Optimization of Edge Directions and Weights for Mixed Guidance Graphs in Lifelong Multi-Agent Path Findingcited by 1
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representationcited by 1
- 2021Dealing with Adversarial Player Strategies in the Neural Network Game iNNk through Ensemble Learningcited by 0
- 2022Generating Diverse Indoor Furniture Arrangementscited by 0
- 2022Quality-diversity in dissimilarity spacescited by 0
- 2023The Quest for Content: A Survey of Search-Based Procedural Content Generation for Video Gamescited by 0
- 2023Evolutionary Machine Learning and Gamescited by 0
- 2024Dynamic Quality-Diversity Searchcited by 0
- 2025Evolutionary Level Repaircited by 0
- 2025Expanding Horizons of Level Diversity via Multi-objective Evolutionary Learningcited by 0
- 2026EvoPref: Multi-Objective Evolutionary Optimization Discovers Diverse LLM Alignments Beyond Gradient Descentcited by 0
- 2026Procedural Generation of First Person Shooter Maps using Map-Elitescited by 0
50 most cited of 51 All 51 (JSON)
- 2026Behavioral Foundation Models for Quality Diversity28 Sep 2026
- 2026Procedural Generation of First Person Shooter Maps using Map-Elites28 May 2026
- 2026EvoPref: Multi-Objective Evolutionary Optimization Discovers Diverse LLM Alignments Beyond Gradient Descent10 May 2026
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation25 Mar 2026
- 2026Optimization of Edge Directions and Weights for Mixed Guidance Graphs in Lifelong Multi-Agent Path Finding26 Feb 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Soft Quality-Diversity Optimization30 Nov 2025
- 2025Expanding Horizons of Level Diversity via Multi-objective Evolutionary Learning29 Sep 2025
- 2025Evolutionary Level Repair24 Jun 2025
- 2025Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Models8 Jun 2025
- 2025AutoQD: Automatic Discovery of Diverse Behaviors with Quality-Diversity Optimization5 Jun 2025
- 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models4 Dec 2024
38 more
- 2024QD-MAPPER: A Quality Diversity Framework to Automatically Evaluate Multi-Agent Path Finding Algorithms in Diverse Maps10 Sep 2024
- 2024Algorithmic Scenario Generation as Quality Diversity Optimization7 Sep 2024
- 2024Quality-Diversity with Limited Resources6 Jun 2024
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2024Dynamic Quality-Diversity Search7 Apr 2024
- 2023Quality-Diversity Generative Sampling for Learning with Synthetic Data22 Dec 2023
- 2023Evolutionary Machine Learning and Games20 Nov 2023
- 2023The Quest for Content: A Survey of Search-Based Procedural Content Generation for Video Games8 Nov 2023
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automata28 Oct 2023
- 2023Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimization18 Oct 2023
- 2023Diversity from Human Feedback10 Oct 2023
- 2023Rigorous Runtime Analysis of Diversity Optimization with GSEMO on OneMinMax14 Jul 2023
- 2023Gradient-Informed Quality Diversity for the Illumination of Discrete Spaces8 Jun 2023
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learning23 May 2023
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousing10 May 2023
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarios26 Apr 2023
- 20233D GANs and Latent Space: A comprehensive survey8 Apr 2023
- 2023Don't Bet on Luck Alone: Enhancing Behavioral Reproducibility of Quality-Diversity Solutions in Uncertain Domains7 Apr 2023
- 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimization1 Mar 2023
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Models12 Feb 2023
- 2023Evolving Flying Machines in Minecraft Using Quality Diversity1 Feb 2023
- 2022Quality-diversity in dissimilarity spaces14 Nov 2022
- 2022Benchmarking Quality-Diversity Algorithms on Neuroevolution for Reinforcement Learning4 Nov 2022
- 2022Efficient Learning of Locomotion Skills through the Discovery of Diverse Environmental Trajectory Generator Priors10 Oct 2022
- 2022Heterogeneous Multi-agent Zero-Shot Coordination by Coevolution9 Aug 2022
- 2022Tackling Neural Architecture Search With Quality Diversity Optimization30 Jul 2022
- 2022Generating Diverse Indoor Furniture Arrangements20 Jun 2022
- 2022Deep Surrogate Assisted Generation of Environments9 Jun 2022
- 2022Covariance Matrix Adaptation MAP-Annealing22 May 2022
- 2022Learning to Walk Autonomously via Reset-Free Quality-Diversity7 Apr 2022
- 2022Accelerated Quality-Diversity through Massive Parallelism2 Feb 2022
- 2021Illuminating Diverse Neural Cellular Automata for Level Generation12 Sep 2021
- 2021Dealing with Adversarial Player Strategies in the Neural Network Game iNNk through Ensemble Learning5 Jul 2021
- 2021On the Importance of Environments in Human-Robot Coordination21 Jun 2021
- 2021Differentiable Quality Diversity7 Jun 2021
- 2021Fast Game Content Adaptation Through Bayesian-based Player Modelling18 May 2021
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencoder24 Feb 2021
- 2021Using Multiple Generative Adversarial Networks to Build Better-Connected Levels for Mega Man30 Jan 2021
50 newest of 51 All 51 (JSON)
- 2021Differentiable Quality Diversitycited by 71
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2021On the Importance of Environments in Human-Robot Coordinationcited by 37
- 2021Illuminating Diverse Neural Cellular Automata for Level Generationcited by 35
- 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimizationcited by 29
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2022Covariance Matrix Adaptation MAP-Annealingcited by 24
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousingcited by 17
- 2021Illuminating the Space of Beatable Lode Runner Levels Produced By Various Generative Adversarial Networkscited by 14
- 2022Accelerated Quality-Diversity through Massive Parallelismcited by 14
12 most cited of 46 All 46 (JSON)
- 2026Behavioral Foundation Models for Quality Diversity28 Sep 2026
- 2026Procedural Generation of First Person Shooter Maps using Map-Elites28 May 2026
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation25 Mar 2026
- 2026Optimization of Edge Directions and Weights for Mixed Guidance Graphs in Lifelong Multi-Agent Path Finding26 Feb 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Soft Quality-Diversity Optimization30 Nov 2025
- 2025Expanding Horizons of Level Diversity via Multi-objective Evolutionary Learning29 Sep 2025
- 2025Evolutionary Level Repair24 Jun 2025
- 2025AutoQD: Automatic Discovery of Diverse Behaviors with Quality-Diversity Optimization5 Jun 2025
- 2024QD-MAPPER: A Quality Diversity Framework to Automatically Evaluate Multi-Agent Path Finding Algorithms in Diverse Maps10 Sep 2024
- 2024Algorithmic Scenario Generation as Quality Diversity Optimization7 Sep 2024
- 2024Quality-Diversity with Limited Resources6 Jun 2024
12 newest of 46 All 46 (JSON)