Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencoder
Not on the map. Why?
Abstract (arXiv)
Several works have demonstrated the use of variational autoencoders (VAEs) for generating levels in the style of existing games and blending levels across different games. Further, quality-diversity (QD) algorithms have also become popular for generating varied game content by using evolution to explore a search space while focusing on both variety and quality. To reap the benefits of both these approaches, we present a level generation and game blending approach that combines the use of VAEs and QD algorithms. Specifically, we train VAEs on game levels and run the MAP-Elites QD algorithm using the learned latent space of the VAE as the search space. The latent space captures the properties of the games whose levels we want to generate and blend, while MAP-Elites searches this latent space to find a diverse set of levels optimizing a given objective such as playability. We test our method using models for 5 different platformer games as well as a blended domain spanning 3 of these games. We refer to using MAP-Elites for blending as Blend-Elites. Our results show that MAP-Elites in conjunction with VAEs enables the generation of a diverse set of playable levels not just for each individual game but also for the blended domain while illuminating game-specific regions of the blended latent space.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 24 Feb 2021.
Builds on
30 of 56 references.
References · 30
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Illuminating search spaces by mapping elitescited by 425
- 2019Go-Explore: a New Approach for Hard-Exploration Problemscited by 212
- 2017Procedural Content Generation via Machine Learning (PCGML)cited by 137
- 2019Covariance Matrix Adaptation for the Rapid Illumination of Behavior Spacecited by 78
- 2018Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Networkcited by 76
- 2020Illuminating Mario Scenes in the Latent Space of a Generative Adversarial Networkcited by 52
- 2019Procedural Content Generation through Quality Diversitycited by 45
- 2016The VGLC: The Video Game Level Corpuscited by 41
- 2016Super Mario as a String: Platformer Level Generation Via LSTMscited by 40
- 2019Mapping Hearthstone Deck Spaces through MAP-Elites with Sliding Boundariescited by 32
- 2018Talakat: Bullet Hell Generation through Constrained Map-Elitescited by 26
18 more
- 2020Interactive Evolution and Exploration Within Latent Level-Design Space of Generative Adversarial Networkscited by 22
- 2020Baba is Y'all: Collaborative Mixed-Initiative Level Designcited by 20
- 2020CPPN2GAN: Combining Compositional Pattern Producing Networks and GANs for Large-scale Pattern Generationcited by 19
- 2019Empowering Quality Diversity in Dungeon Design with Interactive Constrained MAP-Elitescited by 18
- 2019Diverse Agents for Ad-Hoc Cooperation in Hanabicited by 17
- 2020Conditional Level Generation and Game Blendingcited by 17
- 2018Automated Game Design via Conceptual Expansioncited by 15
- 2020Controllable Level Blending between Games using Variational Autoencoderscited by 14
- 2020Finding Game Levels with the Right Difficulty in a Few Trials through Intelligent Trial-and-Errorcited by 14
- 2020Sequential Segment-based Level Generation and Blending using Variational Autoencoderscited by 14
- 2020Exploring Level Blending across Platformers via Paths and Affordancescited by 14
- 2020Mech-Elites: Illuminating the Mechanic Space of GVGAIcited by 13
- 2020Towards Game Design via Creative Machine Learning (GDCML)cited by 13
- 2020Multi-Domain Level Generation and Blending with Sketches via Example-Driven BSP and Variational Autoencoderscited by 11
- 2018Generating Levels That Teach Mechanicscited by 9
- 2020Game Level Clustering and Generation using Gaussian Mixture VAEscited by 9
- 2020Entity Embedding as Game Representationcited by 8
- 2017Mechanics Automatically Recognized via Interactive Observation: Jumpingcited by 4
Built on by
Citing papers per year: 2021: 3; 2022: 7; 2023: 9; 2024: 2; 2025: 4; 2026: 2.
27 papers.
Sort:
- 2021Differentiable Quality Diversitycited by 72
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 64
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2022Covariance Matrix Adaptation MAP-Annealingcited by 25
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddingscited by 14
- 2021Dungeon and Platformer Level Blending and Generation using Conditional VAEscited by 10
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarioscited by 8
- 2022Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversitycited by 7
- 2023Lode Encoder: AI-constrained co-creativitycited by 6
- 2022Hierarchical Quality-Diversity for Online Damage Recoverycited by 5
- 2022Mario Plays on a Manifold: Generating Functional Content in Latent Space through Differential Geometrycited by 5
15 more
- 2023Evolving Populations of Diverse RL Agents with MAP-Elitescited by 5
- 2024Measuring Diversity of Game Scenarioscited by 5
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombinationcited by 3
- 2021Ensemble Learning For Mega Man Level Generationcited by 1
- 2022Clustering-based Tile Embedding (CTE): A General Representation for Level Design with Skewed Tile Distributionscited by 1
- 2023Joint Level Generation and Translation Using Gameplay Videoscited by 1
- 2023Reconstructing Existing Levels through Level Inpaintingcited by 1
- 2025Level Generation with Constrained Expressive Rangecited by 1
- 2025Video Game Level Design as a Multi-Agent Reinforcement Learning Problemcited by 1
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spacescited by 1
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representationcited by 1
- 2022Latent Combinational Game Designcited by 0
- 2023Targeted Analysis of High-Risk States Using an Oriented Variational Autoencodercited by 0
- 2024LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Searchcited by 0
- 2025Level Generation with Quantum Reservoir Computingcited by 0
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation25 Mar 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Video Game Level Design as a Multi-Agent Reinforcement Learning Problem6 Oct 2025
- 2025Level Generation with Quantum Reservoir Computing19 May 2025
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination29 Apr 2025
- 2025Level Generation with Constrained Expressive Range4 Apr 2025
- 2024LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Search22 Apr 2024
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2023Reconstructing Existing Levels through Level Inpainting18 Sep 2023
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddings8 Aug 2023
- 2023Lode Encoder: AI-constrained co-creativity2 Aug 2023
- 2023Joint Level Generation and Translation Using Gameplay Videos29 Jun 2023
15 more
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learning23 May 2023
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarios26 Apr 2023
- 2023Targeted Analysis of High-Risk States Using an Oriented Variational Autoencoder20 Mar 2023
- 2023Evolving Populations of Diverse RL Agents with MAP-Elites9 Mar 2023
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Models12 Feb 2023
- 2022Clustering-based Tile Embedding (CTE): A General Representation for Level Design with Skewed Tile Distributions23 Oct 2022
- 2022Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversity18 Oct 2022
- 2022Latent Combinational Game Design28 Jun 2022
- 2022Deep Surrogate Assisted Generation of Environments9 Jun 2022
- 2022Mario Plays on a Manifold: Generating Functional Content in Latent Space through Differential Geometry31 May 2022
- 2022Covariance Matrix Adaptation MAP-Annealing22 May 2022
- 2022Hierarchical Quality-Diversity for Online Damage Recovery12 Apr 2022
- 2021Ensemble Learning For Mega Man Level Generation27 Jul 2021
- 2021Dungeon and Platformer Level Blending and Generation using Conditional VAEs17 Jun 2021
- 2021Differentiable Quality Diversity7 Jun 2021
- 2021Differentiable Quality Diversitycited by 72
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 64
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2022Covariance Matrix Adaptation MAP-Annealingcited by 25
- 2023Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learningcited by 20
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddingscited by 14
- 2021Dungeon and Platformer Level Blending and Generation using Conditional VAEscited by 10
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarioscited by 8
- 2022Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversitycited by 7
- 2023Lode Encoder: AI-constrained co-creativitycited by 6
- 2022Hierarchical Quality-Diversity for Online Damage Recoverycited by 5
- 2022Mario Plays on a Manifold: Generating Functional Content in Latent Space through Differential Geometrycited by 5
12 most cited of 27 All 27 (JSON)
- 2026Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation25 Mar 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Video Game Level Design as a Multi-Agent Reinforcement Learning Problem6 Oct 2025
- 2025Level Generation with Quantum Reservoir Computing19 May 2025
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination29 Apr 2025
- 2025Level Generation with Constrained Expressive Range4 Apr 2025
- 2024LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Search22 Apr 2024
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2023Reconstructing Existing Levels through Level Inpainting18 Sep 2023
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddings8 Aug 2023
- 2023Lode Encoder: AI-constrained co-creativity2 Aug 2023
- 2023Joint Level Generation and Translation Using Gameplay Videos29 Jun 2023
12 newest of 27 All 27 (JSON)