Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Network
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Networks (GANs) are a machine learning approach capable of generating novel example outputs across a space of provided training examples. Procedural Content Generation (PCG) of levels for video games could benefit from such models, especially for games where there is a pre-existing corpus of levels to emulate. This paper trains a GAN to generate levels for Super Mario Bros using a level from the Video Game Level Corpus. The approach successfully generates a variety of levels similar to one in the original corpus, but is further improved by application of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). Specifically, various fitness functions are used to discover levels within the latent space of the GAN that maximize desired properties. Simple static properties are optimized, such as a given distribution of tile types. Additionally, the champion A* agent from the 2009 Mario AI competition is used to assess whether a level is playable, and how many jumping actions are required to beat it. These fitness functions allow for the discovery of levels that exist within the space of examples designed by experts, and also guide the search towards levels that fulfill one or more specified objectives.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 19; 2023: 17; 2024: 10; 2025: 9; 2026: 4.
76 papers.
Sort:
By area:
- 2021Differentiable Quality Diversitycited by 71
- 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 69
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
- 2021Learning Controllable Content Generatorscited by 40
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2021On the Importance of Environments in Human-Robot Coordinationcited by 37
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2021Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Studycited by 25
- 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integrationcited by 22
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2023ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Designcited by 20
- 2022Learning Controllable 3D Level Generatorscited by 19
38 more
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousingcited by 17
- 2021Illuminating the Space of Beatable Lode Runner Levels Produced By Various Generative Adversarial Networkscited by 14
- 2021World-GAN: a Generative Model for Minecraft Worldscited by 14
- 2022Path of Destruction: Learning an Iterative Level Generator Using a Small Datasetcited by 14
- 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddingscited by 14
- 2024Unbounded: A Generative Infinite Game of Character Life Simulationcited by 14
- 2023On Deep Generative Models for Approximation and Estimation of Distributions on Manifoldscited by 12
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
- 2021Dungeon and Platformer Level Blending and Generation using Conditional VAEscited by 10
- 2022COIL: Constrained Optimization in Learned Latent Space: Learning Representations for Valid Solutionscited by 10
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolutioncited by 9
- 2022Open-Ended Evolution for Minecraft Building Generationcited by 9
- 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Gamescited by 7
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generatorscited by 7
- 2025AnimeGamer: Infinite Anime Life Simulation with Next Game State Predictioncited by 7
- 2021Level Generation for Angry Birds with Sequential VAE and Latent Variable Evolutioncited by 6
- 2022Learning Synthetic Environments and Reward Networks for Reinforcement Learningcited by 6
- 2023Towards Mode Balancing of Generative Models via Diversity Weightscited by 6
- 2022Mario Plays on a Manifold: Generating Functional Content in Latent Space through Differential Geometrycited by 5
- 2024Measuring Diversity of Game Scenarioscited by 5
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Gamescited by 5
- 2021Hybrid Encoding For Generating Large Scale Game Level Patterns With Local Variationscited by 4
- 2022Gen'eLive! Generating Rhythm Actions in Love Live!cited by 4
- 2023Evolving Flying Machines in Minecraft Using Quality Diversitycited by 4
- 2023Hierarchically Composing Level Generators for the Creation of Complex Structurescited by 4
- 2021Evolving GAN Formulations for Higher Quality Image Synthesiscited by 3
- 2021Fast Game Content Adaptation Through Bayesian-based Player Modellingcited by 3
- 2023Procedural content generation of puzzle games using conditional generative adversarial networkscited by 3
- 2024Semantic Loss Functions for Neuro-Symbolic Structured Predictioncited by 3
- 2025Learning Intractable Multimodal Policies with Reparameterization and Diversity Regularizationcited by 3
- 2021GradFreeBits: Gradient Free Bit Allocation for Dynamic Low Precision Neural Networkscited by 2
- 2021Adapting Procedural Content Generation to Player Personas Through Evolutioncited by 2
- 2022Generating Game Levels of Diverse Behaviour Engagementcited by 2
- 2022Online Game Level Generation from Musiccited by 2
- 2022Aesthetic Bot: Interactively Evolving Game Maps on Twittercited by 2
- 2023Tools for Landscape Analysis of Optimisation Problems in Procedural Content Generation for Gamescited by 2
- 2023Using a Variational Autoencoder to Learn Valid Search Spaces of Safely Monitored Autonomous Robots for Last-Mile Deliverycited by 2
50 most cited of 76 All 76 (JSON)
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Learning Local Constraints for Reinforcement-Learned Content Generators13 May 2026
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines3 Mar 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Learning Intractable Multimodal Policies with Reparameterization and Diversity Regularization3 Nov 2025
- 2025Procedural Game Level Design with Deep Reinforcement Learning16 Oct 2025
- 2025Expanding Horizons of Level Diversity via Multi-objective Evolutionary Learning29 Sep 2025
- 2025Co-Evolving Complexity: An Adversarial Framework for Automatic MARL Curricula3 Sep 2025
- 2025Text-to-Level Diffusion Models With Various Text Encoders for Super Mario Bros30 Jun 2025
- 2025Evolutionary Level Repair24 Jun 2025
- 2025Analysis of Robustness of a Large Game Corpus4 Apr 2025
- 2025AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction1 Apr 2025
38 more
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games27 Mar 2025
- 2024Tensor Network Estimation of Distribution Algorithms27 Dec 2024
- 2024Controllable Game Level Generation: Assessing the Effect of Negative Examples in GAN Models30 Oct 2024
- 2024Guided Game Level Repair via Explainable AI30 Oct 2024
- 2024Unbounded: A Generative Infinite Game of Character Life Simulation24 Oct 2024
- 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integration21 Oct 2024
- 2024Improving Conditional Level Generation using Automated Validation in Match-3 Games10 Sep 2024
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generators22 Aug 2024
- 2024Semantic Loss Functions for Neuro-Symbolic Structured Prediction12 May 2024
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2024Collaborative Interactive Evolution of Art in the Latent Space of Deep Generative Models28 Mar 2024
- 2023Evolutionary Machine Learning and Games20 Nov 2023
- 2023The Quest for Content: A Survey of Search-Based Procedural Content Generation for Video Games8 Nov 2023
- 2023Utilizing Generative Adversarial Networks for Stable Structure Generation in Angry Birds5 Sep 2023
- 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddings8 Aug 2023
- 2023Fooling Contrastive Language-Image Pre-trained Models with CLIPMasterPrints7 Jul 2023
- 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Games4 Jul 2023
- 2023Procedural content generation of puzzle games using conditional generative adversarial networks26 Jun 2023
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousing10 May 2023
- 2023Games for Artificial Intelligence Research: A Review and Perspectives26 Apr 2023
- 2023Towards Mode Balancing of Generative Models via Diversity Weights24 Apr 2023
- 2023Using a Variational Autoencoder to Learn Valid Search Spaces of Safely Monitored Autonomous Robots for Last-Mile Delivery6 Mar 2023
- 2023On Deep Generative Models for Approximation and Estimation of Distributions on Manifolds25 Feb 2023
- 2023Tools for Landscape Analysis of Optimisation Problems in Procedural Content Generation for Games16 Feb 2023
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Models12 Feb 2023
- 2023ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Design9 Feb 2023
- 2023Hierarchically Composing Level Generators for the Creation of Complex Structures3 Feb 2023
- 2023Evolving Flying Machines in Minecraft Using Quality Diversity1 Feb 2023
- 2022State Space Closure: Revisiting Endless Online Level Generation via Reinforcement Learning6 Dec 2022
- 2022Open-Ended Evolution for Minecraft Building Generation7 Sep 2022
- 2022Aesthetic Bot: Interactively Evolving Game Maps on Twitter9 Aug 2022
- 2022Combining Evolutionary Search with Behaviour Cloning for Procedurally Generated Content29 Jul 2022
- 2022Distribution Learning Based on Evolutionary Algorithm Assisted Deep Neural Networks for Imbalanced Image Classification26 Jul 2022
- 2022Audio-guided Album Cover Art Generation with Genetic Algorithms14 Jul 2022
- 2022Online Game Level Generation from Music12 Jul 2022
- 2022Generating Game Levels of Diverse Behaviour Engagement5 Jul 2022
- 2022Learning Controllable 3D Level Generators27 Jun 2022
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolution11 Jun 2022
50 newest of 76 All 76 (JSON)
- 2021Differentiable Quality Diversitycited by 71
- 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 69
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
- 2021Learning Controllable Content Generatorscited by 40
- 2022Deep Surrogate Assisted Generation of Environmentscited by 40
- 2021On the Importance of Environments in Human-Robot Coordinationcited by 37
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2021Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Studycited by 25
- 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integrationcited by 22
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2023ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Designcited by 20
- 2022Learning Controllable 3D Level Generatorscited by 19
12 most cited of 72 All 72 (JSON)
- 2026Learning Local Constraints for Reinforcement-Learned Content Generators13 May 2026
- 2026Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces3 Jan 2026
- 2025Learning Intractable Multimodal Policies with Reparameterization and Diversity Regularization3 Nov 2025
- 2025Procedural Game Level Design with Deep Reinforcement Learning16 Oct 2025
- 2025Expanding Horizons of Level Diversity via Multi-objective Evolutionary Learning29 Sep 2025
- 2025Co-Evolving Complexity: An Adversarial Framework for Automatic MARL Curricula3 Sep 2025
- 2025Evolutionary Level Repair24 Jun 2025
- 2025Analysis of Robustness of a Large Game Corpus4 Apr 2025
- 2025AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction1 Apr 2025
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games27 Mar 2025
- 2024Tensor Network Estimation of Distribution Algorithms27 Dec 2024
- 2024Controllable Game Level Generation: Assessing the Effect of Negative Examples in GAN Models30 Oct 2024
12 newest of 72 All 72 (JSON)