Level generation and style enhancement -- deep learning for game development overview
Not on the map. Why?
Abstract (arXiv)
We present practical approaches of using deep learning to create and enhance level maps and textures for video games -- desktop, mobile, and web. We aim to present new possibilities for game developers and level artists. The task of designing levels and filling them with details is challenging. It is both time-consuming and takes effort to make levels rich, complex, and with a feeling of being natural. Fortunately, recent progress in deep learning provides new tools to accompany level designers and visual artists. Moreover, they offer a way to generate infinite worlds for game replayability and adjust educational games to players' needs. We present seven approaches to create level maps, each using statistical methods, machine learning, or deep learning. In particular, we include: - Generative Adversarial Networks for creating new images from existing examples (e.g. ProGAN). - Super-resolution techniques for upscaling images while preserving crisp detail (e.g. ESRGAN). - Neural style transfer for changing visual themes. - Image translation - turning semantic maps into images (e.g. GauGAN). - Semantic segmentation for turning images into semantic masks (e.g. U-Net). - Unsupervised semantic segmentation for extracting semantic features (e.g. Tile2Vec). - Texture synthesis - creating large patterns based on a smaller sample (e.g. InGAN).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 89 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
44 of 89 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
32 more
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
- 2018Do Better ImageNet Models Transfer Better?cited by 560
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
- 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
- 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2017Neural Style Transfer: A Reviewcited by 199
- 2017Deep Photo Style Transfercited by 168
- 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
- 2018Tile2Vec: Unsupervised representation learning for spatially distributed datacited by 109
- 2016Learning What and Where to Drawcited by 105
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2019A Deep Journey into Super-resolution: A surveycited by 86
- 2021Enhancing Photorealism Enhancementcited by 74
- 2020Deep Learning for Procedural Content Generationcited by 73
- 2018Non-Stationary Texture Synthesis by Adversarial Expansioncited by 66
- 2019Increasing Generality in Machine Learning through Procedural Content Generationcited by 58
- 2019Learned Image Downscaling for Upscaling using Content Adaptive Resamplercited by 55
- 2016Super Mario as a String: Platformer Level Generation Via LSTMscited by 40
- 2018GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentationcited by 40
- 2019Ultrafast Photorealistic Style Transfer via Neural Architecture Searchcited by 39
- 2019Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creatorscited by 31
- 2017Towards the Automatic Anime Characters Creation with Generative Adversarial Networkscited by 29
- 2017TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Networkcited by 21
- 2016Toward Game Level Generation from Gameplay Videoscited by 6
Built on by
Not cited yet.