mlsanityData to 14 Oct 2026

Level Generation Through Large Language Models

arXiv 2302.05817 ↗First posted 11 Feb 2023cs.AI cs.CL cs.NEcited by 68

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are powerful tools, capable of leveraging their training on natural language to write stories, generate code, and answer questions. But can they generate functional video game levels? Game levels, with their complex functional constraints and spatial relationships in more than one dimension, are very different from the kinds of data an LLM typically sees during training. Datasets of game levels are also hard to come by, potentially taxing the abilities of these data-hungry models. We investigate the use of LLMs to generate levels for the game Sokoban, finding that LLMs are indeed capable of doing so, and that their performance scales dramatically with dataset size. We also perform preliminary experiments on controlling LLM level generators and discuss promising areas for future work.

Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 11 Feb 2023.

Builds on

22 of 35 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  5. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  6. 2022A Generalist Agentcited by 808
  7. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
  8. 2023MusicLM: Generating Music From Textcited by 448
  9. 2017Imagination-Augmented Agents for Deep Reinforcement Learningcited by 140
  10. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 137
  11. 2020PCGRL: Procedural Content Generation via Reinforcement Learningcited by 90
  12. 2020Deep Learning for Procedural Content Generationcited by 73
10 more
  1. 2016Super Mario as a String: Platformer Level Generation Via LSTMscited by 40
  2. 2021Learning Controllable Content Generatorscited by 40
  3. 2019Bootstrapping Conditional GANs for Video Game Level Generationcited by 35
  4. 2020Griddly: A platform for AI research in gamescited by 31
  5. 2020Interactive Evolution and Exploration Within Latent Level-Design Space of Generative Adversarial Networkscited by 22
  6. 2020Conditional Level Generation and Game Blendingcited by 17
  7. 2017Learning to Decode for Future Successcited by 16
  8. 2020Multi-Domain Level Generation and Blending with Sketches via Example-Driven BSP and Variational Autoencoderscited by 11
  9. 2021Dungeon and Platformer Level Blending and Generation using Conditional VAEscited by 10
  10. 2018Addressing the Fundamental Tension of PCGML with Discriminative Learningcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 9; 2024: 27; 2025: 19; 2026: 13.

68 papers.

Sort:

By area:

  1. 2024Genie: Generative Interactive Environmentscited by 747
  2. 2024Large Language Models and Games: A Survey and Roadmapcited by 93
  3. 2023LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimizationcited by 87
  4. 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 64
  5. 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agentscited by 46
  6. 2023Beyond Size: How Gradients Shape Pruning Decisions in Large Language Modelscited by 30
  7. 2024Game Generation via Large Language Modelscited by 25
  8. 2024DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedbackcited by 25
  9. 2024GAVEL: Generating Games Via Evolution and Language Modelscited by 24
  10. 2024Large Language Models and Video Games: A Preliminary Scoping Reviewcited by 23
  11. 2023Practical PCG Through Large Language Modelscited by 21
  12. 2024Automating the Search for Artificial Life with Foundation Modelscited by 20
38 more
  1. 2024DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraftcited by 17
  2. 2024Player-Driven Emergence in LLM-Driven Game Narrativecited by 16
  3. 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 16
  4. 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
  5. 2023The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddingscited by 14
  6. 2024Unbounded: A Generative Infinite Game of Character Life Simulationcited by 14
  7. 2024The Ink Splotch Effect: A Case Study on ChatGPT as a Co-Creative Game Designercited by 12
  8. 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Gamescited by 12
  9. 2024GPT for Games: A Scoping Review (2020-2023)cited by 10
  10. 2024FactorSim: Generative Simulation via Factorized Representationcited by 10
  11. 2024DreamGarden: A Designer Assistant for Growing Games from a Single Promptcited by 10
  12. 2024GPT for Games: An Updated Scoping Review (2020-2024)cited by 10
  13. 2024Missed Connections: Lateral Thinking Puzzles for Large Language Modelscited by 9
  14. 2023ChatGPT4PCG Competition: Character-like Level Generation for Science Birdscited by 8
  15. 2024From Text to Life: On the Reciprocal Relationship between Artificial Life and Large Language Modelscited by 8
  16. 2024GameTraversalBenchmark: Evaluating Planning Abilities Of Large Language Models Through Traversing 2D Game Mapscited by 8
  17. 2024Codenames as a Benchmark for Large Language Modelscited by 8
  18. 2023Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally Lackingcited by 7
  19. 2024A Survey on Human-AI Collaboration with Large Foundation Modelscited by 7
  20. 2024Grammar-based Game Description Generation using Large Language Modelscited by 7
  21. 2025AnimeGamer: Infinite Anime Life Simulation with Next Game State Predictioncited by 7
  22. 2024Measuring Diversity of Game Scenarioscited by 5
  23. 2024ChatPCG: Large Language Model-Driven Reward Design for Procedural Content Generationcited by 5
  24. 2025Text Speaks Louder than Vision: ASCII Art Reveals Textual Biases in Vision-Language Modelscited by 5
  25. 2025MARCO: Multi-Agent Code Optimization with Real-Time Knowledge Integration for High-Performance Computingcited by 5
  26. 2025Divide-Fuse-Conquer: Eliciting "Aha Moments" in Multi-Scenario Gamescited by 4
  27. 2026Mage: Multi-Axis Evaluation of LLM-Generated Executable Game Scenes Beyond Compile-Pass Ratecited by 4
  28. 2024Generative Design through Quality-Diversity Data Synthesis and Language Modelscited by 3
  29. 20243D Building Generation in Minecraft via Large Language Modelscited by 3
  30. 2025Cardiverse: Harnessing LLMs for Novel Card Game Prototypingcited by 3
  31. 2025PCGRLLM: Large Language Model-Driven Reward Design for Procedural Content Generation Reinforcement Learningcited by 3
  32. 2025Word2Minecraft: Generating 3D Game Levels through Large Language Modelscited by 3
  33. 2025All Stories Are One Story: Emotional Arc Guided Procedural Game Level Generationcited by 3
  34. 2025Multi-Objective Instruction-Aware Representation Learning in Procedural Content Generation RLcited by 3
  35. 2026AI for Games in the Foundation Model Eracited by 3
  36. 2025Grammar and Gameplay-aligned RL for Game Description Generation with LLMscited by 2
  37. 2025ScriptDoctor: Automatic Generation of PuzzleScript Games via Large Language Models and Tree Searchcited by 2
  38. 2025Boardwalk: Towards a Framework for Creating Board Games with LLMscited by 2

50 most cited of 68 All 68 (JSON)