mlsanityData to 14 Oct 2026

Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environments

arXiv 2509.04481 ↗First posted 31 Aug 2025cs.GR cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent advances in large language models (LLMs) enable compelling story generation, but connecting narrative text to playable visual environments remains an open challenge in procedural content generation (PCG). We present a lightweight pipeline that transforms short narrative prompts into a sequence of 2D tile-based game scenes, reflecting the temporal structure of stories. Given an LLM-generated narrative, our system identifies three key time frames, extracts spatial predicates in the form of "Object-Relation-Object" triples, and retrieves visual assets using affordance-aware semantic embeddings from the GameTileNet dataset. A layered terrain is generated using Cellular Automata, and objects are placed using spatial rules grounded in the predicate structure. We evaluated our system in ten diverse stories, analyzing tile-object matching, affordance-layer alignment, and spatial constraint satisfaction across frames. This prototype offers a scalable approach to narrative-driven scene generation and lays the foundation for future work on multi-frame continuity, symbolic tracking, and multi-agent coordination in story-centered PCG.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 31 Aug 2025.

Builds on

20 of 60 references.

References · 20

  1. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  2. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  3. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  4. 2019Visual Semantic Reasoning for Image-Text Matchingcited by 185
  5. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 137
  6. 2024Large Language Models and Games: A Survey and Roadmapcited by 93
  7. 2014Narrative Planning: Balancing Plot and Charactercited by 61
  8. 2019Knowledge-Enriched Visual Storytellingcited by 26
  9. 2024Game Generation via Large Language Modelscited by 25
  10. 2024GAVEL: Generating Games Via Evolution and Language Modelscited by 24
  11. 2024Word2World: Generating Stories and Worlds through Large Language Modelscited by 18
  12. 2023Large language models can segment narrative events similarly to humanscited by 16
8 more
  1. 2021Tile Embedding: A General Representation for Procedural Level Generation via Machine Learningcited by 9
  2. 2024Collaborative Comic Generation: Integrating Visual Narrative Theories with AI Models for Enhanced Creativitycited by 6
  3. 2025Hierarchical Knowledge Graphs for Story Understanding in Visual Narrativescited by 5
  4. 2018Let CONAN tell you a story: Procedural quest generationcited by 4
  5. 2023A Customizable Generator for Comic-Style Visual Narrativecited by 4
  6. 2025GameTileNet: A Semantic Dataset for Low-Resolution Game Art in Procedural Content Generationcited by 3
  7. 2025All Stories Are One Story: Emotional Arc Guided Procedural Game Level Generationcited by 3
  8. 2025Robust Symbolic Reasoning for Visual Narratives via Hierarchical and Semantically Normalized Knowledge Graphscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.