# WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI

arXiv: https://arxiv.org/abs/2308.13355 · HTML: https://mlsanity.com/paper/2308.13355/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Aug 2023.

## Built on by (most cited first, 13 of 13)

- [Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization](https://mlsanity.com/paper/2408.04112/) (2024)
- [PromptMap: An Alternative Interaction Style for AI-Based Image Generation](https://mlsanity.com/paper/2503.09436/) (2025)
- [Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbols](https://mlsanity.com/paper/2501.13284/) (2025)
- [BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI](https://mlsanity.com/paper/2403.13947/) (2024)
- [SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending](https://mlsanity.com/paper/2409.13926/) (2024)
- [Societal Impacts Research Requires Benchmarks for Creative Composition Tasks](https://mlsanity.com/paper/2504.06549/) (2025)
- [Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and Outputs](https://mlsanity.com/paper/2512.20129/) (2025)
- [AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People](https://mlsanity.com/paper/2408.10240/) (2024)
- [MS2Mesh-XR: Multi-modal Sketch-to-Mesh Generation in XR Environments](https://mlsanity.com/paper/2412.09008/) (2024)
- [Understanding Prompt Programming Tasks and Questions](https://mlsanity.com/paper/2507.17264/) (2025)
- [AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration](https://mlsanity.com/paper/2511.17906/) (2025)
- [Compos3D: Interactive Part-Based Composition for Creative Control in Generative 3D Models](https://mlsanity.com/paper/2607.12193/) (2026)
- [Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks](https://mlsanity.com/paper/2609.24955/) (2026)

## Abstract (arXiv)

Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image generation systems to enable users iteratively visualize and modify elements of their fictional world using a combination of text input, sketching, and region-based filling. WorldSmith enables novice world builders to quickly visualize a fictional world with layered edits and hierarchical compositions. Through a formative study (4 participants) and first-use study (13 participants) we demonstrate that WorldSmith offers more expressive interactions with prompt-based models. With this work, we explore how creatives can be empowered to leverage prompt-based generative AI as a tool in their creative process, beyond current "click-once" prompting UI paradigms.