mlsanityData to 7 Oct 2026

Unbounded: A Generative Infinite Game of Character Life Simulation

arXiv 2410.18975 ↗First posted 24 Oct 2024cs.CV cs.AI cs.CLcited by 14

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We introduce the concept of a generative infinite game, a video game that transcends the traditional boundaries of finite, hard-coded systems by using generative models. Inspired by James P. Carse's distinction between finite and infinite games, we leverage recent advances in generative AI to create Unbounded: a game of character life simulation that is fully encapsulated in generative models. Specifically, Unbounded draws inspiration from sandbox life simulations and allows you to interact with your autonomous virtual character in a virtual world by feeding, playing with and guiding it - with open-ended mechanics generated by an LLM, some of which can be emergent. In order to develop Unbounded, we propose technical innovations in both the LLM and visual generation domains. Specifically, we present: (1) a specialized, distilled large language model (LLM) that dynamically generates game mechanics, narratives, and character interactions in real-time, and (2) a new dynamic regional image prompt Adapter (IP-Adapter) for vision models that ensures consistent yet flexible visual generation of a character across multiple environments. We evaluate our system through both qualitative and quantitative analysis, showing significant improvements in character life simulation, user instruction following, narrative coherence, and visual consistency for both characters and the environments compared to traditional related approaches.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 74 of its 94 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

74 of 94 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  2. 2024Genie: Generative Interactive Environments23 Feb
  3. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb

Other references · 71

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  12. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
38 more
  1. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  2. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  3. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  4. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  5. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  6. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  7. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  8. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  9. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  10. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  11. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  12. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  13. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  14. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
  15. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
  16. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  17. 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
  18. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  19. 2020Learning to Simulate Dynamic Environments with GameGANcited by 86
  20. 2018Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Networkcited by 76
  21. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
  22. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  23. 2023Level Generation Through Large Language Modelscited by 68
  24. 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
  25. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  26. 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
  27. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  28. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
  29. 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 46
  30. 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agentscited by 41
  31. 2016Super Mario as a String: Platformer Level Generation Via LSTMscited by 40
  32. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  33. 2020Bringing Stories Alive: Generating Interactive Fiction Worldscited by 28
  34. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 27
  35. 2023Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Modelscited by 26
  36. 2024DialogGen: Multi-modal Interactive Dialogue System for Multi-turn Text-to-Image Generationcited by 26
  37. 2024Game Generation via Large Language Modelscited by 24
  38. 2023CALYPSO: LLMs as Dungeon Masters' Assistantscited by 23

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 4.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026VirtualEnv: A Platform for Embodied AI Research
  2. 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction
  3. 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models
  4. 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
  5. 2026Programmable World Model
  6. 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
  7. 2026AlayaWorld: Long-Horizon and Playable Video World Generation
  8. 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation