From Zero to Hero: Training-Free Custom Concept Spawning in World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Autoregressive world models have emerged as a powerful paradigm for interactive video generation, allowing users to navigate dynamically generated environments through actions. These models are typically conditioned on a text prompt and/or a single reference frame, from which the entire world is generated. Yet the moment the user navigates beyond what is visible in that frame, the unseen regions are populated by the base model's priors, with no mechanism for the user to specify what should appear and where. This is a fundamental limitation for applications such as gaming, interactive storytelling, and simulation, where controllable scene composition is essential. We refer to this missing capability as concept spawning; introducing a user-specified visual concept into a world model, analogous to spawning in a game engine. We introduce SPAWN (Swapping Pinned Anchor with Windowed iNjection), a training-free method for concept spawning. SPAWN exploits a structural property of image-to-video backbones: the first slot of the context memory is pinned to the reference frame and acts as a foundational anchor for every generated chunk. By swapping this anchor with an external concept latent over a short injection window and letting the original anchor return, we cause the concept to propagate naturally through the rollout via the model's own memory. SPAWN supports concepts from fine-grained entities such as characters and props to large-scale elements such as buildings and landmarks, and accepts either a concept image or a text description as input. Experiments show that SPAWN integrates concepts with consistent lighting, scale, and perspective while preserving identity and temporal coherence, demonstrating that controllable concept spawning is achievable in existing autoregressive world models without any training.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 38 of its 40 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
38 of 40 references.
Closest ancestors · 17
Same direction, newest first
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Genie: Generative Interactive Environments23 Feb
5 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 21
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Video Diffusion Modelscited by 2,280
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
9 more
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 72
- 2026What Makes Position Zero Special? A Mechanistic Study of Position Zero Attention Sinks in LLMscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens
- 2025Dreamland: Controllable World Creation with Simulator and Generative Models
- 2026Programmable World Model
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models