WorldWeave: Growing Persistent Geometric Worlds for Video Generation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Despite rapid progress, world models still lack explicit, persistent structural memory, making it difficult to preserve consistent world structure during continual scene expansion and cross-view revisits. To address this limitation, we present WorldWeave, a world generation framework that decouples world-state maintenance from visual rendering. Specifically, WorldWeave combines continual elevation-map generation with agent-guided scene organization and stitching to build an expandable explicit 3D world that incrementally extends structural memory while preserving existing structure. First, its terrain module uses diffusion-based image outpainting to generate continuous metric elevation maps under neighborhood conditioning and boundary constraints. Next, an agent integrates user intent, terrain evidence, and cross-region connectivity constraints to construct scenes through hierarchical semantic planning, deterministic geometry compilation, and local revision. Finally, during visual generation, planned camera trajectories query world geometry through a read-only interface, producing depth sequences that guide video synthesis without writing the generated results back into the world state. As a result, structural memory remains independent of short-window video generation, enabling continual expansion without predefined map boundaries and providing a consistent geometric basis for observations across trajectories and repeated visits.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 48 of its 51 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
48 of 51 references.
Closest ancestors · 9
Same direction, newest first
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphs10 Mar
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environments14 Dec
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar
Other references · 39
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2025Qwen-Image Technical Reportcited by 973
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2023WonderJourney: Going from Anywhere to Everywherecited by 157
27 more
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
- 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 62
- 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 53
- 2024InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Modelscited by 53
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
- 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editingcited by 14
- 2026Code2Worlds: Empowering Coding LLMs for 4D World Generationcited by 12
- 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 10
- 2025MESA: Text-Driven Terrain Generation Using Latent Diffusion and Global Copernicus Datacited by 7
- 2025ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignmentcited by 7
- 2026Geometry-as-context: Modulating Explicit 3D in Scene-consistent Video Generation to Geometry Contextcited by 7
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2025TerraFusion: Joint Generation of Terrain Geometry and Texture Using Latent Diffusion Modelscited by 1
- 2025InfiniteDiffusion: Bridging Learned Fidelity and Procedural Utility for Open-World Terrain Generationcited by 1
- 2025GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structurecited by 1
- 2026Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2025WorldGrow: Generating Infinite 3D World
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory
- 2025Video World Models with Long-term Spatial Memory
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory