mlsanityData to 7 Oct 2026

WorldGen: From Text to Traversable and Interactive 3D Worlds

arXiv 2511.16825 ↗First posted 20 Nov 2025cs.CV cs.AIcited by 18

Not on the map. Why?

Abstract (arXiv)

We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 80 of its 95 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

80 of 95 references.

References · 80

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  3. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  4. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  5. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  6. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  7. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  8. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  9. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  10. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  11. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  12. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
38 more
  1. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  2. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  3. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  4. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  5. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  6. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  7. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
  8. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
  9. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  10. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  11. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  12. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  13. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
  14. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
  15. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  16. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  17. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  18. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 104
  19. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
  20. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  21. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  22. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  23. 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
  24. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  25. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
  26. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  27. 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
  28. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  29. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
  30. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
  31. 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenescited by 70
  32. 20233D-aware Image Generation using 2D Diffusion Modelscited by 69
  33. 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
  34. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  35. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  36. 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
  37. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generationcited by 56
  38. 2023LDM3D: Latent Diffusion Model for 3Dcited by 53

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 17.

18 papers.

Sort:

By area:

  1. 2026Code World Model: Coding Agent as World Braincited by 9
  2. 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenescited by 8
  3. 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
  4. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
  5. 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
  6. 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layoutscited by 5
  7. 2026VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?cited by 2
  8. 2026Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Sciencecited by 1
  9. 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
  10. 2026PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generationcited by 1
  11. 2026StateFlow: Building, Evolving, and Accessing 3D World States for Previsualizationcited by 1
  12. 2026From Prompts to Worlds: How Users Iterate, Explore, and Make Sense of AI-Generated 3D Environmentscited by 0
6 more
  1. 2026MeshReGen: A Unified 3D Geometry Regeneration Frameworkcited by 0
  2. 2026SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Controlcited by 0
  3. 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generationcited by 0
  4. 2026Operational digital twin clinics enable task-based evaluation of embodied AIcited by 0
  5. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  6. 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation
  2. 2026World Craft: Agentic Framework to Create Visualizable Worlds via Text
  3. 2026MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Models
  4. 2026Code2Games: Enabling Coding Agents for Gaming World Generation
  5. 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editing
  6. 2026Imagine a City: CityGenAgent for Procedural 3D City Generation
  7. 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agents
  8. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model