mlsanityData to 14 Oct 2026

HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels

arXiv 2507.21809 ↗First posted 29 Jul 2025cs.CVcited by 94

Not on the map. Why?

Cited by 48 in World models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Creating immersive and playable 3D worlds from texts or images remains a fundamental challenge in computer vision and graphics. Existing world generation approaches typically fall into two categories: video-based methods that offer rich diversity but lack 3D consistency and rendering efficiency, and 3D-based methods that provide geometric consistency but struggle with limited training data and memory-inefficient representations. To address these limitations, we present HunyuanWorld 1.0, a novel framework that combines the best of both worlds for generating immersive, explorable, and interactive 3D scenes from text and image conditions. Our approach features three key advantages: 1) 360deg immersive experiences via panoramic world proxies; 2) mesh export capabilities for seamless compatibility with existing computer graphics pipelines; 3) disentangled object representations for augmented interactivity. The core of our framework is a semantically layered 3D mesh representation that leverages panoramic images as 360deg world proxies for semantic-aware world decomposition and reconstruction, enabling the generation of diverse 3D worlds. Extensive experiments demonstrate that our method achieves state-of-the-art performance in generating coherent, explorable, and interactive 3D worlds while enabling versatile applications in virtual reality, physical simulation, game development, and interactive content creation.

Key facts. Cited by 94 papers in the map (data through 14 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

55 of 69 references.

References · 55

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
38 more
  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  2. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  3. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  4. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  5. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  6. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  7. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  8. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  9. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  10. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  11. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  12. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  13. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  14. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  15. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  16. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  17. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  18. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  19. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  20. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
  21. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
  22. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
  23. 2025Video World Models with Long-term Spatial Memorycited by 136
  24. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
  25. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
  26. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
  27. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
  28. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
  29. 2020Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Imagecited by 77
  30. 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 62
  31. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  32. 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 51
  33. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  34. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
  35. 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
  36. 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
  37. 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
  38. 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 29; 2026: 65.

94 papers.

Sort:

By area:

  1. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  2. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
  3. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
  4. 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
  5. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  6. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
  7. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  8. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
  9. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
  10. 2025Unified Camera Positional Encoding for Controlled Video Generationcited by 37
  11. 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
  12. 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videoscited by 31
38 more
  1. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
  2. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 28
  3. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 26
  4. 2025DA2: Depth Anything in Any Directioncited by 25
  5. 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
  6. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
  7. 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 21
  8. 2025EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memorycited by 20
  9. 2025X-Streamer: Unified Human World Modeling with Audiovisual Interactioncited by 18
  10. 2026Fast Autoregressive Video Diffusion and World Models with Temporal Cache Compression and Sparse Attentioncited by 18
  11. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
  12. 2025Omni-View: Unlocking How Generation Facilitates Understanding in Unified 3D Model based on Multiview imagescited by 17
  13. 2026Wonder: Video World Model Done Bettercited by 15
  14. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
  15. 2026Code World Model: Coding Agent as World Braincited by 14
  16. 2025Reinforcement Learning with Inverse Rewards for World Model Post-trainingcited by 13
  17. 2025KlingAvatar 2.0 Technical Reportcited by 13
  18. 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
  19. 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
  20. 2025GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generationcited by 11
  21. 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 11
  22. 2026Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Modelscited by 11
  23. 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routingcited by 10
  24. 2026ReWorld: An Interactive World Model with Long-Horizon Memorycited by 10
  25. 2026PerpetualWonder: Long-Horizon Action-Conditioned 4D Scene Generationcited by 9
  26. 2025TRELLISWorld: Training-Free World Generation from Object Generatorscited by 8
  27. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
  28. 2026Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planningcited by 8
  29. 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 8
  30. 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
  31. 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
  32. 2026InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Modelcited by 7
  33. 2026Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generationcited by 7
  34. 2026Compression and Retrieval: Implicit Memory Retrieval for Video World Modelscited by 6
  35. 2025From Orbit to Ground: Generative City Photogrammetry from Extreme Off-Nadir Satellite Imagescited by 5
  36. 2026Imagine a City: CityGenAgent for Procedural 3D City Generationcited by 5
  37. 2026EgoCS-400K: An Egocentric Gameplay Dataset for World Modelscited by 5
  38. 2026A Definition and Roadmap for World Modelscited by 5

50 most cited of 94 All 94 (JSON)