mlsanityData to 14 Oct 2026

OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping

arXiv 2609.03919 ↗First posted 3 Sep 2026cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present OctWorld, a video diffusion framework with persistent 3D memory for generating explorable, world-consistent, and high-fidelity visual scenes. Given a single image, OctWorld performs stable autoregressive world generation along user-specified camera trajectories. We focus on long-range generation, characterized by extended camera paths and wide viewpoint coverage, where preserving spatial consistency is particularly challenging when previously generated regions are revisited. To address this problem, we introduce OctMap, an extensible and spatially adaptive 3D memory that progressively fuses generated visual observations and their corresponding depth maps into a global representation. OctMap employs TSDF fusion within a dynamic sparse octree whose spatial resolution adapts to image evidence. This design preserves geometric and appearance details across diverse scene scales while maintaining low memory overhead. Experiments demonstrate that OctWorld generates long-range, spatially consistent videos and outperforms prior methods on both existing benchmarks and challenging long-range generation settings. OctMap also provides clear advantages over point-based caches and fixed-resolution TSDF volumes. Project page: https://maxtirerror.github.io/octworldpage/

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 51 of its 59 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

51 of 59 references.

Closest ancestors · 7

Same direction, newest first

  1. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy18 Aug
  2. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation4 Jun
  3. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
  4. 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec
  5. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec
  6. 2024World-consistent Video Diffusion with Explicit 3D Modeling2 Dec
  7. 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting30 Apr

Other references · 44

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
32 more
  1. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  2. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  3. 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 336
  4. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  5. 2024Diffusion Models Are Real-Time Game Enginescited by 296
  6. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  7. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  8. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  9. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  10. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
  11. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  12. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  13. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  14. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 165
  15. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  16. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  17. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  18. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  19. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  20. 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
  21. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  22. 2025Aether: Geometric-Aware Unified World Modelingcited by 97
  23. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  24. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  25. 2025Kwai Keye-VL 1.5 Technical Reportcited by 73
  26. 2025DeepVerse: 4D Autoregressive Video Generation as a World Modelcited by 40
  27. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
  28. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
  29. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
  30. 2024GSFusion: Online RGB-D Mapping Where Gaussian Splatting Meets TSDF Fusioncited by 20
  31. 2020Multi-Resolution 3D Mapping with Explicit Free Space Representation for Fast and Accurate Mobile Robot Motion Planningcited by 8
  32. 2025Resolution Where It Counts: Hash-based GPU-Accelerated 3D Reconstruction via Variance-Adaptive Voxel Gridscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling
  2. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion
  3. 2025WorldWarp: Propagating 3D Geometry with Asynchronous Video Diffusion
  4. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  5. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  6. 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generation
  7. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
  8. 2025DreamJourney: Perpetual View Generation with Video Diffusion Models