WorldWarp: Propagating 3D Geometry with Asynchronous Video Diffusion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Generating long-range, geometrically consistent video presents a fundamental dilemma: while consistency demands strict adherence to 3D geometry in pixel space, state-of-the-art generative models operate most effectively in a camera-conditioned latent space. This disconnect causes current methods to struggle with occluded areas and complex camera trajectories. To bridge this gap, we propose WorldWarp, a framework that couples a 3D structural anchor with a 2D generative refiner. To establish geometric grounding, WorldWarp maintains an online 3D geometric cache built via Gaussian Splatting (3DGS). By explicitly warping historical content into novel views, this cache acts as a structural scaffold, ensuring each new frame respects prior geometry. However, static warping inevitably leaves holes and artifacts due to occlusions. We address this using a Spatio-Temporal Diffusion (ST-Diff) model designed for a "fill-and-revise" objective. Our key innovation is a spatio-temporal varying noise schedule: blank regions receive full noise to trigger generation, while warped regions receive partial noise to enable refinement. By dynamically updating the 3D cache at every step, WorldWarp maintains consistency across video chunks. Consequently, it achieves state-of-the-art fidelity by ensuring that 3D logic guides structure while diffusion logic perfects texture. Project page: hrefhttps://hyokong.github.io/worldwarp-page/https://hyokong.github.io/worldwarp-page/.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 75 of its 82 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
75 of 82 references.
Closest ancestors · 7
Same direction, newest first
- 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis8 Sep
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun
- 2024EscherNet: A Generative Model for Scalable View Synthesis6 Feb
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models21 Apr
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
Other references · 68
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2023Photorealistic Video Generation with Diffusion Modelscited by 306
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2019Scaling Autoregressive Video Modelscited by 190
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2025History-Guided Video Diffusioncited by 171
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2025Test-Time Training Done Rightcited by 130
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 123
- 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2024Rolling Diffusion Modelscited by 104
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 10
- 2026Evolution of Video Generative Foundationscited by 7
- 2026ArtiFixer: Enhancing and Extending 3D Reconstruction with Auto-Regressive Diffusion Modelscited by 6
- 2026DVD: Deterministic Video Depth Estimation with Generative Priorscited by 4
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generationcited by 2
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generationcited by 0
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data1 Jun 2026
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation29 May 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generation24 Mar 2026
- 2026DVD: Deterministic Video Depth Estimation with Generative Priors12 Mar 2026
- 2026ArtiFixer: Enhancing and Extending 3D Reconstruction with Auto-Regressive Diffusion Models28 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
- 2025GeoVideo: Introducing Geometric Regularization into Video Generation Model
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
- 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling