mlsanityData to 7 Oct 2026

UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models

arXiv 2608.04701 ↗First posted 5 Aug 2026cs.CVcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

The abundance of casually captured monocular videos and images on social media provides a valuable source for immersive content creation, where generating novel views from such sparse observations can greatly enhance user experiences. However, producing photorealistic and geometrically consistent views with precise camera control remains challenging when input coverage is extremely limited. Reconstruction-based approaches such as NeRF and 3D Gaussian Splatting (3DGS) deteriorate severely under sparse inputs and fail to explicitly handle occlusions. Generative methods ease data requirements but still struggle with large-baseline view synthesis due to inaccurate or implicit geometric guidance. To overcome these limitations, we introduce UniWorld-View, a unified framework for controllable large-baseline novel view synthesis from monocular inputs. UniWorld-View integrates explicit 3D guidance with generative diffusion modeling to enable precise camera control and geometrically consistent view generation. The geometric guidance is obtained through an occlusion-aware point cloud rendering strategy that resolves visibility ambiguities and provides accurate priors for diffusion-based synthesis. By coupling this rendering strategy with powerful video diffusion backbones, UniWorld-View achieves high-fidelity novel view generation even under extreme camera motions and wide-baseline changes, and can further provide multi-view videos for downstream dynamic 3DGS reconstruction. Experiments on the WorldScore benchmark and zero-shot NVS benchmarks demonstrate the effectiveness of UniWorld-View in controllability, geometric consistency, and visual fidelity.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 114 of its 120 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

114 of 120 references.

Closest ancestors · 20

Same direction, newest first

  1. 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations17 May
  2. 2025VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Step2 Apr
  3. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
  4. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar
  5. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturing21 Dec
  6. 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec
  7. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints10 Dec
  8. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec
  9. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models27 Nov
  10. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
  11. 2024VistaDream: Sampling multiview consistent images for single-view scene reconstruction22 Oct
  12. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
8 more
  1. 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions21 Jul
  2. 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun
  3. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer24 May
  4. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  5. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion10 Apr
  6. 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
  7. 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generation10 Oct
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar

Other references · 94

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
38 more
  1. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  2. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  3. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  8. 2024Depth Anything V2cited by 1,385
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  10. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  12. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  13. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  14. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  15. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  16. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  17. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  18. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  19. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  20. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  21. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  22. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  23. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  24. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  25. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  26. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  27. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  28. 2025VACE: All-in-One Video Creation and Editingcited by 467
  29. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  30. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  31. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  32. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  33. 2022Kubric: A scalable dataset generatorcited by 373
  34. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  35. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  36. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  37. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  38. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286

50 most cited of 94 All 94 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OmniView: An All-Seeing Diffusion Model for 3D and 4D View Synthesis
  2. 2025MV-Performer: Taming Video Diffusion Model for Faithful and Synchronized Multi-view Performer Synthesis
  3. 2025DreamJourney: Perpetual View Generation with Video Diffusion Models
  4. 2023Consistent View Synthesis with Pose-Guided Diffusion Models
  5. 2025Improving Novel view synthesis of 360^circ Scenes in Extremely Sparse Views by Jointly Training Hemisphere Sampled Synthetic Images
  6. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  7. 2026Enhancing Novel View Synthesis via Geometry Grounded Set Diffusion
  8. 2026OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis