mlsanityData to 7 Oct 2026

NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer

arXiv 2405.15364 ↗First posted 24 May 2024cs.CVcited by 79

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

By harnessing the potent generative capabilities of pre-trained large video diffusion models, we propose NVS-Solver, a new novel view synthesis (NVS) paradigm that operates textitwithout the need for training. NVS-Solver adaptively modulates the diffusion sampling process with the given views to enable the creation of remarkable visual experiences from single or multiple views of static scenes or monocular videos of dynamic scenes. Specifically, built upon our theoretical modeling, we iteratively modulate the score function with the given scene priors represented with warped input views to control the video diffusion process. Moreover, by theoretically exploring the boundary of the estimation error, we achieve the modulation in an adaptive fashion according to the view pose and the number of diffusion steps. Extensive evaluations on both static and dynamic scenes substantiate the significant superiority of our NVS-Solver over state-of-the-art methods both quantitatively and qualitatively. textit Source code in hrefhttps://github.com/ZHU-Zhiyu/NVSSolverhttps://github.com/ZHU-Zhiyu/NVS_Solver.

Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 71 of its 87 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

71 of 87 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  2. 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
  3. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image27 Oct
  4. 2023Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views27 Aug
  5. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields19 May
  6. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models21 Apr
  7. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
  8. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr
  9. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
  10. 20233D-aware Image Generation using 2D Diffusion Models31 Mar
  11. 2023Consistent View Synthesis with Pose-Guided Diffusion Models30 Mar
  12. 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models22 Nov
1 more
  1. 2022Novel View Synthesis with Diffusion Models6 Oct

Other references · 58

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2022Video Diffusion Modelscited by 2,280
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
38 more
  1. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  4. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  8. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  10. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  11. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  12. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  13. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  14. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  15. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  16. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  17. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  18. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
  19. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  20. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  21. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
  22. 2020State of the Art on Neural Renderingcited by 276
  23. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  24. 2020Free View Synthesiscited by 231
  25. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 180
  26. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
  27. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
  28. 2016View Synthesis by Appearance Flowcited by 172
  29. 2020Stable View Synthesiscited by 165
  30. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
  31. 2017A Survey of Structure from Motioncited by 157
  32. 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 153
  33. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  34. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  35. 2022Riemannian Diffusion Modelscited by 120
  36. 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
  37. 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 99
  38. 2018Extreme View Synthesiscited by 94

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 35; 2026: 34.

79 papers.

Sort:

By area:

  1. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  2. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  3. 2025Controllable Video Generation: A Surveycited by 93
  4. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  5. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  6. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  7. 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
  8. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  9. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
  10. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
  11. 2024Novel View Extrapolation with Video Diffusion Priorscited by 23
  12. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
38 more
  1. 2025Generative Video Motion Editing with 3D Point Trackscited by 21
  2. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20
  3. 2025Positional Encoding Fieldcited by 20
  4. 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusioncited by 19
  5. 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 19
  6. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 18
  7. 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preferencecited by 17
  8. 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observationscited by 16
  9. 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusioncited by 15
  10. 2026Vista4D: Video Reshooting with 4D Point Cloudscited by 15
  11. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  12. 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videoscited by 14
  13. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 14
  14. 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videoscited by 13
  15. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  16. 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 11
  17. 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 11
  18. 2025Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Viewscited by 11
  19. 2025Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpaintingcited by 11
  20. 2025Light-X: Generative 4D Video Rendering with Camera and Illumination Controlcited by 11
  21. 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 10
  22. 2026LaVR: Scene Latent Conditioned Generative Video Trajectory Re-Rendering using Large 4D Reconstruction Modelscited by 10
  23. 2024Semantic Score Distillation Sampling for Compositional Text-to-3D Generationcited by 9
  24. 2025High-Fidelity Novel View Synthesis via Splatting-Guided Diffusioncited by 9
  25. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Modelscited by 7
  26. 2025InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problemcited by 6
  27. 2025Flash Sculptor: Modular 3D Worlds from Objectscited by 5
  28. 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completioncited by 4
  29. 2025DriveVGGT: Calibration-Constrained Visual Geometry Transformers for Multi-Camera Autonomous Drivingcited by 4
  30. 2025OmniView: An All-Seeing Diffusion Model for 3D and 4D View Synthesiscited by 4
  31. 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstructioncited by 4
  32. 2026Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Videocited by 4
  33. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
  34. 2025F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Aggregative Gaussian Splattingcited by 3
  35. 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editingcited by 3
  36. 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
  37. 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformerscited by 3
  38. 2025Acc3D: Accelerating Single Image to 3D Diffusion Models via Edge Consistency Guided Score Distillationcited by 2

50 most cited of 79 All 79 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  2. 2025DT-NVS: Diffusion Transformers for Novel View Synthesis
  3. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models
  4. 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videos
  5. 2024Novel View Synthesis with Pixel-Space Diffusion Models
  6. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis
  7. 2026OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis
  8. 2026FrameCrafter: Novel View Synthesis as Video Completion