Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion
Not on the map. Why?
Abstract (arXiv)
Given just a few glimpses of a scene, can you imagine the movie playing out as the camera glides through it? That's the lens we take on sparse-input novel view synthesis, not only as filling spatial gaps between widely spaced views, but also as completing a natural video unfolding through space. We recast the task as test-time natural video completion, using powerful priors from pretrained video diffusion models to hallucinate plausible in-between views. Our zero-shot, generation-guided framework produces pseudo views at novel camera poses, modulated by an uncertainty-aware mechanism for spatial coherence. These synthesized frames densify supervision for 3D Gaussian Splatting (3D-GS) for scene reconstruction, especially in under-observed regions. An iterative feedback loop lets 3D geometry and 2D view synthesis inform each other, improving both the scene reconstruction and the generated views. The result is coherent, high-fidelity renderings from sparse inputs without any scene-specific training or fine-tuning. On LLFF, DTU, DL3DV, and MipNeRF-360, our method significantly outperforms strong 3D-GS baselines under extreme sparsity.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 57 of its 67 references that are in the map. First posted on arXiv 22 Nov 2025.
Builds on
57 of 67 references.
References · 57
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023Universal Guidance for Diffusion Modelscited by 426
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2023DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Modelscited by 127
- 2024Training-free Camera Control for Video Generationcited by 119
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2024CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussianscited by 62
- 2023Urban Radiance Field Representation with Deformable Neural Mesh Primitivescited by 55
- 2023GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistencycited by 54
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Simcited by 1
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priorscited by 0
- 2026Dynamic-Robust Photometric-Semantic Reconstruction for Open-Vocabulary 3D Scene Understandingcited by 0
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesiscited by 0
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis27 Sep 2026
- 2026Dynamic-Robust Photometric-Semantic Reconstruction for Open-Vocabulary 3D Scene Understanding29 Aug 2026
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors24 Aug 2026
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Sim7 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026FrameCrafter: Novel View Synthesis as Video Completion
- 2026RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction