GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has achieved remarkable success in novel view synthesis; however, reconstructions under sparse views often exhibit noticeable artifacts. While recent video diffusion models provide strong spatio-temporal priors for 3DGS restoration, directly fine-tuning them for restoration is suboptimal, as they lack awareness of the underlying multi-camera geometry, resulting in multi-view inconsistencies. In this work, we propose a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction. Specifically, we construct a large-scale 3DGS video dataset to enable specialized fine-tuning. To bridge the gap between 2D video generation and 3D multi-view constraints, we introduce a camera-conditioned geometric prior. By using the first and last frames as boundary anchors and encoding the corresponding camera relationships, we explicitly inject spatial structure into the video generation pipeline. This boundary-anchored, camera-aware prior guides the network toward geometrically grounded restoration that remains coherent across viewpoints. Extensive experiments show that, among video-prior restoration methods, our approach attains the best pixel- and structure-level fidelity (PSNR/SSIM) and improves multi-view consistency, while remaining competitive in perceptual quality (LPIPS).
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 47 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
39 of 47 references.
Closest ancestors · 9
Same direction, newest first
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug
- 2025DreamJourney: Perpetual View Generation with Video Diffusion Models21 Jun
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
- 20243DEnhancer: Consistent Multi-View Diffusion for 3D Enhancement24 Dec
- 2024How to Use Diffusion Priors under Sparse Views?3 Dec
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors21 Oct
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 30
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
18 more
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
- 20243D Gaussian as a New Era: A Surveycited by 102
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussianscited by 62
- 2025S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splattingcited by 24
- 20253D Gaussian Inpainting with Depth-Guided Cross-View Consistencycited by 23
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 17
- 2025AD-GS: Alternating Densification for Sparse-Input 3D Gaussian Splattingcited by 8
- 2024MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fieldscited by 6
- 20254DSloMo: 4D Reconstruction for High Speed Scene with Asynchronous Capturecited by 6
- 2026GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generatorcited by 6
- 2025StructGS: Adaptive Spherical Harmonics and Rendering Enhancements for Superior 3D Gaussian Splattingcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 20264DGS-Fixer: Generative Sparse-View 4D Gaussian Splatting with Iterative Refinement Guided by Video Diffusion Priors
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors
- 2026VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2025Diffusion-Guided Gaussian Splatting for Large-Scale Unconstrained 3D Reconstruction and Novel View Synthesis