VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Gaussian Splatting has achieved remarkable progress in multi-view surface reconstruction, yet it exhibits notable degradation when only few views are available. Although recent efforts alleviate this issue by enhancing multi-view consistency to produce plausible surfaces, they struggle to infer unseen, occluded, or weakly constrained regions beyond the input coverage. To address this limitation, we present VidSplat, a training-free generative reconstruction framework that leverages powerful video diffusion priors to iteratively synthesize novel views that compensate for missing input coverage, and thereby recover complete 3D scenes from sparse inputs. Specifically, we tackle two key challenges that enable the effective integration of generation and reconstruction. First, for 3D consistent generation, we elaborate a training-free, stage-wise denoising strategy that adaptively guides the denoising direction toward the underlying geometry using the rendered RGB and mask images. Second, to enhance the reconstruction, we develop an iterative mechanism that samples camera trajectories, explores unobserved regions, synthesizes novel views, and supplements training through confidence weighted refinement. VidSplat performs robustly to sparse input and even a single image. Extensive experiments on widely used benchmarks demonstrate our superior performance in sparse-view scene reconstruction.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 47 of its 73 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
47 of 73 references.
Closest ancestors · 9
Same direction, newest first
- 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance7 Apr
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior14 Oct
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splatting20 Aug
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion11 Mar
- 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generation10 Oct
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec
Other references · 38
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
26 more
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2024Training-free Camera Control for Video Generationcited by 122
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 61
- 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 31
- 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
- 2025OmniSync: Towards Universal Lip Synchronization via Diffusion Transformerscited by 27
- 2025Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Viewscited by 26
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 23
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 23
- 2023S-VolSDF: Sparse Multi-View Stereo Regularization of Neural Implicit Surfacescited by 21
- 2024MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Viewscited by 21
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2024Bracket Diffusion: HDR Image Generation by Consistent LDR Denoisingcited by 15
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 2025Sparis: Neural Implicit Surface Reconstruction of Indoor Scenes from Sparse Viewscited by 9
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2025VA-GS: Enhancing the Geometric Representation of Gaussian Splatting via View Alignmentcited by 6
- 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
- 2025PFF-Net: Patch Feature Fitting for Point Cloud Normal Estimationcited by 3
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstructioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
- 2024DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models
- 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given