SparseGS: Sparse View Synthesis using 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has recently enabled real-time rendering of unbounded 3D scenes for novel view synthesis. However, this technique requires dense training views to accurately reconstruct 3D geometry. A limited number of input views will significantly degrade reconstruction quality, resulting in artifacts such as "floaters" and "background collapse" at unseen viewpoints. In this work, we introduce SparseGS, an efficient training pipeline designed to address the limitations of 3DGS in scenarios with sparse training views. SparseGS incorporates depth priors, novel depth rendering techniques, and a pruning heuristic to mitigate floater artifacts, alongside an Unseen Viewpoint Regularization module to alleviate background collapses. Our extensive evaluations on the Mip-NeRF360, LLFF, and DTU datasets demonstrate that SparseGS achieves high-quality reconstruction in both unbounded and forward-facing scenarios, with as few as 12 and 3 input images, respectively, while maintaining fast training and real-time rendering capabilities.
Key facts. Cited by 134 papers in the map (data through 7 Oct 2026). Builds on 37 of its 55 references that are in the map. First posted on arXiv 30 Nov 2023.
Builds on
37 of 55 references.
References · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
25 more
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2023LDM3D: Latent Diffusion Model for 3Dcited by 53
- 2023NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenescited by 53
- 2022Gravitationally Lensed Black Hole Emission Tomographycited by 22
Built on by
Citing papers per year: 2024: 51; 2025: 63; 2026: 20.
134 papers.
Sort:
By area:
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
38 more
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 40
- 2024On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategycited by 39
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
- 2024360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roamingcited by 35
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 30
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
- 2025Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Imagescited by 25
- 2025S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splattingcited by 24
- 2024MVGamba: Unify 3D Content Generation as State Space Sequence Modelingcited by 23
- 2024Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Camerascited by 22
- 2024SAGS: Structure-Aware 3D Gaussian Splattingcited by 21
- 2025DroneSplat: 3D Gaussian Splatting for Robust 3D Reconstruction from In-the-Wild Drone Imagerycited by 20
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Trainingcited by 18
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 17
- 2024SLGaussian: Fast Language Gaussian Splatting in Sparse Viewscited by 17
- 2025RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priorscited by 17
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splattingcited by 15
- 2024Gaussian Splatting for Efficient Satellite Image Photogrammetrycited by 15
- 2024Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractorscited by 14
- 2024TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Trackscited by 12
- 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splattingcited by 12
- 2025Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Viewscited by 11
- 2025Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpaintingcited by 11
- 2024Few-shot Novel View Synthesis using Depth Aware 3D Gaussian Splattingcited by 10
- 2024UniGaussian: Driving Scene Reconstruction from Multiple Camera Models via Unified Gaussian Representationscited by 10
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
- 2024SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstructioncited by 10
- 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesiscited by 10
- 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localizationcited by 10
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Priorcited by 10
- 2024Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstructioncited by 8
- 2024Aquatic-GS: A Hybrid 3D Representation for Underwater Scenescited by 8
- 2024SPARS3R: Semantic Prior Alignment and Regularization for Sparse 3D Reconstructioncited by 8
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priorscited by 8
50 most cited of 134 All 134 (JSON)
- 2026What Do Scan-Derived Class Prototypes Add? Disentangling Supervision, Prototype Content and Query Protocol in Recognition over Frozen Foundation Features3 Sep 2026
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors22 Aug 2026
- 2026Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction20 Aug 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2026Improving Sparse-View 3DGS Generalization via Flat Minima Optimization1 Jul 2026
- 2026AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings30 Jun 2026
- 2026KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis2 Jun 2026
- 2026FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views28 May 2026
- 2026PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting12 May 2026
- 2026Generalizable Sparse-View 3D Reconstruction from Unconstrained Images30 Apr 2026
- 2026Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction26 Apr 2026
- 2026DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures23 Apr 2026
38 more
- 2026GSCompleter: A Distillation-Free Plugin for Metric-Aware 3D Gaussian Splatting Completion in Seconds22 Apr 2026
- 2026In Depth We Trust: Reliable Monocular Depth Supervision for Gaussian Splatting7 Apr 2026
- 2026F4Splat: Feed-Forward Predictive Densification for Feed-Forward 3D Gaussian Splatting22 Mar 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2026Language and Geometry Grounded Sparse Voxel Representations for Holistic Scene Understanding17 Feb 2026
- 2026Pi-GS: Sparse-View Gaussian Splatting with Dense π3 Initialization3 Feb 2026
- 2026ShadowGS: Shadow-Aware 3D Gaussian Splatting for Satellite Imagery4 Jan 2026
- 2025G3Splat: Geometrically Consistent Generalizable Gaussian Splatting19 Dec 2025
- 2025COSMOS: Coherent Supergaussian Modeling with Spatial Priors for Sparse-View 3D Splatting17 Dec 2025
- 2025CLAIM: Camera-LiDAR Alignment with Intensity and Monodepth16 Dec 2025
- 2025GAINS: Gaussian-based Inverse Rendering from Sparse Multi-View Captures10 Dec 2025
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion22 Nov 2025
- 2025SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting21 Nov 2025
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splatting20 Nov 2025
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policies2 Nov 2025
- 2025D2GS: Dense Depth Regularization for LiDAR-free Urban Scene Reconstruction29 Oct 2025
- 2025Gen-LangSplat: Generalized Language Gaussian Splatting with Pre-Trained Feature Compression27 Oct 2025
- 2025Initialize to Generalize: A Stronger Initialization Pipeline for Sparse-View 3DGS20 Oct 2025
- 2025Scene Coordinate Reconstruction Priors14 Oct 2025
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior14 Oct 2025
- 2025Opacity-Gradient Driven Density Control for Compact and Efficient Few-Shot 3D Gaussian Splatting11 Oct 2025
- 2025Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting11 Oct 2025
- 2025XYZCylinder: Towards Compatible Feed-Forward 3D Gaussian Splatting for Driving Scenes via Unified Cylinder Lifting Method9 Oct 2025
- 2025AlignGS: Aligning Geometry and Semantics for Robust Indoor Reconstruction from Sparse Views9 Oct 2025
- 2025FSFSplatter: Build Surface and Novel Views with Sparse-Views within 2min3 Oct 2025
- 2025OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splatting27 Sep 2025
- 2025MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild19 Sep 2025
- 2025Segmentation-Driven Initialization for Sparse-view 3D Gaussian Splatting15 Sep 2025
- 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splatting18 Aug 2025
- 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactions6 Aug 2025
- 2025DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splatting6 Aug 2025
- 2025LT-Gaussian: Long-Term Map Update Using 3D Gaussian Splatting for Autonomous Driving3 Aug 2025
- 2025I2V-GS: Infrastructure-to-Vehicle View Transformation with Gaussian Splatting for Autonomous Driving Data Generation31 Jul 2025
- 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localization31 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025DWTGS: Rethinking Frequency Regularization for Sparse-view 3D Gaussian Splatting21 Jul 2025
- 2025SurfaceSplat: Connecting Surface Reconstruction and Gaussian Splatting21 Jul 2025
50 newest of 134 All 134 (JSON)
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
- 2024MVGamba: Unify 3D Content Generation as State Space Sequence Modelingcited by 23
- 2025RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priorscited by 17
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Priorcited by 10
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priorscited by 8
- 2024How to Use Diffusion Priors under Sparse Views?cited by 8
- 2024Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priorscited by 7
- 2024ScalingGaussian: Enhancing 3D Content Creation with Generative Gaussian Splattingcited by 6
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policiescited by 2
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splattingcited by 2
12 most cited of 15 All 15 (JSON)
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors22 Aug 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2025GAINS: Gaussian-based Inverse Rendering from Sparse Multi-View Captures10 Dec 2025
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policies2 Nov 2025
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior14 Oct 2025
- 2025OGGSplat: Open Gaussian Growing for Generalizable Reconstruction with Expanded Field-of-View5 Jun 2025
- 2025RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priors13 Mar 2025
- 2024How to Use Diffusion Priors under Sparse Views?3 Dec 2024
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors24 Nov 2024
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors5 Sep 2024
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model29 Aug 2024
- 2024ScalingGaussian: Enhancing 3D Content Creation with Generative Gaussian Splatting26 Jul 2024
12 newest of 15 All 15 (JSON)
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
- 2024UniGaussian: Driving Scene Reconstruction from Multiple Camera Models via Unified Gaussian Representationscited by 10
- 2025Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructionscited by 6
- 2025Martian World Model: Controllable Video Synthesis with Physically Accurate 3D Reconstructions10 Jul 2025
- 2024UniGaussian: Driving Scene Reconstruction from Multiple Camera Models via Unified Gaussian Representations22 Nov 2024
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior29 Mar 2024
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
12 most cited of 115 All 115 (JSON)
- 2026What Do Scan-Derived Class Prototypes Add? Disentangling Supervision, Prototype Content and Query Protocol in Recognition over Frozen Foundation Features3 Sep 2026
- 2026Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction20 Aug 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2026Improving Sparse-View 3DGS Generalization via Flat Minima Optimization1 Jul 2026
- 2026AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings30 Jun 2026
- 2026KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis2 Jun 2026
- 2026FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views28 May 2026
- 2026PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting12 May 2026
- 2026Generalizable Sparse-View 3D Reconstruction from Unconstrained Images30 Apr 2026
- 2026Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction26 Apr 2026
- 2026DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures23 Apr 2026
- 2026GSCompleter: A Distillation-Free Plugin for Metric-Aware 3D Gaussian Splatting Completion in Seconds22 Apr 2026
12 newest of 115 All 115 (JSON)