SplatFill: 3D Scene Inpainting via Depth-Guided Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has enabled the creation of highly realistic 3D scene representations from sets of multi-view images. However, inpainting missing regions, whether due to occlusion or scene editing, remains a challenging task, often leading to blurry details, artifacts, and inconsistent geometry. In this work, we introduce SplatFill, a novel depth-guided approach for 3DGS scene inpainting that achieves state-of-the-art perceptual quality and improved efficiency. Our method combines two key ideas: (1) joint depth-based and object-based supervision to ensure inpainted Gaussians are accurately placed in 3D space and aligned with surrounding geometry, and (2) we propose a consistency-aware refinement scheme that selectively identifies and corrects inconsistent regions without disrupting the rest of the scene. Evaluations on the SPIn-NeRF dataset demonstrate that SplatFill not only surpasses existing NeRF-based and 3DGS-based inpainting methods in visual fidelity but also reduces training time by 24.5%. Qualitative results show our method delivers sharper details, fewer artifacts, and greater coherence across challenging viewpoints.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
25 of 37 references.
References · 25
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
13 more
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
- 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
- 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2024MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Priorcited by 24
- 2024Contrastive Gaussian Clustering: Weakly Supervised 3D Scene Segmentationcited by 22
- 2024RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpaintingcited by 21
- 2024Taming Latent Diffusion Model for Neural Radiance Field Inpaintingcited by 20
- 2023InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fieldscited by 16
- 2023Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusioncited by 13
- 2025Geometry-Aware Diffusion Models for Multiview Scene Inpaintingcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.