Perspective-aware 3D Gaussian Inpainting with Multi-view Consistency
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D Gaussian inpainting, a critical technique for numerous applications in virtual reality and multimedia, has made significant progress with pretrained diffusion models. However, ensuring multi-view consistency, an essential requirement for high-quality inpainting, remains a key challenge. In this work, we present PAInpainter, a novel approach designed to advance 3D Gaussian inpainting by leveraging perspective-aware content propagation and consistency verification across multi-view inpainted images. Our method iteratively refines inpainting and optimizes the 3D Gaussian representation with multiple views adaptively sampled from a perspective graph. By propagating inpainted images as prior information and verifying consistency across neighboring views, PAInpainter substantially enhances global consistency and texture fidelity in restored 3D scenes. Extensive experiments demonstrate the superiority of PAInpainter over existing methods. Our approach achieves superior 3D inpainting quality, with PSNR scores of 26.03 dB and 29.51 dB on the SPIn-NeRF and NeRFiller datasets, respectively, highlighting its effectiveness and generalization capability.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 56 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
39 of 56 references.
Closest ancestors · 10
Same direction, newest first
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr
- 2024Taming Latent Diffusion Model for Neural Radiance Field Inpainting15 Apr
- 2023Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inpainting with Generative Diffusion Models30 Dec
- 2023Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion6 Dec
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
- 20223D Neural Field Generation using Triplane Diffusion30 Nov
- 2022Novel View Synthesis with Diffusion Models6 Oct
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Neural Discrete Representation Learningcited by 4,650
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
17 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2014Learning Fine-grained Image Similarity with Deep Rankingcited by 189
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25
- 2024View-consistent Object Removal in Radiance Fieldscited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch
- 2025Visibility-Uncertainty-guided 3D Gaussian Inpainting via Scene Conceptional Learning
- 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
- 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpainting
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors
- 2024MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior
- 2024Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Model
- 2025Geometry-Aware Diffusion Models for Multiview Scene Inpainting