Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenes
Not on the map. Why?
Abstract (arXiv)
Despite recent advances in single-object front-facing inpainting using NeRF and 3D Gaussian Splatting (3DGS), inpainting in complex 360deg scenes remains largely underexplored. This is primarily due to three key challenges: (i) identifying target objects in the 3D field of 360deg environments, (ii) dealing with severe occlusions in multi-object scenes, which makes it hard to define regions to inpaint, and (iii) maintaining consistent and high-quality appearance across views effectively. To tackle these challenges, we propose Inpaint360GS, a flexible 360deg editing framework based on 3DGS that supports multi-object removal and high-fidelity inpainting in 3D space. By distilling 2D segmentation into 3D and leveraging virtual camera views for contextual guidance, our method enables accurate object-level editing and consistent scene completion. We further introduce a new dataset tailored for 360deg inpainting, addressing the lack of ground truth object-free scenes. Experiments demonstrate that Inpaint360GS outperforms existing baselines and achieves state-of-the-art performance. Project page: https://dfki-av.github.io/inpaint360gs/
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 57 of its 67 references that are in the map. First posted on arXiv 9 Nov 2025.
Builds on
57 of 67 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2023Segment Everything Everywhere All at Oncecited by 548
38 more
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2023Segment and Track Anythingcited by 193
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2023Segment Any 3D Gaussianscited by 161
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023SAM3D: Segment Anything in 3D Scenescited by 157
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2023Real-Time Flying Object Detection with YOLOv8cited by 94
- 2022High-Quality Entity Segmentationcited by 93
- 2023Neural Point Catacaustics for Novel-View Synthesis of Reflectionscited by 82
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023SNI-SLAM: Semantic Neural Implicit SLAMcited by 65
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2023Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Modelscited by 61
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
- 2022A Generalized Framework for Video Instance Segmentationcited by 53
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
- 2024Gaga: Group Any Gaussians via 3D-aware Memory Bankcited by 41
- 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
- 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
- 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
- 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
- 2024UniVS: Unified and Universal Video Segmentation with Prompts as Queriescited by 27
- 2023Mask Propagation for Efficient Video Semantic Segmentationcited by 26
- 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25
- 2024MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Priorcited by 24
- 20253D Gaussian Inpainting with Depth-Guided Cross-View Consistencycited by 24
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 22
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026ReLaGS: Relational Language Gaussian Splattingcited by 6
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesiscited by 3
- 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenescited by 2
- 2026JOPP-3D: Joint Open Vocabulary Semantic Segmentation on Point Clouds and Panoramascited by 1
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Spacecited by 1
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Spacecited by 1
- 2026Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenescited by 0
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priorscited by 0
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors29 Sep 2026
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space11 Jun 2026
- 2026Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenes29 May 2026
- 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes15 May 2026
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space1 May 2026
- 2026ReLaGS: Relational Language Gaussian Splatting18 Mar 2026
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis16 Mar 2026
- 2026JOPP-3D: Joint Open Vocabulary Semantic Segmentation on Point Clouds and Panoramas6 Mar 2026