Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractors
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have severe impact on the rendering quality as they get represented as view-dependent effects or result in floating artifacts. Our goal is to identify and ignore such distractors during the 3D Gaussian optimization to obtain a clean reconstruction. To this end, we take a self-supervised approach that looks at the image residuals during the optimization to determine areas that have likely been falsified by a distractor. In addition, we leverage a pretrained segmentation network to provide object awareness, enabling more accurate exclusion of distractors. This way, we obtain segmentation masks of distractors to effectively ignore them in the loss formulation. We demonstrate that our approach is robust to various distractors and strongly improves rendering quality on distractor-polluted scenes, improving PSNR by 1.86dB compared to 3D Gaussian Splatting.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 21 Aug 2024.
Builds on
32 of 37 references.
References · 32
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
20 more
- 2020Neural Sparse Voxel Fieldscited by 959
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2021Urban Radiance Fieldscited by 263
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 8.
14 papers.
Sort:
- 2024DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstructioncited by 25
- 2024T-3DGS: Removing Transient Objects for 3D Scene Reconstructioncited by 13
- 2025RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGScited by 10
- 2024Distractor-free Generalizable 3D Gaussian Splattingcited by 8
- 2025GeoSplat: A Deep Dive into Geometry-Constrained Gaussian Splattingcited by 1
- 2025Rad-GS: Radar-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environmentscited by 0
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videoscited by 0
- 2026Sparse View Distractor-Free Gaussian Splattingcited by 0
- 20263DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classificationcited by 0
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstructioncited by 0
- 2026DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesiscited by 0
- 2026HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonizationcited by 0
2 more
- 2026Robust Multimodal Dynamic Object Segmentation20 Jul 2026
- 2026SSA-3DGS: Unsupervised Removal of Screen-Space Artifacts for 3D Gaussian Splatting6 Jul 2026
- 2026HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonization13 May 2026
- 2026DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis15 Apr 2026
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction6 Apr 2026
- 20263DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classification8 Mar 2026
- 2026Sparse View Distractor-Free Gaussian Splatting2 Mar 2026
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos24 Feb 2026
- 2025Rad-GS: Radar-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environments20 Nov 2025
- 2025GeoSplat: A Deep Dive into Geometry-Constrained Gaussian Splatting5 Sep 2025
- 2025RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGS3 Jun 2025
- 2024DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstruction27 Dec 2024
2 more
- 2024T-3DGS: Removing Transient Objects for 3D Scene Reconstruction29 Nov 2024
- 2024Distractor-free Generalizable 3D Gaussian Splatting26 Nov 2024
- 2024DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstructioncited by 25
- 2024T-3DGS: Removing Transient Objects for 3D Scene Reconstructioncited by 13
- 2025RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGScited by 10
- 2024Distractor-free Generalizable 3D Gaussian Splattingcited by 8
- 2025GeoSplat: A Deep Dive into Geometry-Constrained Gaussian Splattingcited by 1
- 2025Rad-GS: Radar-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environmentscited by 0
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videoscited by 0
- 2026Sparse View Distractor-Free Gaussian Splattingcited by 0
- 20263DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classificationcited by 0
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstructioncited by 0
- 2026DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesiscited by 0
- 2026HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonizationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Robust Multimodal Dynamic Object Segmentation20 Jul 2026
- 2026SSA-3DGS: Unsupervised Removal of Screen-Space Artifacts for 3D Gaussian Splatting6 Jul 2026
- 2026HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonization13 May 2026
- 2026DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis15 Apr 2026
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction6 Apr 2026
- 20263DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classification8 Mar 2026
- 2026Sparse View Distractor-Free Gaussian Splatting2 Mar 2026
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos24 Feb 2026
- 2025Rad-GS: Radar-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environments20 Nov 2025
- 2025GeoSplat: A Deep Dive into Geometry-Constrained Gaussian Splatting5 Sep 2025
- 2025RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGS3 Jun 2025
- 2024DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstruction27 Dec 2024
12 newest of 14 All 14 (JSON)