mlsanityData to 7 Oct 2026

Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractors

arXiv 2408.11697 ↗First posted 21 Aug 2024cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have severe impact on the rendering quality as they get represented as view-dependent effects or result in floating artifacts. Our goal is to identify and ignore such distractors during the 3D Gaussian optimization to obtain a clean reconstruction. To this end, we take a self-supervised approach that looks at the image residuals during the optimization to determine areas that have likely been falsified by a distractor. In addition, we leverage a pretrained segmentation network to provide object awareness, enabling more accurate exclusion of distractors. This way, we obtain segmentation masks of distractors to effectively ignore them in the loss formulation. We demonstrate that our approach is robust to various distractors and strongly improves rendering quality on distractor-polluted scenes, improving PSNR by 1.86dB compared to 3D Gaussian Splatting.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 21 Aug 2024.

Builds on

32 of 37 references.

References · 32

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  10. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
20 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  4. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  5. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  6. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  7. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  8. 2023Gaussian Splatting SLAMcited by 410
  9. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  10. 2023Text-to-3D using Gaussian Splattingcited by 299
  11. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  12. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  13. 2021Urban Radiance Fieldscited by 263
  14. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  15. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  16. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
  17. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  18. 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
  19. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  20. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 8.

14 papers.

Sort: