mlsanityData to 14 Oct 2026

A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation

arXiv 2508.09977 ↗First posted 13 Aug 2025cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radiance Field (NeRF), enabling high-fidelity photorealistic rendering in real time. Beyond novel view synthesis, the explicit and compact nature of 3DGS enables a wide range of downstream applications that require geometric and semantic understanding. This survey provides a comprehensive overview of recent progress in 3DGS applications. It first reviews the reconstruction preliminaries of 3DGS, followed by the problem formulation, 2D foundation models, and related NeRF-based research areas that inform downstream 3DGS applications. We then categorize 3DGS applications into three foundational tasks: segmentation, editing, and generation, alongside additional functional applications built upon or tightly coupled with these foundational capabilities. For each, we summarize representative methods, supervision strategies, and learning paradigms, highlighting shared design principles and emerging trends. Commonly used datasets and evaluation protocols are also summarized, along with comparative analyses of recent methods across public benchmarks. To support ongoing research and development, a continually updated repository of papers, code, and resources is maintained at https://github.com/heshuting555/Awesome-3DGS-Applications.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 370 of its 429 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

370 of 429 references.

References · 370

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2023Segment Anythingcited by 8,234
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2023Visual Instruction Tuningcited by 7,869
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  11. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  12. 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
  1. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  13. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  14. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  15. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  16. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  17. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  18. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  19. 2020Point Transformercited by 1,470
  20. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  21. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  22. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  23. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  24. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  25. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  26. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  27. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  28. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  29. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  30. 2018Panoptic Segmentationcited by 802
  31. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  32. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  33. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  34. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  35. 2022Language-driven Semantic Segmentationcited by 717
  36. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  37. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  38. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684

50 most cited of 370 All 370 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 14.

19 papers.

Sort:

By area:

  1. 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
  2. 2025Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modelingcited by 6
  3. 2025Free-Form Scene Editor: Enabling Multi-Round Object Manipulation like in a 3D Enginecited by 3
  4. 2025Segment Anything Across Shots: A Method and Benchmarkcited by 3
  5. 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 2
  6. 2026FIND: A Simple yet Effective Baseline for Diffusion-Generated Image Detectioncited by 2
  7. 2026Radiant Foam Rendering on a Graph Processorcited by 1
  8. 20263D-DRES: Detailed 3D Referring Expression Segmentationcited by 1
  9. 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 1
  10. 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimizationcited by 0
  11. 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priorscited by 0
  12. 2026NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentationcited by 0
7 more
  1. 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representationscited by 0
  2. 20263DEditSafe: Defending 3D Editing Pipelines from Unsafe Generationcited by 0
  3. 2026Meshless Domain Randomization via Explicit Parameter Perturbation of 3D Gaussian Splattingcited by 0
  4. 2026VCAR: Training-Free 3DGS Segmentation via View Completeness and Axis-Aware Boundary Refinementcited by 0
  5. 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbationscited by 0
  6. 2026Hybrid Gaussians for Robust Open-Vocabulary 3D Segmentation with Multi-View Object Association and Boundary Refinementcited by 0
  7. 2026Visibility-Guided Structured Measure Flow for Class-Conditioned 3D Gaussian Generationcited by 0