A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation
Not on the map. Why?
Abstract (arXiv)
In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radiance Field (NeRF), enabling high-fidelity photorealistic rendering in real time. Beyond novel view synthesis, the explicit and compact nature of 3DGS enables a wide range of downstream applications that require geometric and semantic understanding. This survey provides a comprehensive overview of recent progress in 3DGS applications. It first reviews the reconstruction preliminaries of 3DGS, followed by the problem formulation, 2D foundation models, and related NeRF-based research areas that inform downstream 3DGS applications. We then categorize 3DGS applications into three foundational tasks: segmentation, editing, and generation, alongside additional functional applications built upon or tightly coupled with these foundational capabilities. For each, we summarize representative methods, supervision strategies, and learning paradigms, highlighting shared design principles and emerging trends. Commonly used datasets and evaluation protocols are also summarized, along with comparative analyses of recent methods across public benchmarks. To support ongoing research and development, a continually updated repository of papers, code, and resources is maintained at https://github.com/heshuting555/Awesome-3DGS-Applications.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 370 of its 429 references that are in the map. First posted on arXiv 13 Aug 2025.
Builds on
370 of 429 references.
References · 370
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2016Improved Techniques for Training GANscited by 2,970
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2020Point Transformercited by 1,470
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2018Panoptic Segmentationcited by 802
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2022Language-driven Semantic Segmentationcited by 717
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
50 most cited of 370 All 370 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 14.
19 papers.
Sort:
By area:
- 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
- 2025Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modelingcited by 6
- 2025Free-Form Scene Editor: Enabling Multi-Round Object Manipulation like in a 3D Enginecited by 3
- 2025Segment Anything Across Shots: A Method and Benchmarkcited by 3
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 2
- 2026FIND: A Simple yet Effective Baseline for Diffusion-Generated Image Detectioncited by 2
- 2026Radiant Foam Rendering on a Graph Processorcited by 1
- 20263D-DRES: Detailed 3D Referring Expression Segmentationcited by 1
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 1
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimizationcited by 0
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priorscited by 0
- 2026NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentationcited by 0
7 more
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representationscited by 0
- 20263DEditSafe: Defending 3D Editing Pipelines from Unsafe Generationcited by 0
- 2026Meshless Domain Randomization via Explicit Parameter Perturbation of 3D Gaussian Splattingcited by 0
- 2026VCAR: Training-Free 3DGS Segmentation via View Completeness and Axis-Aware Boundary Refinementcited by 0
- 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbationscited by 0
- 2026Hybrid Gaussians for Robust Open-Vocabulary 3D Segmentation with Multi-View Object Association and Boundary Refinementcited by 0
- 2026Visibility-Guided Structured Measure Flow for Class-Conditioned 3D Gaussian Generationcited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Hybrid Gaussians for Robust Open-Vocabulary 3D Segmentation with Multi-View Object Association and Boundary Refinement23 Sep 2026
- 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations3 Sep 2026
- 2026VCAR: Training-Free 3DGS Segmentation via View Completeness and Axis-Aware Boundary Refinement31 Aug 2026
- 2026Visibility-Guided Structured Measure Flow for Class-Conditioned 3D Gaussian Generation17 Aug 2026
- 2026Meshless Domain Randomization via Explicit Parameter Perturbation of 3D Gaussian Splatting24 Jul 2026
- 20263DEditSafe: Defending 3D Editing Pipelines from Unsafe Generation14 May 2026
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations11 May 2026
- 2026NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation16 Apr 2026
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors13 Apr 2026
- 2026FIND: A Simple yet Effective Baseline for Diffusion-Generated Image Detection15 Mar 2026
- 20263D-DRES: Detailed 3D Referring Expression Segmentation3 Mar 2026
7 more
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization27 Jan 2026
- 2026Radiant Foam Rendering on a Graph Processor7 Jan 2026
- 2025Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modeling30 Nov 2025
- 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulation20 Nov 2025
- 2025Segment Anything Across Shots: A Method and Benchmark17 Nov 2025
- 2025Free-Form Scene Editor: Enabling Multi-Round Object Manipulation like in a 3D Engine17 Nov 2025
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splatting14 Sep 2025
- 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
- 2025Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modelingcited by 6
- 2025Segment Anything Across Shots: A Method and Benchmarkcited by 3
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 2
- 2026Radiant Foam Rendering on a Graph Processorcited by 1
- 20263D-DRES: Detailed 3D Referring Expression Segmentationcited by 1
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 1
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimizationcited by 0
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priorscited by 0
- 2026NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentationcited by 0
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representationscited by 0
- 20263DEditSafe: Defending 3D Editing Pipelines from Unsafe Generationcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Hybrid Gaussians for Robust Open-Vocabulary 3D Segmentation with Multi-View Object Association and Boundary Refinement23 Sep 2026
- 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations3 Sep 2026
- 2026VCAR: Training-Free 3DGS Segmentation via View Completeness and Axis-Aware Boundary Refinement31 Aug 2026
- 2026Visibility-Guided Structured Measure Flow for Class-Conditioned 3D Gaussian Generation17 Aug 2026
- 2026Meshless Domain Randomization via Explicit Parameter Perturbation of 3D Gaussian Splatting24 Jul 2026
- 20263DEditSafe: Defending 3D Editing Pipelines from Unsafe Generation14 May 2026
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations11 May 2026
- 2026NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation16 Apr 2026
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors13 Apr 2026
- 20263D-DRES: Detailed 3D Referring Expression Segmentation3 Mar 2026
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization27 Jan 2026
12 newest of 17 All 17 (JSON)