mlsanityData to 14 Oct 2026

GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions

arXiv 2311.16037 ↗First posted 27 Nov 2023cs.CV cs.GRcited by 168

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recently, impressive results have been achieved in 3D scene editing with text instructions based on a 2D diffusion model. However, current diffusion models primarily generate images by predicting noise in the latent space, and the editing is usually applied to the whole image, which makes it challenging to perform delicate, especially localized, editing for 3D scenes. Inspired by recent 3D Gaussian splatting, we propose a systematic framework, named GaussianEditor, to edit 3D scenes delicately via 3D Gaussians with text instructions. Benefiting from the explicit property of 3D Gaussians, we design a series of techniques to achieve delicate editing. Specifically, we first extract the region of interest (RoI) corresponding to the text instruction, aligning it to 3D Gaussians. The Gaussian RoI is further used to control the editing process. Our framework can achieve more delicate and precise editing of 3D scenes than previous methods while enjoying much faster training speed, i.e. within 20 minutes on a single V100 GPU, more than twice as fast as Instruct-NeRF2NeRF (45 minutes -- 2 hours).

Key facts. Cited by 168 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 54 of its 63 references that are in the map. First posted on arXiv 27 Nov 2023.

Builds on

54 of 63 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023Segment Anythingcited by 8,234
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  10. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  11. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  13. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  14. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  15. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  16. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  17. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  18. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  19. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  20. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  21. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  22. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  23. 2021Editing Conditional Radiance Fieldscited by 222
  24. 2021Neural Articulated Radiance Fieldcited by 196
  25. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
  26. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  27. 2022ARF: Artistic Radiance Fieldscited by 147
  28. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  29. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  30. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  31. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  32. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  33. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  34. 2022Deforming Radiance Fields with Cagescited by 78
  35. 2021Learning to Stylize Novel Viewscited by 76
  36. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  37. 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
  38. 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 70; 2025: 58; 2026: 37.

168 papers.

Sort:

By area:

  1. 2024A Survey on 3D Gaussian Splattingcited by 224
  2. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  3. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
  4. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  5. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
  6. 20243D Gaussian as a New Era: A Surveycited by 104
  7. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
  8. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  9. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
  10. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  11. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
  12. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
38 more
  1. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
  2. 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
  3. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  4. 2024Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collectionscited by 56
  5. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
  6. 2024Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editingcited by 47
  7. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
  8. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  9. 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 42
  10. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
  11. 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
  12. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  13. 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splattingcited by 37
  14. 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
  15. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  16. 2024N2F2: Hierarchical Scene Understanding with Nested Neural Feature Fieldscited by 34
  17. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  18. 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 33
  19. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  20. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  21. 2025CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstructioncited by 26
  22. 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
  23. 2024GaussianCut: Interactive segmentation via graph cut for 3D Gaussian Splattingcited by 25
  24. 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
  25. 2025Viser: Imperative, Web-based 3D Visualization in Pythoncited by 23
  26. 2024Contrastive Gaussian Clustering: Weakly Supervised 3D Scene Segmentationcited by 22
  27. 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 22
  28. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splattingcited by 22
  29. 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
  30. 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
  31. 2025BARD-GS: Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splattingcited by 19
  32. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  33. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  34. 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusioncited by 17
  35. 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splattingcited by 17
  36. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  37. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
  38. 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16

50 most cited of 168 All 168 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
  2. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
  3. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
  4. 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors
  5. 20254DGS-Craft: Consistent and Interactive 4D Gaussian Splatting Editing
  6. 2024Towards a Training Free Approach for 3D Scene Editing
  7. 2026Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing
  8. 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting