mlsanityData to 7 Oct 2026

GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting

arXiv 2403.05154 ↗First posted 8 Mar 2024cs.CV cs.GRcited by 36

Not on the map. Why?

Abstract (arXiv)

We present GSEdit, a pipeline for text-guided 3D object editing based on Gaussian Splatting models. Our method enables the editing of the style and appearance of 3D objects without altering their main details, all in a matter of minutes on consumer hardware. We tackle the problem by leveraging Gaussian splatting to represent 3D scenes, and we optimize the model while progressively varying the image supervision by means of a pretrained image-based diffusion model. The input object may be given as a 3D triangular mesh, or directly provided as Gaussians from a generative model such as DreamGaussian. GSEdit ensures consistency across different viewpoints, maintaining the integrity of the original object's information. Compared to previously proposed methods relying on NeRF-like MLP models, GSEdit stands out for its efficiency, making 3D editing tasks much faster. Our editing process is refined via the application of the SDS loss, ensuring that our edits are both precise and accurate. Our comprehensive evaluation demonstrates that GSEdit effectively alters object shape and appearance following the given textual instructions while preserving their coherence and detail.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 8 Mar 2024.

Builds on

35 of 41 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  12. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
23 more
  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  2. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  3. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  4. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  6. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  7. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  8. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  9. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  10. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  11. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  12. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  13. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  14. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  15. 2021Editing Conditional Radiance Fieldscited by 222
  16. 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
  17. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  18. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  19. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
  20. 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
  21. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  22. 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
  23. 2021DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Renderingcited by 60

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 17; 2026: 8.

36 papers.

Sort:

By area:

  1. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  2. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  3. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
  4. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  5. 2024GStex: Per-Primitive Texturing of 2D Gaussian Splatting for Decoupled Appearance and Geometry Modelingcited by 30
  6. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 29
  7. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  8. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  9. 2024DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservationcited by 13
  10. 2025iSegMan: Interactive Segment-and-Manipulate 3D Gaussianscited by 11
  11. 2025UVGS: Reimagining Unstructured 3D Gaussian Splatting using UV Mappingcited by 8
  12. 2024FruitNinja: 3D Object Interior Texture Generation with Gaussian Splattingcited by 5
24 more
  1. 2025ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Priorcited by 5
  2. 2024Implicit-ARAP: Efficient Handle-Guided Neural Field Deformation via Local Patch Meshingcited by 4
  3. 2025Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Samplingcited by 4
  4. 2024A3D: Does Diffusion Dream about 3D Alignment?cited by 3
  5. 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformationcited by 3
  6. 2025ContraGS: Codebook-Condensed and Trainable Gaussian Splatting for Fast, Memory-Efficient Reconstructioncited by 3
  7. 2025VULCAN: Tool-Augmented Multi Agents for Iterative 3D Object Arrangementcited by 3
  8. 20253D Scene Change Modeling With Consistent Multi-View Aggregationcited by 3
  9. 2026Vinedresser3D: Agentic Text-guided 3D Editingcited by 3
  10. 2024Efficient Semantic Splatting for Remote Sensing Multi-view Segmentationcited by 2
  11. 2024ProGDF: Progressive Gaussian Differential Field for Controllable and Flexible 3D Editingcited by 2
  12. 2025Rigidity-Aware 3D Gaussian Deformation from a Single Imagecited by 2
  13. 2025Learning Unified Representation of 3D Gaussian Splattingcited by 2
  14. 2026ArtisanGS: Interactive Tools for Gaussian Splat Selection with AI and Human in the Loopcited by 2
  15. 2025Towards Generalized and Training-Free Text-Guided Semantic Manipulationcited by 1
  16. 2025Efficient multi-view training for 3D Gaussian Splattingcited by 0
  17. 2025Optimization-Free Style Transfer for 3D Gaussian Splatscited by 0
  18. 2025Cross-Temporal 3D Gaussian Splatting for Sparse-View Guided Scene Updatecited by 0
  19. 2026SVGS: Single-View to 3D Object Editing via Gaussian Splattingcited by 0
  20. 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervisioncited by 0
  21. 2026ReAge3D: Re-Aging 3D Faces with View Consistencycited by 0
  22. 2026RADmesh: Remesh-Aware Mesh Deformationcited by 0
  23. 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objectscited by 0
  24. 2026Scaling Versatile 3D Assets Editing with a Million-Scale Datasetcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
  2. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
  3. 2024DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation
  4. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splatting
  5. 2025InStyle: Instant Appearance Stylization of 3D Shapes
  6. 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing
  7. 2026Variation-aware Flexible 3D Gaussian Editing
  8. 2024Towards a Training Free Approach for 3D Scene Editing