mlsanityData to 14 Oct 2026

DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation

arXiv 2405.05800 ↗First posted 9 May 2024cs.GR cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

User-friendly 3D object editing is a challenging task that has attracted significant attention recently. The limitations of direct 3D object editing without 2D prior knowledge have prompted increased attention towards utilizing 2D generative models for 3D editing. While existing methods like Instruct NeRF-to-NeRF offer a solution, they often lack user-friendliness, particularly due to semantic guided editing. In the realm of 3D representation, 3D Gaussian Splatting emerges as a promising approach for its efficiency and natural explicit property, facilitating precise editing tasks. Building upon these insights, we propose DragGaussian, a 3D object drag-editing framework based on 3D Gaussian Splatting, leveraging diffusion models for interactive image editing with open-vocabulary input. This framework enables users to perform drag-based editing on pre-trained 3D Gaussian object models, producing modified 2D images through multi-view consistent editing. Our contributions include the introduction of a new task, the development of DragGaussian for interactive point-based 3D editing, and comprehensive validation of its effectiveness through qualitative and quantitative experiments.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 45 of its 51 references that are in the map. First posted on arXiv 9 May 2024.

Builds on

45 of 51 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2022Generative Adversarial Networkscited by 5,627
33 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  5. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  6. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  8. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  10. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  11. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  12. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  13. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  14. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  15. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  16. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  17. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
  18. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  19. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  20. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  21. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  22. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
  23. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  24. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  25. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  26. 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50
  27. 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
  28. 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
  29. 2022Rewriting Geometric Rules of a GANcited by 25
  30. 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 25
  31. 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
  32. 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
  33. 2020Semantic Layout Manipulation with High-Resolution Sparse Attentioncited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splatting
  2. 2024MvDrag3D: Drag-based Creative 3D Editing via Multi-view Generation-Reconstruction Priors
  3. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
  4. 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting
  5. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
  6. 2026Variation-aware Flexible 3D Gaussian Editing
  7. 2026SVGS: Single-View to 3D Object Editing via Gaussian Splatting
  8. 2026Reproducing DragDiffusion: Interactive Point-Based Editing with Diffusion Models