DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation
Not on the map. Why?
Abstract (arXiv)
User-friendly 3D object editing is a challenging task that has attracted significant attention recently. The limitations of direct 3D object editing without 2D prior knowledge have prompted increased attention towards utilizing 2D generative models for 3D editing. While existing methods like Instruct NeRF-to-NeRF offer a solution, they often lack user-friendliness, particularly due to semantic guided editing. In the realm of 3D representation, 3D Gaussian Splatting emerges as a promising approach for its efficiency and natural explicit property, facilitating precise editing tasks. Building upon these insights, we propose DragGaussian, a 3D object drag-editing framework based on 3D Gaussian Splatting, leveraging diffusion models for interactive image editing with open-vocabulary input. This framework enables users to perform drag-based editing on pre-trained 3D Gaussian object models, producing modified 2D images through multi-view consistent editing. Our contributions include the introduction of a new task, the development of DragGaussian for interactive point-based 3D editing, and comprehensive validation of its effectiveness through qualitative and quantitative experiments.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 45 of its 51 references that are in the map. First posted on arXiv 9 May 2024.
Builds on
45 of 51 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Generative Adversarial Networkscited by 5,627
33 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
- 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50
- 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
- 2022User-Controllable Latent Transformer for StyleGAN Image Layout Editingcited by 28
- 2022Rewriting Geometric Rules of a GANcited by 25
- 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 25
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
- 2020Semantic Layout Manipulation with High-Resolution Sparse Attentioncited by 10
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Priorcited by 5
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editingcited by 4
- 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformationcited by 3
- 2026VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splatscited by 1
- 2025Neural-MMGS: Multi-modal Neural Gaussian Splats for Large-Scale Scene Reconstructioncited by 0
- 2026ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGS Modelscited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGS Models30 Mar 2026
- 2026VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splats3 Mar 2026
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing12 Jan 2026
- 2025Neural-MMGS: Multi-modal Neural Gaussian Splats for Large-Scale Scene Reconstruction22 Sep 2025
- 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformation17 Apr 2025
- 2025ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Prior17 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splatting
- 2024MvDrag3D: Drag-based Creative 3D Editing via Multi-view Generation-Reconstruction Priors
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
- 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
- 2026Variation-aware Flexible 3D Gaussian Editing
- 2026SVGS: Single-View to 3D Object Editing via Gaussian Splatting
- 2026Reproducing DragDiffusion: Interactive Point-Based Editing with Diffusion Models