mlsanityData to 7 Oct 2026

GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing

arXiv 2403.08733 ↗First posted 13 Mar 2024cs.CVcited by 114

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We propose GaussCtrl, a text-driven method to edit a 3D scene reconstructed by the 3D Gaussian Splatting (3DGS). Our method first renders a collection of images by using the 3DGS and edits them by using a pre-trained 2D diffusion model (ControlNet) based on the input prompt, which is then used to optimise the 3D model. Our key contribution is multi-view consistent editing, which enables editing all images together instead of iteratively editing one image while updating the 3D model as in previous works. It leads to faster editing as well as higher visual quality. This is achieved by the two terms: (a) depth-conditioned editing that enforces geometric consistency across multi-view images by leveraging naturally consistent depth maps. (b) attention-based latent code alignment that unifies the appearance of edited images by conditioning their editing to several reference views through self and cross-view attention between images' latent representations. Experiments demonstrate that our method achieves faster editing and better visual results than previous state-of-the-art methods.

Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 13 Mar 2024.

Builds on

43 of 50 references.

References · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2023Segment Anythingcited by 8,158
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
31 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  8. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  10. 2021Grounded Language-Image Pre-trainingcited by 1,147
  11. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  12. 2022Language-driven Semantic Segmentationcited by 711
  13. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  14. 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
  15. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  16. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
  17. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  18. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  19. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  20. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  21. 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
  22. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  23. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
  24. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  25. 2022ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Modelscited by 141
  26. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  27. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  28. 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editingcited by 88
  29. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  30. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
  31. 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 61

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 16; 2025: 60; 2026: 38.

114 papers.

Sort:

By area:

  1. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  2. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  3. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 40
  4. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  5. 2024GStex: Per-Primitive Texturing of 2D Gaussian Splatting for Decoupled Appearance and Geometry Modelingcited by 30
  6. 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 20
  7. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  8. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  9. 2024LangSurf: Language-Embedded Surface Gaussians for 3D Scene Understandingcited by 17
  10. 2024CLIP-GS: CLIP-Informed Gaussian Splatting for View-Consistent 3D Indoor Semantic Understandingcited by 16
  11. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 16
  12. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
38 more
  1. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  2. 2025Fast Multi-view Consistent 3D Editing with Video Priorscited by 12
  3. 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11
  4. 2024TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulationcited by 10
  5. 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
  6. 20253D-LATTE: Latent Space 3D Editing from Textual Instructionscited by 10
  7. 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
  8. 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
  9. 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 9
  10. 2025Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylizationcited by 8
  11. 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splattingcited by 8
  12. 20243D Gaussian Editing with A Single Imagecited by 7
  13. 20253DOT: Texture Transfer for 3DGS Objects from a Single Reference Imagecited by 7
  14. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  15. 2025WonderFree: Enhancing Novel View Quality and Cross-View Consistency for 3D Scene Explorationcited by 7
  16. 2025Geometry-Aware Diffusion Models for Multiview Scene Inpaintingcited by 6
  17. 2025Let it Snow! Animating 3D Gaussian Scenes with Dynamic Weather Effects via Physics-Guided Score Distillationcited by 6
  18. 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 6
  19. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  20. 2025ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Priorcited by 5
  21. 2025FreeInsert: Disentangled Text-Guided Object Insertion in 3D Gaussian Scene without Spatial Priorscited by 5
  22. 2025Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generationcited by 5
  23. 2025CoreEditor: Correspondence-constrained Diffusion for Consistent 3D Editingcited by 5
  24. 2025EditCast3D: Single-Frame-Guided 3D Editing with Video Propagation and View Selectioncited by 5
  25. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 5
  26. 2026LightSplat: Fast and Memory-Efficient Open-Vocabulary 3D Scene Understanding in Five Secondscited by 5
  27. 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylizationcited by 4
  28. 2025Attention in Diffusion Model: A Surveycited by 4
  29. 2025Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Samplingcited by 4
  30. 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenescited by 4
  31. 2024GSDeformer: Direct, Real-time and Extensible Cage-based Deformation for 3D Gaussian Splattingcited by 3
  32. 2024Sketch-guided Cage-based 3D Gaussian Splatting Deformationcited by 3
  33. 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformationcited by 3
  34. 2025Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Timecited by 3
  35. 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpaintingcited by 3
  36. 2025Stable Score Distillationcited by 3
  37. 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editingcited by 3
  38. 2025ContraGS: Codebook-Condensed and Trainable Gaussian Splatting for Fast, Memory-Efficient Reconstructioncited by 3

50 most cited of 114 All 114 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing
  2. 2026Variation-aware Flexible 3D Gaussian Editing
  3. 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
  4. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
  5. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splatting
  6. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions
  7. 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting
  8. 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing