mlsanityData to 14 Oct 2026

Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Sampling

arXiv 2507.11061 ↗First posted 15 Jul 2025cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Recent advances in 3D neural representations and instance-level editing models have enabled the efficient creation of high-quality 3D content. However, achieving precise local 3D edits remains challenging, especially for Gaussian Splatting, due to inconsistent multi-view 2D part segmentations and inherently ambiguous nature of Score Distillation Sampling (SDS) loss. To address these limitations, we propose RoMaP, a novel local 3D Gaussian editing framework that enables precise and drastic part-level modifications. First, we introduce a robust 3D mask generation module with our 3D-Geometry Aware Label Prediction (3D-GALP), which uses spherical harmonics (SH) coefficients to model view-dependent label variations and soft-label property, yielding accurate and consistent part segmentations across viewpoints. Second, we propose a regularized SDS loss that combines the standard SDS loss with additional regularizers. In particular, an L1 anchor loss is introduced via our Scheduled Latent Mixing and Part (SLaMP) editing method, which generates high-quality part-edited 2D images and confines modifications only to the target region while preserving contextual coherence. Additional regularizers, such as Gaussian prior removal, further improve flexibility by allowing changes beyond the existing context, and robust 3D masking prevents unintended edits. Experimental results demonstrate that our RoMaP achieves state-of-the-art local 3D editing on both reconstructed and generated Gaussian scenes and objects qualitatively and quantitatively, making it possible for more robust and flexible part-level 3D Gaussian editing. Code is available at https://janeyeon.github.io/romap.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 58 of its 66 references that are in the map. First posted on arXiv 15 Jul 2025.

Builds on

58 of 66 references.

References · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Segment Anythingcited by 8,234
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  5. 2016Density estimation using Real NVPcited by 2,042
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  9. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  10. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  13. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  14. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  15. 2023LERF: Language Embedded Radiance Fieldscited by 543
  16. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  17. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  18. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  19. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  20. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  21. 2023Text-to-3D using Gaussian Splattingcited by 299
  22. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  23. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  24. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  25. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  26. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  27. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  28. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  29. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  30. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  31. 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
  32. 2023Noise-Free Score Distillationcited by 99
  33. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  34. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  35. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
  36. 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
  37. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 52
  38. 2023Posterior Distillation Samplingcited by 46

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.