Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Sampling
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D neural representations and instance-level editing models have enabled the efficient creation of high-quality 3D content. However, achieving precise local 3D edits remains challenging, especially for Gaussian Splatting, due to inconsistent multi-view 2D part segmentations and inherently ambiguous nature of Score Distillation Sampling (SDS) loss. To address these limitations, we propose RoMaP, a novel local 3D Gaussian editing framework that enables precise and drastic part-level modifications. First, we introduce a robust 3D mask generation module with our 3D-Geometry Aware Label Prediction (3D-GALP), which uses spherical harmonics (SH) coefficients to model view-dependent label variations and soft-label property, yielding accurate and consistent part segmentations across viewpoints. Second, we propose a regularized SDS loss that combines the standard SDS loss with additional regularizers. In particular, an L1 anchor loss is introduced via our Scheduled Latent Mixing and Part (SLaMP) editing method, which generates high-quality part-edited 2D images and confines modifications only to the target region while preserving contextual coherence. Additional regularizers, such as Gaussian prior removal, further improve flexibility by allowing changes beyond the existing context, and robust 3D masking prevents unintended edits. Experimental results demonstrate that our RoMaP achieves state-of-the-art local 3D editing on both reconstructed and generated Gaussian scenes and objects qualitatively and quantitatively, making it possible for more robust and flexible part-level 3D Gaussian editing. Code is available at https://janeyeon.github.io/romap.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 58 of its 66 references that are in the map. First posted on arXiv 15 Jul 2025.
Builds on
58 of 66 references.
References · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2016Density estimation using Real NVPcited by 2,042
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
- 2023Noise-Free Score Distillationcited by 99
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 52
- 2023Posterior Distillation Samplingcited by 46
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 7
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Modelscited by 1
- 2026BEA-GS: BEyond RAdiance Supervision in 3DGS for Precise Object Extractioncited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models29 Aug 2026
- 2026BEA-GS: BEyond RAdiance Supervision in 3DGS for Precise Object Extraction10 May 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3D15 Dec 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025