Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields
Not on the map. Why?
Abstract (arXiv)
Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address this issue, we propose a novel NeRF-based model, Blending-NeRF, which consists of two NeRF networks: pretrained NeRF and editable NeRF. Additionally, we introduce new blending operations that allow Blending-NeRF to properly edit target regions which are localized by text. By using a pretrained vision-language aligned model, CLIP, we guide Blending-NeRF to add new objects with varying colors and densities, modify textures, and remove parts of the original object. Our extensive experiments demonstrate that Blending-NeRF produces naturally and locally edited 3D objects from various text prompts. Our project page is available at https://seokhunchoi.github.io/Blending-NeRF/
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 23 Aug 2023.
Builds on
37 of 44 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022Language-driven Semantic Segmentationcited by 717
25 more
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
- 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 363
- 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2021Editing Conditional Radiance Fieldscited by 222
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
- 2021Decoupling Zero-Shot Semantic Segmentationcited by 199
- 2019ManiGAN: Text-Guided Image Manipulationcited by 156
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
- 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
- 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
Built on by
Citing papers per year: 2023: 7; 2024: 14; 2025: 5; 2026: 2.
28 papers.
Sort:
By area:
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 22
- 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRFcited by 20
- 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
- 2024Gaussian Splatting in Stylecited by 16
- 2024Localized Gaussian Splatting Editing with Contextual Awarenesscited by 13
- 2024InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenescited by 11
- 2024NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFscited by 11
- 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimizationcited by 10
16 more
- 2023Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updatescited by 9
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
- 2023Advances in 3D Neural Stylization: A Surveycited by 8
- 2024ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fieldscited by 7
- 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 7
- 2024LLaNA: Large Language and NeRF Assistantcited by 6
- 2024Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decompositioncited by 5
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 5
- 2024Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injectioncited by 4
- 2025Affine-Equivariant Kernel Space Encoding for NeRF Editingcited by 4
- 2024Sketch-guided Cage-based 3D Gaussian Splatting Deformationcited by 3
- 2023Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inpainting with Generative Diffusion Modelscited by 2
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
- 2025Scaling LLaNA: Advancing NeRF-Language Understanding Through Large-Scale Trainingcited by 0
- 2026What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservation14 Sep 2026
- 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training5 Dec 2025
- 2025Affine-Equivariant Kernel Space Encoding for NeRF Editing4 Aug 2025
- 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization26 Jun 2025
- 2025Scaling LLaNA: Advancing NeRF-Language Understanding Through Large-Scale Training18 Apr 2025
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor17 Jan 2025
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting2 Dec 2024
- 2024Sketch-guided Cage-based 3D Gaussian Splatting Deformation19 Nov 2024
- 2024Localized Gaussian Splatting Editing with Contextual Awareness31 Jul 2024
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussians16 Jul 2024
16 more
- 2024LLaNA: Large Language and NeRF Assistant17 Jun 2024
- 2024Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injection27 May 2024
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing29 Apr 2024
- 2024Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition3 Apr 2024
- 2024Gaussian Splatting in Style13 Mar 2024
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review17 Feb 2024
- 2024NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs13 Feb 2024
- 2024ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields31 Jan 2024
- 2024InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenes10 Jan 2024
- 2023Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inpainting with Generative Diffusion Models30 Dec 2023
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds14 Dec 2023
- 2023Advances in 3D Neural Stylization: A Survey30 Nov 2023
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF22 Nov 2023
- 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context15 Oct 2023
- 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRF4 Oct 2023
- 2023Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates20 Sep 2023
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 22
- 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
- 2024Gaussian Splatting in Stylecited by 16
- 2024InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenescited by 11
- 2024NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFscited by 11
- 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimizationcited by 10
- 2023Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updatescited by 9
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
12 most cited of 23 All 23 (JSON)
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservation14 Sep 2026
- 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training5 Dec 2025
- 2025Affine-Equivariant Kernel Space Encoding for NeRF Editing4 Aug 2025
- 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization26 Jun 2025
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor17 Jan 2025
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting2 Dec 2024
- 2024Sketch-guided Cage-based 3D Gaussian Splatting Deformation19 Nov 2024
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussians16 Jul 2024
- 2024Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injection27 May 2024
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing29 Apr 2024
12 newest of 23 All 23 (JSON)