mlsanityData to 7 Oct 2026

ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields

arXiv 2402.00864 ↗First posted 1 Feb 2024cs.CVcited by 68

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce ViCA-NeRF, the first view-consistency-aware method for 3D editing with text instructions. In addition to the implicit neural radiance field (NeRF) modeling, our key insight is to exploit two sources of regularization that explicitly propagate the editing information across different views, thus ensuring multi-view consistency. For geometric regularization, we leverage the depth information derived from NeRF to establish image correspondences between different views. For learned regularization, we align the latent codes in the 2D diffusion model between edited and unedited images, enabling us to edit key views and propagate the update throughout the entire scene. Incorporating these two strategies, our ViCA-NeRF operates in two stages. In the initial stage, we blend edits from different views to create a preliminary 3D edit. This is followed by a second stage of NeRF training, dedicated to further refining the scene's appearance. Experimental results demonstrate that ViCA-NeRF provides more flexible, efficient (3 times faster) editing with higher levels of consistency and details, compared with the state of the art. Our code is publicly available.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 1 Feb 2024.

Builds on

33 of 37 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2023Segment Anythingcited by 8,158
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  11. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
21 more
  1. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  2. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  3. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  4. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  5. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  6. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  8. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  9. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  10. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  11. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  12. 2021Editing Conditional Radiance Fieldscited by 222
  13. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  14. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  15. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  16. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 93
  17. 2022Neural 3D Reconstruction in the Wildcited by 79
  18. 2021Learning to Stylize Novel Viewscited by 76
  19. 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 47
  20. 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
  21. 2022PaletteNeRF: Palette-based Color Editing for NeRFscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 26; 2025: 30; 2026: 12.

68 papers.

Sort:

By area:

  1. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
  2. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
  3. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  4. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 40
  5. 2024GeoDiffuser: Geometry-Based Image Editing with Diffusion Modelscited by 34
  6. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  7. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
  8. 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
  9. 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 20
  10. 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editingcited by 18
  11. 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
  12. 2024Customizing Text-to-Image Diffusion with Object Viewpoint Controlcited by 13
38 more
  1. 2024Localized Gaussian Splatting Editing with Contextual Awarenesscited by 13
  2. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  3. 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editingcited by 12
  4. 2025Fast Multi-view Consistent 3D Editing with Video Priorscited by 12
  5. 2024TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulationcited by 10
  6. 20243DEgo: 3D Editing on the Go!cited by 10
  7. 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimizationcited by 10
  8. 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splattingcited by 9
  9. 2025Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylizationcited by 8
  10. 2024Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Modelcited by 6
  11. 2025Geometry-Aware Diffusion Models for Multiview Scene Inpaintingcited by 6
  12. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  13. 2024DATENeRF: Depth-Aware Text-based Editing of NeRFscited by 5
  14. 2025FreeInsert: Disentangled Text-Guided Object Insertion in 3D Gaussian Scene without Spatial Priorscited by 5
  15. 2025CoreEditor: Correspondence-constrained Diffusion for Consistent 3D Editingcited by 5
  16. 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylizationcited by 4
  17. 2025Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Samplingcited by 4
  18. 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenescited by 4
  19. 2025C3Editor: Achieving Controllable Consistency in 2D Model for 3D Editingcited by 4
  20. 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editingcited by 4
  21. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  22. 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editingcited by 3
  23. 2025Affine-Equivariant Kernel Space Encoding for NeRF Editingcited by 3
  24. 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editingcited by 3
  25. 2024Preserving Identity with Variational Score for General-purpose 3D Editingcited by 2
  26. 2024Towards a Training Free Approach for 3D Scene Editingcited by 2
  27. 2024DragScene: Interactive 3D Scene Editing with Single-view Drag Instructionscited by 2
  28. 2025Advancing 3D Gaussian Splatting Editing with Complementary and Consensus Informationcited by 2
  29. 2025Personalize Your Gaussian: Consistent 3D Scene Personalization from a Single Imagecited by 2
  30. 2025Neural Atlas Graphs for Dynamic Scene Decomposition and Editingcited by 2
  31. 2025GuideFlow3D: Optimization-Guided Rectified Flow For Appearance Transfercited by 2
  32. 2025Training-Free Multi-View Extension of IC-Light for Textual Position-Aware Scene Relightingcited by 2
  33. 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformercited by 2
  34. 2026Variation-aware Flexible 3D Gaussian Editingcited by 2
  35. 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
  36. 2025Instruct-4DGS: Efficient Dynamic Scene Editing via 4D Gaussian-based Static-Dynamic Separationcited by 1
  37. 2025Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garmentscited by 1
  38. 2025Improved 3D Scene Stylization via Text-Guided Generative Image Editing with Region-Based Controlcited by 1

50 most cited of 68 All 68 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model
  2. 2023RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models
  3. 2024ID-NeRF: Indirect Diffusion-guided Neural Radiance Fields for Generalizable View Synthesis
  4. 2024Omni-Recon: Harnessing Image-based Rendering for General-Purpose Neural Radiance Fields
  5. 2024SIGNeRF: Scene Integrated Generation for Neural Radiance Fields
  6. 2024Taming Latent Diffusion Model for Neural Radiance Field Inpainting
  7. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
  8. 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRF