mlsanityData to 14 Oct 2026

DreamEditor: Text-Driven 3D Scene Editing with Neural Fields

arXiv 2306.13455 ↗First posted 23 Jun 2023cs.CVcited by 155

Not on the map. Why?

Cited by 48 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Neural fields have achieved impressive advancements in view synthesis and scene reconstruction. However, editing these neural fields remains challenging due to the implicit encoding of geometry and texture information. In this paper, we propose DreamEditor, a novel framework that enables users to perform controlled editing of neural fields using text prompts. By representing scenes as mesh-based neural fields, DreamEditor allows localized editing within specific regions. DreamEditor utilizes the text encoder of a pretrained text-to-Image diffusion model to automatically identify the regions to be edited based on the semantics of the text prompts. Subsequently, DreamEditor optimizes the editing region and aligns its geometry and texture with the text prompts through score distillation sampling [29]. Extensive experiments have demonstrated that DreamEditor can accurately edit neural fields of real-world scenes according to the given text prompts while ensuring consistency in irrelevant areas. DreamEditor generates highly realistic textures and geometry, significantly surpassing previous works in both quantitative and qualitative evaluations.

Key facts. Cited by 155 papers in the map (data through 14 Oct 2026). Builds on 52 of its 58 references that are in the map. First posted on arXiv 23 Jun 2023.

Builds on

52 of 58 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
38 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  5. 2020Neural Sparse Voxel Fieldscited by 959
  6. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  7. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  8. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  9. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  10. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  11. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  12. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  13. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  14. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  15. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  16. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  17. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  18. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  19. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  20. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  21. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  22. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  23. 2021Editing Conditional Radiance Fieldscited by 222
  24. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
  25. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  26. 2021Neural Articulated Radiance Fieldcited by 196
  27. 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
  28. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  29. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  30. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  31. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
  32. 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
  33. 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
  34. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  35. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  36. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  37. 2022Deforming Radiance Fields with Cagescited by 78
  38. 2021Neural Point Light Fieldscited by 51

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 27; 2024: 63; 2025: 42; 2026: 23.

155 papers.

Sort:

By area:

  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  2. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  3. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  4. 2023Text-to-3D with Classifier Score Distillationcited by 128
  5. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  6. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  7. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  8. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  9. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
  10. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  11. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
  12. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
38 more
  1. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  2. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  3. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 63
  4. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
  5. 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
  6. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  7. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  8. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 52
  9. 2023Posterior Distillation Samplingcited by 46
  10. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
  11. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 41
  12. 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
  13. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  14. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 35
  15. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  16. 2024Mesh-based Gaussian Splatting for Real-time Large-scale Deformationcited by 28
  17. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  18. 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 25
  19. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
  20. 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solidscited by 23
  21. 2024Collaborative Control for Geometry-Conditioned PBR Image Generationcited by 22
  22. 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
  23. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splattingcited by 22
  24. 2023Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Trainingcited by 21
  25. 2024GALA: Generating Animatable Layered Assets from a Single Scancited by 21
  26. 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
  27. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  28. 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editingcited by 18
  29. 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
  30. 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
  31. 2023LatentEditor: Text Driven Local Editing of 3D Scenescited by 17
  32. 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
  33. 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
  34. 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 15
  35. 2023Free-Editor: Zero-shot Text-driven 3D Scene Editingcited by 14
  36. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  37. 2025CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generationcited by 14
  38. 2024Localized Gaussian Splatting Editing with Contextual Awarenesscited by 13

50 most cited of 155 All 155 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservation
  2. 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors
  3. 2023Editing 3D Scenes via Text Prompts without Retraining
  4. 2024DreamPolish: Domain Score Distillation With Progressive Geometry Generation
  5. 2026DreamEdit3D: Personalization of Multi-View Diffusion Models for 3D Editing
  6. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models
  7. 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Models
  8. 2023SKED: Sketch-guided Text-based 3D Editing