mlsanityData to 14 Oct 2026

DreamEdit3D: Personalization of Multi-View Diffusion Models for 3D Editing

arXiv 2605.16990 ↗First posted 16 May 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control. Inspired by these 2D advancements, we present a novel personalization method for text-guided 3D editing that enables compositional, object-level control through natural language. Given a 3D input, we render orthogonal views and extract object-level segmentation masks to isolate semantic components. We then learn distinct token embeddings for each component through a tailored two-phase optimization strategy: multi-view textual inversion with attention alignment, followed by full fine-tuning of multi-view diffusion model. During inference, these disentangled tokens seamlessly compose with editing prompts to generate multi-view consistent images, which are subsequently lifted into high-fidelity textured 3D meshes. Extensive evaluations across diverse editing scenarios demonstrate that our method successfully transfers the flexibility of 2D personalization to 3D, achieving state-of-the-art edit faithfulness and identity preservation compared to existing baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 49 of its 55 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

49 of 55 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov
  2. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec
  3. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  4. 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editing18 Mar
  5. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation2 Dec
  6. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  8. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  9. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  11. 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
3 more
  1. 2023SKED: Sketch-guided Text-based 3D Editing19 Mar
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 34

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2023Segment Anythingcited by 8,234
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
22 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  2. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  3. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  5. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  6. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  7. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  9. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  10. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  11. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  12. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
  13. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  14. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
  15. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  16. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
  17. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
  18. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
  19. 2024Imagen 3cited by 27
  20. 2024GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinementcited by 14
  21. 2024PartCraft: Crafting Creative Objects by Partscited by 13
  22. 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
  2. 2023ControlDreamer: Blending Geometry and Style in Text-to-3D
  3. 2025Align 3D Representation and Text Embedding for 3D Content Personalization
  4. 2025Make Your MoVe: Make Your 3D Contents by Adapting Multi-View Diffusion Models to External Editing
  5. 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-View
  6. 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models
  7. 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors
  8. 2025FreeInsert: Personalized Object Insertion with Geometric and Style Control