DreamEdit3D: Personalization of Multi-View Diffusion Models for 3D Editing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control. Inspired by these 2D advancements, we present a novel personalization method for text-guided 3D editing that enables compositional, object-level control through natural language. Given a 3D input, we render orthogonal views and extract object-level segmentation masks to isolate semantic components. We then learn distinct token embeddings for each component through a tailored two-phase optimization strategy: multi-view textual inversion with attention alignment, followed by full fine-tuning of multi-view diffusion model. During inference, these disentangled tokens seamlessly compose with editing prompts to generate multi-view consistent images, which are subsequently lifted into high-fidelity textured 3D meshes. Extensive evaluations across diverse editing scenarios demonstrate that our method successfully transfers the flexibility of 2D personalization to 3D, achieving state-of-the-art edit faithfulness and identity preservation compared to existing baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 49 of its 55 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
49 of 55 references.
Closest ancestors · 15
Same direction, newest first
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editing18 Mar
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation2 Dec
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
3 more
Other references · 34
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023Segment Anythingcited by 8,234
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
22 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
- 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
- 2024Imagen 3cited by 27
- 2024GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinementcited by 14
- 2024PartCraft: Crafting Creative Objects by Partscited by 13
- 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
- 2023ControlDreamer: Blending Geometry and Style in Text-to-3D
- 2025Align 3D Representation and Text Embedding for 3D Content Personalization
- 2025Make Your MoVe: Make Your 3D Contents by Adapting Multi-View Diffusion Models to External Editing
- 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-View
- 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models
- 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors
- 2025FreeInsert: Personalized Object Insertion with Geometric and Style Control