mlsanityData to 13 Oct 2026

CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generation

arXiv 2505.07003 ↗First posted 11 May 2025cs.CVcited by 14

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recently, 3D generation methods have shown their powerful ability to automate 3D model creation. However, most 3D generation methods only rely on an input image or a text prompt to generate a 3D model, which lacks the control of each component of the generated 3D model. Any modifications of the input image lead to an entire regeneration of the 3D models. In this paper, we introduce a new method called CMD that generates a 3D model from an input image while enabling flexible local editing of each component of the 3D model. In CMD, we formulate the 3D generation as a conditional multiview diffusion model, which takes the existing or known parts as conditions and generates the edited or added components. This conditional multiview diffusion model not only allows the generation of 3D models part by part but also enables local editing of 3D models according to the local revision of the input image without changing other 3D parts. Extensive experiments are conducted to demonstrate that CMD decomposes a complex 3D generation task into multiple components, improving the generation quality. Meanwhile, CMD enables efficient and flexible local editing of a 3D model by just editing one rendered image.

Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 41 of its 68 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

41 of 68 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  2. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image30 May
  3. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  4. 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editing18 Mar
  5. 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar
  6. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  7. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts18 Oct
  8. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  11. 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
3 more
  1. 2023SKED: Sketch-guided Text-based 3D Editing19 Mar
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,952
  3. 2023Segment Anythingcited by 8,195
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,706
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 753
  9. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 732
  10. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 483
  11. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 440
  12. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 333
14 more
  1. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
  2. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  3. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  4. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  5. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  6. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 93
  7. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
  8. 2023NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshescited by 52
  9. 2024Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioningcited by 26
  10. 20243D Mesh Editing using Masked LRMscited by 17
  11. 2024MagicClay: Sculpting Meshes With Generative Neural Fieldscited by 13
  12. 2024Text-guided Controllable Mesh Refinement for Interactive 3D Modelingcited by 7
  13. 2024NeRF-Insert: 3D Local Editing with Multimodal Control Signalscited by 4
  14. 2023ControlDreamer: Blending Geometry and Style in Text-to-3Dcited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 8; 2026: 6.

14 papers.

Sort:

By area:

  1. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 41
  2. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 29
  3. 20253D-LATTE: Latent Space 3D Editing from Textual Instructionscited by 10
  4. 2025Towards Scalable and Consistent 3D Editingcited by 9
  5. 2025AnchorFlow: Training-Free 3D Editing via Latent Anchor-Aligned Flowscited by 8
  6. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 7
  7. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  8. 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editingcited by 4
  9. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  10. 2025CraftMesh: High-Fidelity Generative Mesh Manipulation via Poisson Seamless Fusioncited by 3
  11. 2026Beyond Prompts: Unconditional 3D Inversion for Out-of-Distribution Shapescited by 1
  12. 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
2 more
  1. 2026VideoWeaver: Multimodal Multi-View Video-to-Video Transfer for Embodied Agentscited by 0
  2. 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models
  2. 2024SketchDream: Sketch-based Text-to-3D Generation and Editing
  3. 2025Make Your MoVe: Make Your 3D Contents by Adapting Multi-View Diffusion Models to External Editing
  4. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D
  5. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
  6. 2024Multi-view Image Prompted Multi-view Diffusion for Improved 3D Generation
  7. 2023Control3D: Towards Controllable Text-to-3D Generation
  8. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation