mlsanityData to 7 Oct 2026

Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts

arXiv 2310.11784 ↗First posted 18 Oct 2023cs.CVcited by 51

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent text-to-3D generation methods achieve impressive 3D content creation capacity thanks to the advances in image diffusion models and optimizing strategies. However, current methods struggle to generate correct 3D content for a complex prompt in semantics, i.e., a prompt describing multiple interacted objects binding with different attributes. In this work, we propose a general framework named Progressive3D, which decomposes the entire generation into a series of locally progressive editing steps to create precise 3D content for complex prompts, and we constrain the content change to only occur in regions determined by user-defined region prompts in each editing step. Furthermore, we propose an overlapped semantic component suppression technique to encourage the optimization process to focus more on the semantic differences between prompts. Extensive experiments demonstrate that the proposed Progressive3D framework generates precise 3D content for prompts with complex semantics and is general for various text-to-3D methods driven by different 3D representations.

Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 46 references that are in the map. First posted on arXiv 18 Oct 2023.

Builds on

39 of 46 references.

Closest ancestors · 9

Same direction, newest first

  1. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  2. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  4. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr
  5. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  6. 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
  7. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  9. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023Segment Anythingcited by 8,158
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
18 more
  1. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  2. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  3. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  4. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  5. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  6. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  8. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  9. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  10. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  11. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  12. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  13. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  14. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  15. 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 85
  16. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
  17. 2023Segment Anything in 3D with Radiance Fieldscited by 61
  18. 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 47

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 24; 2025: 18; 2026: 3.

51 papers.

Sort:

By area:

  1. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  2. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  3. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
  4. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
  5. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  6. 2024Advances in 3D Generation: A Surveycited by 62
  7. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 56
  8. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  9. 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splattingcited by 42
  10. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
  11. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  12. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
38 more
  1. 2024Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioningcited by 26
  2. 2023Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repaintingcited by 25
  3. 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptionscited by 24
  4. 2024BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesiscited by 20
  5. 2025AE-NeRF: Augmenting Event-Based Neural Radiance Fields for Non-ideal Conditions and Larger Scenecited by 19
  6. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  7. 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactionscited by 18
  8. 2024MeshUp: Multi-Target Mesh Deformation via Blended Score Distillationcited by 17
  9. 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
  10. 2024DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstructioncited by 15
  11. 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 15
  12. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  13. 2025CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generationcited by 14
  14. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  15. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  16. 2024Envision3D: One Image to 3D with Anchor Views Interpolationcited by 12
  17. 2025Fast Multi-view Consistent 3D Editing with Video Priorscited by 12
  18. 2024CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussianscited by 10
  19. 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editingcited by 7
  20. 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
  21. 2025DiMeR: Disentangled Mesh Reconstruction Modelcited by 6
  22. 2024DreamBeast: Distilling 3D Fantastical Animals with Part-Aware Knowledge Transfercited by 5
  23. 2025Flash Sculptor: Modular 3D Worlds from Objectscited by 5
  24. 2025Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generationcited by 5
  25. 2025TeRA: Rethinking Text-guided Realistic 3D Avatar Generationcited by 5
  26. 2024DreamBarbie: Text to Barbie-Style 3D Avatarscited by 4
  27. 2025High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Modelcited by 4
  28. 2025Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Samplingcited by 4
  29. 2024Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Modelcited by 3
  30. 2024A3D: Does Diffusion Dream about 3D Alignment?cited by 3
  31. 2024StrandHead: Text to Hair-Disentangled 3D Head Avatars Using Human-Centric Priorscited by 3
  32. 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editingcited by 3
  33. 2025CraftMesh: High-Fidelity Generative Mesh Manipulation via Poisson Seamless Fusioncited by 3
  34. 2025Category-Aware 3D Object Composition with Disentangled Texture and Shape Multi-view Diffusioncited by 2
  35. 2026Sat2City v2: Native 3D City Asset Generation from a Single Satellite Imagecited by 2
  36. 2025Instruct-4DGS: Efficient Dynamic Scene Editing via 4D Gaussian-based Static-Dynamic Separationcited by 1
  37. 2025Towards Generalized and Training-Free Text-Guided Semantic Manipulationcited by 1
  38. 2026ES3D: Embedding Semantics into 3D Space for Component-Aware Editingcited by 0

50 most cited of 51 All 51 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior
  2. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generation
  3. 2023ControlDreamer: Blending Geometry and Style in Text-to-3D
  4. 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
  5. 2023Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior
  6. 2024VP3D: Unleashing 2D Visual Prompt for Text-to-3D Generation
  7. 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing
  8. 2024A Survey On Text-to-3D Contents Generation In The Wild