DecompDreamer: A Composition-Aware Curriculum for Structured 3D Asset Generation
Not on the map. Why?
Abstract (arXiv)
Current text-to-3D methods excel at generating single objects but falter on compositional prompts. We argue this failure is fundamental to their optimization schedules, as simultaneous or iterative heuristics predictably collapse under a combinatorial explosion of conflicting gradients, leading to entangled geometry or catastrophic divergence. In this paper, we reframe the core challenge of compositional generation as one of optimization scheduling. We introduce DecompDreamer, a framework built on a novel staged optimization strategy that functions as an implicit curriculum. Our method first establishes a coherent structural scaffold by prioritizing inter-object relationships before shifting to the high-fidelity refinement of individual components. This temporal decoupling of competing objectives provides a robust solution to gradient conflict. Qualitative and quantitative evaluations on diverse compositional prompts demonstrate that DecompDreamer outperforms state-of-the-art methods in fidelity, disentanglement, and spatial coherence.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
31 of 40 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
19 more
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 97
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2023CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layoutcited by 57
- 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
- 2023TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervisioncited by 28
- 2024CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussianscited by 10
- 2024Deep Geometric Moments Promote Shape Consistency in Text-to-3D Generationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.