Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training
Not on the map. Why?
Abstract (arXiv)
We present Muses, the first training-free method for fantastic 3D creature generation in a feed-forward paradigm. Previous methods, which rely on part-aware optimization, manual assembly, or 2D image generation, often produce unrealistic or incoherent 3D assets due to the challenges of intricate part-level manipulation and limited out-of-domain generation. In contrast, Muses leverages the 3D skeleton, a fundamental representation of biological forms, to explicitly and rationally compose diverse elements. This skeletal foundation formalizes 3D content creation as a structure-aware pipeline of design, composition, and generation. Muses begins by constructing a creatively composed 3D skeleton with coherent layout and scale through graph-constrained reasoning. This skeleton then guides a voxel-based assembly process within a structured latent space, integrating regions from different objects. Finally, image-guided appearance modeling under skeletal conditions is applied to generate a style-consistent and harmonious texture for the assembled shape. Extensive experiments establish Muses' state-of-the-art performance in terms of visual fidelity and alignment with textual descriptions, and potential on flexible 3D object editing. Project page: https://luhexiao.github.io/Muses.github.io/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 76 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
67 of 76 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2025Qwen3 Technical Reportcited by 8,195
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
- 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusioncited by 31
- 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.