mlsanityData to 7 Oct 2026

Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training

arXiv 2601.03256 ↗First posted 6 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present Muses, the first training-free method for fantastic 3D creature generation in a feed-forward paradigm. Previous methods, which rely on part-aware optimization, manual assembly, or 2D image generation, often produce unrealistic or incoherent 3D assets due to the challenges of intricate part-level manipulation and limited out-of-domain generation. In contrast, Muses leverages the 3D skeleton, a fundamental representation of biological forms, to explicitly and rationally compose diverse elements. This skeletal foundation formalizes 3D content creation as a structure-aware pipeline of design, composition, and generation. Muses begins by constructing a creatively composed 3D skeleton with coherent layout and scale through graph-constrained reasoning. This skeleton then guides a voxel-based assembly process within a structured latent space, integrating regions from different objects. Finally, image-guided appearance modeling under skeletal conditions is applied to generate a style-consistent and harmonious texture for the assembled shape. Extensive experiments establish Muses' state-of-the-art performance in terms of visual fidelity and alignment with textual descriptions, and potential on flexible 3D object editing. Project page: https://luhexiao.github.io/Muses.github.io/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 76 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

67 of 76 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
  1. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  4. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  6. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  7. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  8. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  9. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  10. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  12. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  13. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  14. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  15. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  16. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  17. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  18. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
  19. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  20. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  21. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  22. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  23. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  24. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  25. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
  26. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  27. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  28. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
  29. 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
  30. 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
  31. 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
  32. 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
  33. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
  34. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
  35. 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
  36. 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusioncited by 31
  37. 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
  38. 2025From One to More: Contextual Part Latents for 3D Generationcited by 26

50 most cited of 67 All 67 (JSON)

Built on by

Not cited yet.