mlsanityData to 14 Oct 2026

Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets

arXiv 2509.21245 ↗First posted 25 Sep 2025cs.CV cs.AIcited by 22

Not on the map. Why?

Abstract (arXiv)

Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits controllability and practical adoption. To address this gap, we present Hunyuan3D-Omni, a unified framework for fine-grained, controllable 3D asset generation built on Hunyuan3D 2.1. In addition to images, Hunyuan3D-Omni accepts point clouds, voxels, bounding boxes, and skeletal pose priors as conditioning signals, enabling precise control over geometry, topology, and pose. Instead of separate heads for each modality, our model unifies all signals in a single cross-modal architecture. We train with a progressive, difficulty-aware sampling strategy that selects one control modality per example and biases sampling toward harder signals (e.g., skeletal pose) while downweighting easier ones (e.g., point clouds), encouraging robust multi-modal fusion and graceful handling of missing inputs. Experiments show that these additional controls improve generation accuracy, enable geometry-aware transformations, and increase robustness for production workflows.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 36 of its 40 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

36 of 40 references.

References · 36

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  7. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  8. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  9. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  11. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  12. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
24 more
  1. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  2. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  3. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  4. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  5. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  6. 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
  7. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  8. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  9. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  10. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
  11. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  12. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
  13. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  14. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
  15. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
  16. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
  17. 2025X-Part: high fidelity and structure coherent shape decompositioncited by 44
  18. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
  19. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  20. 2025Unleashing Vecset Diffusion Model for Fast Shape Generationcited by 26
  21. 2022FBNet: Feedback Network for Point Cloud Completioncited by 20
  22. 2025RomanTex: Decoupling 3D-aware Rotary Positional Embedded Multi-Attention Network for Texture Synthesiscited by 20
  23. 2025SymmCompletion: High-Fidelity and High-Consistency Point Cloud Completion with Symmetry Guidancecited by 15
  24. 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 19.

22 papers.

Sort:

By area:

  1. 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 30
  2. 2026HY3D-Bench: Generation of 3D Assetscited by 11
  3. 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
  4. 2026Future Optical Flow Prediction Improves Robot Control & Video Generationcited by 7
  5. 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layoutscited by 6
  6. 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Spacecited by 5
  7. 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphingcited by 4
  8. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  9. 2026Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generationcited by 3
  10. 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completioncited by 3
  11. 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
  12. 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformerscited by 1
10 more
  1. 2026CRAG: Can 3D Generative Models Help 3D Assembly?cited by 1
  2. 2026REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancementcited by 1
  3. 2026MeshReGen: A Unified 3D Geometry Regeneration Frameworkcited by 1
  4. 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
  5. 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
  6. 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
  7. 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generationcited by 0
  8. 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Modelscited by 0
  9. 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Trackingcited by 0
  10. 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Imagecited by 0