Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits controllability and practical adoption. To address this gap, we present Hunyuan3D-Omni, a unified framework for fine-grained, controllable 3D asset generation built on Hunyuan3D 2.1. In addition to images, Hunyuan3D-Omni accepts point clouds, voxels, bounding boxes, and skeletal pose priors as conditioning signals, enabling precise control over geometry, topology, and pose. Instead of separate heads for each modality, our model unifies all signals in a single cross-modal architecture. We train with a progressive, difficulty-aware sampling strategy that selects one control modality per example and biases sampling toward harder signals (e.g., skeletal pose) while downweighting easier ones (e.g., point clouds), encouraging robust multi-modal fusion and graceful handling of missing inputs. Experiments show that these additional controls improve generation accuracy, enable geometry-aware transformations, and increase robustness for production workflows.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 36 of its 40 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
36 of 40 references.
References · 36
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
24 more
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 44
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
- 2025Unleashing Vecset Diffusion Model for Fast Shape Generationcited by 26
- 2022FBNet: Feedback Network for Point Cloud Completioncited by 20
- 2025RomanTex: Decoupling 3D-aware Rotary Positional Embedded Multi-Attention Network for Texture Synthesiscited by 20
- 2025SymmCompletion: High-Fidelity and High-Consistency Point Cloud Completion with Symmetry Guidancecited by 15
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
Built on by
Citing papers per year: 2025: 3; 2026: 19.
22 papers.
Sort:
By area:
- 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 30
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026Future Optical Flow Prediction Improves Robot Control & Video Generationcited by 7
- 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layoutscited by 6
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Spacecited by 5
- 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphingcited by 4
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
- 2026Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generationcited by 3
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completioncited by 3
- 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
- 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformerscited by 1
10 more
- 2026CRAG: Can 3D Generative Models Help 3D Assembly?cited by 1
- 2026REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancementcited by 1
- 2026MeshReGen: A Unified 3D Geometry Regeneration Frameworkcited by 1
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generationcited by 0
- 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Modelscited by 0
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Trackingcited by 0
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Imagecited by 0
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Tracking10 Aug 2026
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completion22 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026LLM-as-a-Verifier: A General-Purpose Verification Framework6 Jul 2026
- 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models6 Jul 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation22 Jun 2026
- 2026MeshReGen: A Unified 3D Geometry Regeneration Framework30 Apr 2026
- 2026REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancement30 Apr 2026
- 2026Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generation2 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
10 more
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026CRAG: Can 3D Generative Models Help 3D Assembly?26 Feb 2026
- 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformers11 Feb 2026
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Image4 Feb 2026
- 2026HY3D-Bench: Generation of 3D Assets3 Feb 2026
- 2026Future Optical Flow Prediction Improves Robot Control & Video Generation15 Jan 2026
- 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphing1 Jan 2026
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characters18 Dec 2025
- 2025IRPO: Boosting Image Restoration via Post-training GRPO30 Nov 2025
- 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts25 Nov 2025
- 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformerscited by 1
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Trackingcited by 0
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Tracking10 Aug 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformers11 Feb 2026
- 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 30
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026Future Optical Flow Prediction Improves Robot Control & Video Generationcited by 7
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Spacecited by 5
- 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphingcited by 4
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completioncited by 3
- 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
- 2026CRAG: Can 3D Generative Models Help 3D Assembly?cited by 1
- 2026REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancementcited by 1
- 2026MeshReGen: A Unified 3D Geometry Regeneration Frameworkcited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
12 most cited of 15 All 15 (JSON)
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completion22 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation22 Jun 2026
- 2026MeshReGen: A Unified 3D Geometry Regeneration Framework30 Apr 2026
- 2026REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancement30 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026CRAG: Can 3D Generative Models Help 3D Assembly?26 Feb 2026
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Image4 Feb 2026
- 2026HY3D-Bench: Generation of 3D Assets3 Feb 2026
- 2026Future Optical Flow Prediction Improves Robot Control & Video Generation15 Jan 2026
12 newest of 15 All 15 (JSON)