Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
While 3D generative models have greatly improved artists' workflows, the existing diffusion models for 3D generation suffer from slow generation and poor generalization. To address this issue, we propose a two-stage approach named Hunyuan3D 1.0 including a lite version and a standard version, that both support text- and image-conditioned generation. In the first stage, we employ a multi-view diffusion model that efficiently generates multi-view RGB in approximately 4 seconds. These multi-view images capture rich details of the 3D asset from different viewpoints, relaxing the tasks from single-view to multi-view reconstruction. In the second stage, we introduce a feed-forward reconstruction model that rapidly and faithfully reconstructs the 3D asset given the generated multi-view images in approximately 7 seconds. The reconstruction network learns to handle noises and in-consistency introduced by the multi-view diffusion and leverages the available information from the condition image to efficiently recover the 3D structure. Our framework involves the text-to-image model, i.e., Hunyuan-DiT, making it a unified framework to support both text- and image-conditioned 3D generation. Our standard version has 3x more parameters than our lite and other existing model. Our Hunyuan3D 1.0 achieves an impressive balance between speed and quality, significantly reducing generation time while maintaining the quality and diversity of the produced assets.
Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. First posted on arXiv 4 Nov 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 4; 2025: 47; 2026: 31.
82 papers.
Sort:
By area:
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 20253D and 4D World Modeling: A Surveycited by 67
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 62
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 41
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
38 more
- 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 16
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
- 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2025Towards Scalable and Consistent 3D Editingcited by 10
- 2025Are We Ready for RL in Text-to-3D Generation? A Progressive Investigationcited by 10
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligencecited by 10
- 2025MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processingcited by 8
- 20253D Object Manipulation in a Single Image using Generative Modelscited by 7
- 2025Video Perception Models for 3D Scene Synthesiscited by 7
- 2025Topology-Preserved Auto-regressive Mesh Generation in the Manner of Weaving Silkcited by 7
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Modelscited by 7
- 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagerycited by 7
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 7
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 7
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editingcited by 6
- 2025DiMeR: Disentangled Mesh Reconstruction Modelcited by 6
- 2025FreeMesh: Boosting Mesh Generation with Coordinates Mergingcited by 6
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshescited by 6
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 6
- 2024Grid: Omni Visual Generationcited by 5
- 2025Flash Sculptor: Modular 3D Worlds from Objectscited by 5
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 5
- 2025MASH: Masked Anchored SpHerical Distances for 3D Shape Representation and Generationcited by 4
- 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphingcited by 4
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
- 2026JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environmentscited by 4
- 2026AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animationcited by 4
- 2024Text-to-3D Generation by 2D Editingcited by 3
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillationcited by 3
- 2026Fast-SAM3D: 3Dfy Anything in Images but Fastercited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026ReplicateAnyScene: Zero-Shot Video-to-3D Composition via Textual-Visual-Spatial Alignmentcited by 3
50 most cited of 82 All 82 (JSON)
- 2026Position Forcing: Self-Conditioning 3D Generation7 Oct 2026
- 2026Elucidating the Design Space of Regression-based Diffusion Reinforcement Learning27 Sep 2026
- 2026OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization24 Sep 2026
- 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintings17 Sep 2026
- 2026AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps8 Sep 2026
- 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Images6 Sep 2026
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generation15 Jul 2026
- 2026PoseAlign: Sculpting Pose-Consistent Meshes via Text-Guided Deformation12 Jul 2026
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation7 Jul 2026
38 more
- 2026Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation30 Jun 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026ABot-Earth 0.5: Generative 3D Earth Model8 Jun 2026
- 2026SceneConductor: 3D Scene Generation from a Single Image with Multi-Agent Orchestration7 Jun 2026
- 2026AnySurf: Any Surface Generation with Directed Edge23 May 2026
- 2026DecoRec: Decomposed 3D Scene Reconstruction from Single-View Images via Object-Level Diffusion16 May 2026
- 2026MOC-3D: Manifold-Order Consistency for Text-to-3D Generation3 May 2026
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations29 Apr 2026
- 2026AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animation29 Apr 2026
- 2026ReplicateAnyScene: Zero-Shot Video-to-3D Composition via Textual-Visual-Spatial Alignment12 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Models24 Mar 2026
- 2026SMAL-pets: SMAL Based Avatars of Pets from Single Image17 Mar 2026
- 2026DogWeave: High-Fidelity 3D Canine Reconstruction from a Single Image via Normal Fusion and Conditional Inpainting8 Mar 2026
- 2026JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environments20 Feb 2026
- 2026Fast-SAM3D: 3Dfy Anything in Images but Faster5 Feb 2026
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Image4 Feb 2026
- 2026MorphAny3D: Unleashing the Power of Structured Latent in 3D Morphing1 Jan 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3D15 Dec 2025
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence14 Dec 2025
- 2025Are We Ready for RL in Text-to-3D Generation? A Progressive Investigation11 Dec 2025
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherence26 Nov 2025
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov 2025
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scale24 Nov 2025
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion20 Nov 2025
- 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery14 Nov 2025
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models14 Nov 2025
- 2025Track, Inpaint, Resplat: Subject-driven 3D and 4D Generation with Progressive Texture Infilling27 Oct 2025
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generation27 Oct 2025
- 2025Towards Scalable and Consistent 3D Editing3 Oct 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation29 Sep 2025
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes29 Sep 2025
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets25 Sep 2025
- 2025Pain in 3D: Generating Controllable Synthetic Faces for Automated Pain Assessment20 Sep 2025
- 2025Generative AI Pipeline for Interactive Prompt-driven 2D-to-3D Vascular Reconstruction for Fontan Geometries from Contrast-Enhanced X-Ray Fluoroscopy Imaging16 Sep 2025
50 newest of 82 All 82 (JSON)
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
- 20253D Object Manipulation in a Single Image using Generative Modelscited by 7
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
- 2024Text-to-3D Generation by 2D Editingcited by 3
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillationcited by 3
- 2026Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generationcited by 1
- 2025MoDA: Multi-modal Diffusion Architecture for Talking Head Generationcited by 0
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generation15 Jul 2026
- 2026Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation30 Jun 2026
- 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Models24 Mar 2026
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion20 Nov 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation29 Sep 2025
- 2025DreamLifting: A Plug-in Module Lifting MV Diffusion Models for 3D Asset Generation9 Sep 2025
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillation4 Sep 2025
- 2025MoDA: Multi-modal Diffusion Architecture for Talking Head Generation4 Jul 2025
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details19 Jun 2025
- 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation3 Mar 2025
- 20253D Object Manipulation in a Single Image using Generative Models22 Jan 2025
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan 2025
12 newest of 14 All 14 (JSON)
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 62
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 16
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 41
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2025Towards Scalable and Consistent 3D Editingcited by 10
- 2025Are We Ready for RL in Text-to-3D Generation? A Progressive Investigationcited by 10
- 2025MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processingcited by 8
12 most cited of 58 All 58 (JSON)
- 2026Position Forcing: Self-Conditioning 3D Generation7 Oct 2026
- 2026OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization24 Sep 2026
- 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintings17 Sep 2026
- 2026AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps8 Sep 2026
- 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Images6 Sep 2026
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026PoseAlign: Sculpting Pose-Consistent Meshes via Text-Guided Deformation12 Jul 2026
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation7 Jul 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026ABot-Earth 0.5: Generative 3D Earth Model8 Jun 2026
12 newest of 58 All 58 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
- 2023MVDream: Multi-view Diffusion for 3D Generation
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy
- 2024BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion
- 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
- 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesis
- 2024Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion
- 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curation