Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing
Not on the map. Why?
Abstract (arXiv)
Recent advances in image generation have demonstrated the potential of unified multimodal models that integrate understanding, generation, and editing. However, unified 3D modeling remains constrained by scarce multimodal data, particularly the lack of large-scale and geometrically consistent editing data. To address this limitation, we propose Hunyuan3D-Buffalo 1.0, a unified framework supporting 3D understanding, text-to-3D generation, instruction-guided 3D editing, and text-grounded part generation within a single architecture. To enable scalable training, we construct an 87M-scale 3D multimodal corpus, comprising 25M understanding samples, 50M text-to-3D pairs, and 12M editing pairs generated using Nano3D-v2. Architecturally, the framework combines Hunyuan3D-VLM for semantic, structural, and spatial understanding with Hunyuan3D DiT for high-fidelity 3D synthesis. The VLM provides multimodal semantic conditions for generation, while editing and part generation additionally condition the diffusion process on the source object representation to preserve its overall structure and unedited regions. Extensive experiments show that Hunyuan3D-Buffalo 1.0 achieves state-of-the-art or leading performance on text-to-3D generation and 3D editing benchmarks, while exhibiting strong understanding and part-generation capabilities. Our analysis further shows that both generation and understanding improve editing, demonstrating the effectiveness of unified 3D multimodal training. Project Page: https://tencent-hunyuan.github.io/Hunyuan3D-Buffalo1.0/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 106 of its 114 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
106 of 114 references.
References · 106
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2025Qwen-Image Technical Reportcited by 973
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
38 more
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2025Seedream 3.0 Technical Reportcited by 146
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 133
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
- 2023GPT4Point: A Unified Framework for Point-Language Understanding and Generationcited by 69
- 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
- 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50
50 most cited of 106 All 106 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding
- 20253UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene Understanding
- 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
- 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation
- 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAE