mlsanityData to 7 Oct 2026

Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing

arXiv 2608.02711 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in image generation have demonstrated the potential of unified multimodal models that integrate understanding, generation, and editing. However, unified 3D modeling remains constrained by scarce multimodal data, particularly the lack of large-scale and geometrically consistent editing data. To address this limitation, we propose Hunyuan3D-Buffalo 1.0, a unified framework supporting 3D understanding, text-to-3D generation, instruction-guided 3D editing, and text-grounded part generation within a single architecture. To enable scalable training, we construct an 87M-scale 3D multimodal corpus, comprising 25M understanding samples, 50M text-to-3D pairs, and 12M editing pairs generated using Nano3D-v2. Architecturally, the framework combines Hunyuan3D-VLM for semantic, structural, and spatial understanding with Hunyuan3D DiT for high-fidelity 3D synthesis. The VLM provides multimodal semantic conditions for generation, while editing and part generation additionally condition the diffusion process on the source object representation to preserve its overall structure and unedited regions. Extensive experiments show that Hunyuan3D-Buffalo 1.0 achieves state-of-the-art or leading performance on text-to-3D generation and 3D editing benchmarks, while exhibiting strong understanding and part-generation capabilities. Our analysis further shows that both generation and understanding improve editing, demonstrating the effectiveness of unified 3D multimodal training. Project Page: https://tencent-hunyuan.github.io/Hunyuan3D-Buffalo1.0/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 106 of its 114 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

106 of 114 references.

References · 106

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2025Qwen-Image Technical Reportcited by 973
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
38 more
  1. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  3. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  4. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  5. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  6. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  7. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  8. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  9. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
  10. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  11. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  12. 2025Transfer between Modalities with MetaQueriescited by 231
  13. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  14. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  15. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  16. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
  17. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  18. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  19. 2025Seedream 3.0 Technical Reportcited by 146
  20. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  21. 2025HunyuanImage 3.0 Technical Reportcited by 138
  22. 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 133
  23. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  24. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  25. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  26. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  27. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
  28. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  29. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  30. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
  31. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  32. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  33. 2023GPT4Point: A Unified Framework for Point-Language Understanding and Generationcited by 69
  34. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  35. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  36. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  37. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  38. 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50

50 most cited of 106 All 106 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding
  2. 20253UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene Understanding
  3. 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
  4. 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs
  5. 2026UniMesh: Unifying 3D Mesh Understanding and Generation
  6. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
  7. 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation
  8. 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAE