HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D content generation remains a fundamental yet challenging task due to the inherent structural complexity of 3D data. While recent octree-based diffusion models offer a promising balance between efficiency and quality through hierarchical generation, they often overlook two key insights: 1) existing methods typically model 3D objects as holistic entities, ignoring their semantic part hierarchies and limiting generalization; and 2) holistic high-resolution modeling is computationally expensive, whereas real-world objects are inherently sparse and hierarchical, making them well-suited for layered generation. Motivated by these observations, we propose HierOctFusion, a part-aware multi-scale octree diffusion model that enhances hierarchical feature interaction for generating fine-grained and sparse object structures. Furthermore, we introduce a cross-attention conditioning mechanism that injects part-level information into the generation process, enabling semantic features to propagate effectively across hierarchical levels from parts to the whole. Additionally, we construct a 3D dataset with part category annotations using a pre-trained segmentation model to facilitate training and evaluation. Experiments demonstrate that HierOctFusion achieves superior shape quality and efficiency compared to prior methods.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 35 of its 41 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
35 of 41 references.
Closest ancestors · 9
Same direction, newest first
- 2025Geometry and Perception Guided Gaussians for Multiview-consistent 3D Generation from a Single Image26 Jun
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generation27 Dec
- 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
- 20223D Neural Field Generation using Triplane Diffusion30 Nov
- 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions24 Nov
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 26
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Generative Adversarial Networkscited by 5,627
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2017Neural 3D Mesh Renderercited by 437
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
14 more
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2020Generative 3D Part Assembly via Dynamic Graph Learningcited by 67
- 2020Learning 3D Part Assembly from a Single Imagecited by 52
- 2021Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learningcited by 52
- 2024Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passingcited by 19
- 2023Unsupervised 3D Shape Reconstruction by Part Retrieval and Assemblycited by 7
- 2024AugGS: Self-augmented Gaussians with Structural Masks for Sparse-view 3D Reconstructioncited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functionscited by 0
- 2026ZODIAC: Zero-shot Octree-based Diffusion for Anatomical Completioncited by 0
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstructioncited by 0
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction1 Oct 2026
- 2026ZODIAC: Zero-shot Octree-based Diffusion for Anatomical Completion25 Aug 2026
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
- 2025From One to More: Contextual Part Latents for 3D Generation
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generation
- 2024LT3SD: Latent Trees for 3D Scene Diffusion
- 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridging
- 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior