# SAGNet:Structure-aware Generative Network for 3D-Shape Modeling

arXiv: https://arxiv.org/abs/1808.03981 · HTML: https://mlsanity.com/paper/1808.03981/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Aug 2018.

## Built on by (most cited first, 20 of 20)

- [CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly](https://mlsanity.com/paper/2104.05652/) (2021)
- [Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds](https://mlsanity.com/paper/2106.03437/) (2021)
- [MeshArt: Generating Articulated Meshes with Structure-Guided Transformers](https://mlsanity.com/paper/2412.11596/) (2024)
- [RGL-NET: A Recurrent Graph Learning framework for Progressive Part Assembly](https://mlsanity.com/paper/2107.12859/) (2021)
- [Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes](https://mlsanity.com/paper/2206.04942/) (2022)
- [3D Part Assembly Generation with Instance Encoded Transformer](https://mlsanity.com/paper/2207.01779/) (2022)
- [PointInfinity: Resolution-Invariant Point Diffusion Models](https://mlsanity.com/paper/2404.03566/) (2024)
- [AutoMate: A Dataset and Learning Approach for Automatic Mating of CAD Assemblies](https://mlsanity.com/paper/2105.12238/) (2021)
- [SPAFormer: Sequential 3D Part Assembly with Transformers](https://mlsanity.com/paper/2403.05874/) (2024)
- [ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents](https://mlsanity.com/paper/2510.21432/) (2025)
- [NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garments](https://mlsanity.com/paper/2201.13063/) (2022)
- [Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection](https://mlsanity.com/paper/2305.01652/) (2023)
- [Learning Mesh Representations via Binary Space Partitioning Tree Networks](https://mlsanity.com/paper/2106.14274/) (2021)
- [Primitive3D: 3D Object Dataset Synthesis from Randomly Assembled Primitives](https://mlsanity.com/paper/2205.12627/) (2022)
- [Attention-based Part Assembly for 3D Volumetric Shape Modeling](https://mlsanity.com/paper/2304.10986/) (2023)
- [Seg&Struct: The Interplay Between Part Segmentation and Structure Inference for 3D Shape Parsing](https://mlsanity.com/paper/2211.00382/) (2022)
- [Deep Generative Models on 3D Representations: A Survey](https://mlsanity.com/paper/2210.15663/) (2022)
- [StructRe: Rewriting for Structured Shape Modeling](https://mlsanity.com/paper/2311.17510/) (2023)
- [BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity](https://mlsanity.com/paper/2602.20666/) (2026)
- [Diverse Part Synthesis for 3D Shape Creation](https://mlsanity.com/paper/2401.09384/) (2024)

## Abstract (arXiv)

We present SAGNet, a structure-aware generative model for 3D shapes. Given a set of segmented objects of a certain class, the geometry of their parts and the pairwise relationships between them (the structure) are jointly learned and embedded in a latent space by an autoencoder. The encoder intertwines the geometry and structure features into a single latent code, while the decoder disentangles the features and reconstructs the geometry and structure of the 3D model. Our autoencoder consists of two branches, one for the structure and one for the geometry. The key idea is that during the analysis, the two branches exchange information between them, thereby learning the dependencies between structure and geometry and encoding two augmented features, which are then fused into a single latent code. This explicit intertwining of information enables separately controlling the geometry and the structure of the generated models. We evaluate the performance of our method and conduct an ablation study. We explicitly show that encoding of shapes accounts for both similarities in structure and geometry. A variety of quality results generated by SAGNet are presented. The data and code are at https://github.com/zhijieW-94/SAGNet.
