SDM-NET: Deep Generative Network for Structured Deformable Mesh
Not on the map. Why?
Abstract (arXiv)
We introduce SDM-NET, a deep generative neural network which produces structured deformable meshes. Specifically, the network is trained to generate a spatial arrangement of closed, deformable mesh parts, which respect the global part structure of a shape collection, e.g., chairs, airplanes, etc. Our key observation is that while the overall structure of a 3D shape can be complex, the shape can usually be decomposed into a set of parts, each homeomorphic to a box, and the finer-scale geometry of the part can be recovered by deforming the box. The architecture of SDM-NET is that of a two-level variational autoencoder (VAE). At the part level, a PartVAE learns a deformable model of part geometries. At the structural level, we train a Structured Parts VAE (SP-VAE), which jointly learns the part structure of a shape collection and the part geometries, ensuring a coherence between global shape structure and surface details. Through extensive experiments and comparisons with the state-of-the-art deep generative models of shapes, we demonstrate the superiority of SDM-NET in generating meshes with visual quality, flexible topology, and meaningful structures, which benefit shape interpolation and other subsequently modeling tasks.
Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 17; 2023: 26; 2024: 20; 2025: 17; 2026: 7.
113 papers.
Sort:
By area:
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
38 more
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2024Advances in 3D Generation: A Surveycited by 62
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2021Neural Marching Cubescited by 50
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 44
- 2021Joint Learning of 3D Shape Retrieval and Deformationcited by 41
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2021RGL-NET: A Recurrent Graph Learning framework for Progressive Part Assemblycited by 35
- 2021PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoningcited by 34
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
- 2022SPAGHETTI: Editing Implicit Shapes Through Part Aware Generationcited by 28
- 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
- 2024Mesh-based Gaussian Splatting for Real-time Large-scale Deformationcited by 28
- 2021BIKED: A Dataset for Computational Bicycle Design with Machine Learning Benchmarkscited by 27
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2021OctField: Hierarchical Implicit Functions for 3D Modelingcited by 25
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2023Text-to-3D Generation with Bidirectional Diffusion using both 2D and 3D priorscited by 24
- 2023Category-Level Multi-Part Multi-Joint 3D Shape Assemblycited by 22
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillationcited by 18
- 20223D Part Assembly Generation with Instance Encoded Transformercited by 17
- 2024Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passingcited by 17
- 2021GLASS: Geometric Latent Augmentation for Shape Spacescited by 16
50 most cited of 113 All 113 (JSON)
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes27 Jul 2026
- 2026Mat'ern Noise for Triangulation-Agnostic Flow Matching on Meshes19 May 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents24 Oct 2025
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
38 more
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds20 Aug 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025SAR2Struct: Extracting 3D Semantic Structural Representation of Aircraft Targets from Single-View SAR Image7 Jun 2025
- 2025CLR-Wire: Towards Continuous Latent Representations for 3D Curve Wireframe Generation27 Apr 2025
- 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformation17 Apr 2025
- 2025Recent Advances in 3D Object and Scene Generation: A Survey16 Apr 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025Mesh Compression with Quantized Neural Displacement Fields28 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers16 Dec 2024
- 2024DAGSM: Disentangled Avatar Generation with GS-enhanced Mesh20 Nov 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2024Parameterize Structure with Differentiable Template for 3D Shape Generation14 Oct 2024
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion6 Aug 2024
- 20244Dynamic: Text-to-4D Generation with Hybrid Priors17 Jul 2024
- 2024Generative AI-based Prompt Evolution Engineering Design Optimization With Vision-Language Model13 Jun 2024
- 2024CoFie: Learning Compact Neural Surface Representations with Coordinate Fields5 Jun 2024
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image27 May 2024
- 2024PhyRecon: Physically Plausible Neural Scene Reconstruction25 Apr 2024
- 2024Magic-Boost: Boost 3D Generation with Multi-View Conditioned Diffusion9 Apr 2024
- 2024Recent Advances in 3D Gaussian Splatting17 Mar 2024
- 2024KP-RED: Exploiting Semantic Keypoints for Joint 3D Shape Retrieval and Deformation15 Mar 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024SPAFormer: Sequential 3D Part Assembly with Transformers9 Mar 2024
- 2024Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passing27 Feb 2024
- 2024E(3)-Equivariant Mesh Neural Networks7 Feb 2024
- 2024Mesh-based Gaussian Splatting for Real-time Large-scale Deformation7 Feb 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023CAGE: Controllable Articulation GEneration15 Dec 2023
- 2023Partial Symmetry Detection for 3D Geometry using Contrastive Learning with Geodesic Point Cloud Patches13 Dec 2023
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillation11 Dec 2023
- 2023Text-to-3D Generation with Bidirectional Diffusion using both 2D and 3D priors7 Dec 2023
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies6 Dec 2023
- 2023StructRe: Rewriting for Structured Shape Modeling29 Nov 2023
50 newest of 113 All 113 (JSON)
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillationcited by 18
- 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generationcited by 8
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillationcited by 6
- 2024Magic-Boost: Boost 3D Generation with Multi-View Conditioned Diffusioncited by 2
12 most cited of 14 All 14 (JSON)
- 2026Mat'ern Noise for Triangulation-Agnostic Flow Matching on Meshes19 May 2026
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 20244Dynamic: Text-to-4D Generation with Hybrid Priors17 Jul 2024
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image27 May 2024
- 2024Magic-Boost: Boost 3D Generation with Multi-View Conditioned Diffusion9 Apr 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillation11 Dec 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar 2023
12 newest of 14 All 14 (JSON)
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 5
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
12 most cited of 97 All 97 (JSON)
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes27 Jul 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents24 Oct 2025
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds20 Aug 2025
- 20253D Shape Generation: A Survey27 Jun 2025
12 newest of 97 All 97 (JSON)