Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes
Not on the map. Why?
Abstract (arXiv)
This paper introduces a novel framework called DTNet for 3D mesh reconstruction and generation via Disentangled Topology. Beyond previous works, we learn a topology-aware neural template specific to each input then deform the template to reconstruct a detailed mesh while preserving the learned topology. One key insight is to decouple the complex mesh reconstruction into two sub-tasks: topology formulation and shape deformation. Thanks to the decoupling, DT-Net implicitly learns a disentangled representation for the topology and shape in the latent space. Hence, it can enable novel disentangled controls for supporting various shape generation applications, e.g., remix the topologies of 3D objects, that are not achievable by previous reconstruction works. Extensive experimental results demonstrate that our method is able to produce high-quality meshes, particularly with diverse topologies, as compared with the state-of-the-art methods.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 63 of its 83 references that are in the map. First posted on arXiv 10 Jun 2022.
Builds on
63 of 83 references.
References · 63
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
38 more
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2019CvxNet: Learnable Convex Decompositioncited by 174
- 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 124
- 2019PQ-NET: A Generative Part Seq2Seq Network for 3D Shapescited by 119
- 2020Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondencecited by 119
- 2019SDM-NET: Deep Generative Network for Structured Deformable Meshcited by 113
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
- 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
- 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
- 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
- 2019BAE-NET: Branched Autoencoder for Shape Co-Segmentationcited by 89
- 2020Deep Implicit Templates for 3D Shape Representationcited by 86
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 20173D-PRNN: Generating Shape Primitives with Recurrent Neural Networkscited by 77
- 2018Learning Shape Priors for Single-View 3D Completion and Reconstructioncited by 68
- 2020Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flowscited by 61
- 2020Unsupervised Shape and Pose Disentanglement for 3D Meshescited by 61
- 2019StructureNet: Hierarchical Graph Networks for 3D Shape Generationcited by 59
- 2018Im2Struct: Recovering 3D Shape Structure from a Single RGB Imagecited by 55
- 2020Implicit Mesh Reconstruction from Unannotated Image Collectionscited by 49
- 2017OctNetFusion: Learning Depth Fusion from Datacited by 45
- 2020D2IM-Net: Learning Detail Disentangled Implicit Fields from Single Imagescited by 42
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 14; 2024: 4; 2025: 8; 2026: 7.
34 papers.
Sort:
By area:
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2022Neural Shape Deformation Priorscited by 27
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2023SDF4CHD: Generative Modeling of Cardiac Anatomies with Congenital Heart Defectscited by 17
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2023Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptionscited by 11
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimizationcited by 9
22 more
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistencycited by 9
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimizationcited by 8
- 2024Self-supervised Learning of Hybrid Part-aware 3D Representations of 2D Gaussians and Superquadricscited by 8
- 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 7
- 2023Explorable Mesh Deformation Subspaces from Unstructured Generative Modelscited by 6
- 2023Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloudcited by 6
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
- 2023Adaptive Local Basis Functions for Shape Completioncited by 4
- 2023Point Cloud Part Editing: Segmentation, Generation, Assembly, and Selectioncited by 4
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methodscited by 3
- 2023Semantic-Aware Implicit Template Learning via Part Deformation Consistencycited by 3
- 2026EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentationcited by 3
- 2023Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Artcited by 1
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generationcited by 1
- 2025Relational Anatomical Supervision for Accurate 3D Multi-Chamber Cardiac Mesh Reconstructioncited by 1
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidancecited by 1
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularitycited by 1
- 2023Pix2Repair: Implicit Shape Restoration from Imagescited by 0
- 2025WonderVerse: Extendable 3D Scene Generation with Video Generative Modelscited by 0
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editingcited by 0
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modelingcited by 0
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representationcited by 0
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation8 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistency21 Feb 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025FullPart: Generating each 3D Part at Full Resolution30 Oct 2025
- 2025AutoPartGen: Autogressive 3D Part Generation and Discovery17 Jul 2025
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing16 Jul 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025WonderVerse: Extendable 3D Scene Generation with Video Generative Models12 Mar 2025
22 more
- 2025Relational Anatomical Supervision for Accurate 3D Multi-Chamber Cardiac Mesh Reconstruction10 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024Self-supervised Learning of Hybrid Part-aware 3D Representations of 2D Gaussians and Superquadrics20 Aug 2024
- 2024ShapeFusion: A 3D diffusion model for localized shape editing28 Mar 2024
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization4 Feb 2024
- 2023Point Cloud Part Editing: Segmentation, Generation, Assembly, and Selection19 Dec 2023
- 2023Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art16 Nov 2023
- 2023Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloud13 Nov 2023
- 2023SDF4CHD: Generative Modeling of Cardiac Anatomies with Congenital Heart Defects1 Nov 2023
- 2023Explorable Mesh Deformation Subspaces from Unstructured Generative Models11 Oct 2023
- 2023Semantic-Aware Implicit Template Learning via Part Deformation Consistency23 Aug 2023
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfer26 Jul 2023
- 2023Adaptive Local Basis Functions for Shape Completion17 Jul 2023
- 2023Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions9 Jun 2023
- 2023Pix2Repair: Implicit Shape Restoration from Images29 May 2023
- 2023NAP: Neural 3D Articulation Prior25 May 2023
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation21 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation1 Feb 2023
- 2022Neural Shape Deformation Priors11 Oct 2022
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 7
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularitycited by 1
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024ShapeFusion: A 3D diffusion model for localized shape editing28 Mar 2024
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation21 Mar 2023
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2022Neural Shape Deformation Priorscited by 27
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2023SDF4CHD: Generative Modeling of Cardiac Anatomies with Congenital Heart Defectscited by 17
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2023Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptionscited by 11
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimizationcited by 9
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistencycited by 9
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimizationcited by 8
- 2024Self-supervised Learning of Hybrid Part-aware 3D Representations of 2D Gaussians and Superquadricscited by 8
12 most cited of 29 All 29 (JSON)
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation8 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistency21 Feb 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025FullPart: Generating each 3D Part at Full Resolution30 Oct 2025
- 2025AutoPartGen: Autogressive 3D Part Generation and Discovery17 Jul 2025
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing16 Jul 2025
- 2025WonderVerse: Extendable 3D Scene Generation with Video Generative Models12 Mar 2025
- 2025Relational Anatomical Supervision for Accurate 3D Multi-Chamber Cardiac Mesh Reconstruction10 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
12 newest of 29 All 29 (JSON)