Learning Shape Templates with Structured Implicit Functions
Not on the map. Why?
Abstract (arXiv)
Template 3D shapes are useful for many tasks in graphics and vision, including fitting observation data, analyzing shape collections, and transferring shape attributes. Because of the variety of geometry and topology of real-world shapes, previous methods generally use a library of hand-made templates. In this paper, we investigate learning a general shape template from data. To allow for widely varying geometry and topology, we choose an implicit surface representation based on composition of local shape elements. While long known to computer graphics, this representation has not yet been explored in the context of machine learning for vision. We show that structured implicit functions are suitable for learning and allow a network to smoothly and simultaneously fit multiple classes of shapes. The learned shape template supports applications such as shape exploration, correspondence, abstraction, interpolation, and semantic segmentation from an RGB image.
Key facts. Cited by 242 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 72; 2022: 68; 2023: 43; 2024: 29; 2025: 23; 2026: 7.
242 papers.
Sort:
By area:
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021Advances in Neural Renderingcited by 365
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2021NeRV: Neural Representations for Videoscited by 256
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2021Neural Articulated Radiance Fieldcited by 196
38 more
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2022Generalizable Patch-Based Neural Renderingcited by 122
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2021Neural Lumigraph Renderingcited by 105
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 103
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 93
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 90
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2022GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimationcited by 86
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
- 2022Unified Implicit Neural Stylizationcited by 67
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2023Deep Learning on Implicit Neural Representations of Shapescited by 63
- 2024Advances in 3D Generation: A Surveycited by 63
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fieldscited by 60
- 2021SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimizationcited by 59
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2021UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolutioncited by 57
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 2021Implicit Neural Video Compressioncited by 52
- 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
50 most cited of 242 All 242 (JSON)
- 2026SuperFlex: Deformable Superquadrics for Point Cloud Decomposition1 Jul 2026
- 2026Rascene: High-Fidelity 3D Scene Imaging with mmWave Communication Signals3 Apr 2026
- 2026NOIR: Neural Operator mapping for Implicit Representations13 Mar 2026
- 2026Electrostatics-Inspired Surface Reconstruction (EISR): Recovering 3D Shapes as a Superposition of Poisson's PDE Solutions12 Feb 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2026Implicit Neural Representation-Based Continuous Single Image Super-Resolution: An Empirical Benchmark25 Jan 2026
- 2025In Situ Training of Implicit Neural Compressors for Scientific Simulations via Sketch-Based Regularization4 Nov 2025
- 2025Hierarchical Transformers for Unsupervised 3D Shape Abstraction31 Oct 2025
- 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modeling12 Oct 2025
- 2025A 3D Generation Framework from Cross Modality to Parameterized Primitive9 Oct 2025
- 2025High-Frequency First: A Two-Stage Approach for Improving Image INR21 Aug 2025
38 more
- 2025AutoPartGen: Autogressive 3D Part Generation and Discovery17 Jul 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes23 Jun 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025COSMO-INR: Complex Sinusoidal Modulation for Implicit Neural Representations16 May 2025
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformer7 May 2025
- 2025Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters15 Apr 2025
- 2025ESCT3D: Efficient and Selectively Controllable Text-Driven 3D Content Generation with Gaussian Splatting14 Apr 2025
- 2025Capturing Longitudinal Changes in Brain Morphology Using Temporally Parameterized Neural Displacement Fields13 Apr 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives10 Mar 2025
- 2025GaussianVideo: Efficient Video Representation and Compression by Gaussian Splatting6 Mar 2025
- 2025GenAnalysis: Joint Shape Analysis by Learning Man-Made Shape Generators with Deformation Regularizations2 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2025Few-shot Implicit Function Generation via Equivariance3 Jan 2025
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024INRetouch: Context Aware Implicit Neural Representation for Photography Retouching5 Dec 2024
- 2024Differentiable Topology Estimating from Curvatures for 3D Shapes28 Nov 2024
- 2024Don't Mesh with Me: Generating Constructive Solid Geometry Instead of Meshes by Fine-Tuning a Code-Generation LLM22 Nov 2024
- 2024Shallow Signed Distance Functions for Kinematic Collision Bodies11 Nov 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Optimizing 3D Geometry Reconstruction from Implicit Neural Representations16 Oct 2024
- 2024StegaINR4MIH: steganography by implicit neural representation for multi-image hiding14 Oct 2024
- 2024Neural Video Representation for Redundancy Reduction and Consistency Preservation27 Sep 2024
- 2024Learning Transferable Features for Implicit Neural Representations15 Sep 2024
- 2024Hierarchically Structured Neural Bones for Reconstructing Animatable Objects from Casual Videos1 Aug 2024
- 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks25 Jul 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representations17 Jul 2024
- 2024SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweepers8 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenes25 Jun 2024
- 2024Neural Surface Reconstruction from Sparse Views Using Epipolar Geometry6 Jun 2024
- 2024Quantum Implicit Neural Representations6 Jun 2024
- 2024GenS: Generalizable Neural Surface Reconstruction from Multi-View Images4 Jun 2024
50 newest of 242 All 242 (JSON)
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2024Blaze3DM: Marry Triplane Representation with Diffusion for 3D Medical Inverse Problem Solvingcited by 4
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024Blaze3DM: Marry Triplane Representation with Diffusion for 3D Medical Inverse Problem Solving24 May 2024
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation21 Mar 2023
- 20223D Neural Field Generation using Triplane Diffusion30 Nov 2022
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021Advances in Neural Renderingcited by 365
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021NeRV: Neural Representations for Videoscited by 256
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
12 most cited of 234 All 234 (JSON)
- 2026SuperFlex: Deformable Superquadrics for Point Cloud Decomposition1 Jul 2026
- 2026Rascene: High-Fidelity 3D Scene Imaging with mmWave Communication Signals3 Apr 2026
- 2026NOIR: Neural Operator mapping for Implicit Representations13 Mar 2026
- 2026Electrostatics-Inspired Surface Reconstruction (EISR): Recovering 3D Shapes as a Superposition of Poisson's PDE Solutions12 Feb 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2026Implicit Neural Representation-Based Continuous Single Image Super-Resolution: An Empirical Benchmark25 Jan 2026
- 2025In Situ Training of Implicit Neural Compressors for Scientific Simulations via Sketch-Based Regularization4 Nov 2025
- 2025Hierarchical Transformers for Unsupervised 3D Shape Abstraction31 Oct 2025
- 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modeling12 Oct 2025
- 2025A 3D Generation Framework from Cross Modality to Parameterized Primitive9 Oct 2025
- 2025High-Frequency First: A Two-Stage Approach for Improving Image INR21 Aug 2025
12 newest of 234 All 234 (JSON)