3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks
Not on the map. Why?
Abstract (arXiv)
The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D shapes as a collection of simple parts, we explore such an abstract shape representation based on primitives. Given a single depth image of an object, we present 3D-PRNN, a generative recurrent neural network that synthesizes multiple plausible shapes composed of a set of primitives. Our generative model encodes symmetry characteristics of common man-made objects, preserves long-range structural coherence, and describes objects of varying complexity with a compact representation. We also propose a method based on Gaussian Fields to generate a large scale dataset of primitive-based shape representations to train our network. We evaluate our approach on a wide range of examples and show that it outperforms nearest-neighbor based shape retrieval methods and is on-par with voxel-based generative models while using a significantly reduced parameter space.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 13; 2023: 19; 2024: 11; 2025: 8; 2026: 3.
77 papers.
Sort:
By area:
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Searchcited by 61
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
38 more
- 2023D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropoutscited by 39
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2021HPNet: Deep Primitive Segmentation Using Hybrid Representationscited by 35
- 2022Point Primitive Transformer for Long-Term 4D Point Cloud Video Understandingcited by 35
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 34
- 2021PC2WF: 3D Wireframe Reconstruction from Raw Point Cloudscited by 33
- 2021Scene Synthesis via Uncertainty-Driven Attribute Synchronizationcited by 29
- 2021Robust and Accurate Superquadric Recovery: a Probabilistic Approachcited by 29
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 2021CPFN: Cascaded Primitive Fitting Networks for High-Resolution Point Cloudscited by 24
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
- 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
- 2022RIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structurescited by 18
- 2023Marching-Primitives: Shape Abstraction from Signed Distance Functioncited by 18
- 2021Cuboids Revisited: Learning Robust 3D Shape Fitting to Single RGB Imagescited by 17
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Cloudscited by 16
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstructioncited by 16
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2022Primitive-based Shape Abstraction via Nonparametric Bayesian Inferencecited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocitycited by 13
- 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistencycited by 12
- 2023Mixing-Denoising Generalizable Occupancy Networkscited by 12
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformercited by 12
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2023DPF-Net: Combining Explicit Shape Priors in Deformable Primitive Field for Unsupervised Structural Reconstruction of 3D Objectscited by 10
- 2021Fostering Generalization in Single-view 3D Reconstruction by Learning a Hierarchy of Local and Global Shape Priorscited by 9
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimizationcited by 8
- 2021The Shape Part Slot Machine: Contact-based Reasoning for Generating 3D Shapes from Partscited by 7
- 2023Convex Decomposition of Indoor Scenescited by 6
- 2021Learning Mesh Representations via Binary Space Partitioning Tree Networkscited by 5
- 2021HybridSDF: Combining Deep Implicit Shapes and Geometric Primitives for 3D Shape Representation and Manipulationcited by 5
- 2023Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scanscited by 5
- 2023Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistencycited by 5
50 most cited of 77 All 77 (JSON)
- 2026PART: Learning 3D Part Assembly and Retrieval with Transformers17 Sep 2026
- 2026Learning Convex Decomposition via Feature Fields10 Mar 2026
- 2026Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations9 Mar 2026
- 2025Residual Primitive Fitting of 3D Shapes with SuperFrusta9 Dec 2025
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes29 Sep 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes23 Jun 2025
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocity9 Jun 2025
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformer7 May 2025
- 2025Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives10 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers16 Dec 2024
38 more
- 2024TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly22 Jul 2024
- 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorization19 Jul 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweepers8 Jul 2024
- 2024OSN: Infinite Representations of Dynamic 3D Scenes from Monocular Videos8 Jul 2024
- 2024MV2Cyl: Reconstructing 3D Extrusion Cylinders from Multi-View Images16 Jun 2024
- 2024Improved Convex Decomposition with Ensembling and Negative Primitives29 May 2024
- 2024G-FARS: Gradient-Field-based Auto-Regressive Sampling for 3D Part Grouping10 May 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2024Robust Shape Fitting for 3D Scene Abstraction15 Mar 2024
- 2023Point Cloud Part Editing: Segmentation, Generation, Assembly, and Selection19 Dec 2023
- 2023CNC-Net: Self-Supervised Learning for CNC Machining Operations15 Dec 2023
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos11 Dec 2023
- 2023Mixing-Denoising Generalizable Occupancy Networks20 Nov 2023
- 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistency30 Oct 2023
- 2023QuadricsNet: Learning Concise Representation for Geometric Primitives in Point Clouds25 Sep 2023
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Image22 Sep 2023
- 2023Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistency2 Sep 2023
- 2023DPF-Net: Combining Explicit Shape Priors in Deformable Primitive Field for Unsupervised Structural Reconstruction of 3D Objects25 Aug 2023
- 2023Convex Decomposition of Indoor Scenes9 Jul 2023
- 2023BPNet: B'ezier Primitive Segmentation on 3D Point Clouds8 Jul 2023
- 2023Blocks2World: Controlling Realistic Scenes with Editable Primitives7 Jul 2023
- 2023Concavity-Induced Distance for Unoriented Point Cloud Decomposition19 Jun 2023
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization4 May 2023
- 2023Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scans19 Apr 2023
- 2023Attention-based Part Assembly for 3D Volumetric Shape Modeling17 Apr 2023
- 2023Marching-Primitives: Shape Abstraction from Signed Distance Function23 Mar 2023
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervision16 Mar 2023
- 2023D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropouts27 Jan 2023
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Images15 Aug 2022
- 2022Point Primitive Transformer for Long-Term 4D Point Cloud Video Understanding30 Jul 2022
- 2022TreeSketchNet: From Sketch To 3D Tree Parameters Generation25 Jul 2022
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Space9 Jul 2022
- 2022Learning to Infer 3D Shape Programs with Differentiable Renderer25 Jun 2022
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes10 Jun 2022
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstruction27 May 2022
- 2022Primitive3D: 3D Object Dataset Synthesis from Randomly Assembled Primitives25 May 2022
- 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Search5 May 2022
50 newest of 77 All 77 (JSON)
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Searchcited by 61
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
12 most cited of 75 All 75 (JSON)
- 2026PART: Learning 3D Part Assembly and Retrieval with Transformers17 Sep 2026
- 2026Learning Convex Decomposition via Feature Fields10 Mar 2026
- 2025Residual Primitive Fitting of 3D Shapes with SuperFrusta9 Dec 2025
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes29 Sep 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocity9 Jun 2025
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformer7 May 2025
- 2025Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives10 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers16 Dec 2024
- 2024TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly22 Jul 2024
- 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorization19 Jul 2024
12 newest of 75 All 75 (JSON)