PQ-NET: A Generative Part Seq2Seq Network for 3D Shapes
Not on the map. Why?
Abstract (arXiv)
We introduce PQ-NET, a deep neural network which represents and generates 3D shapes via sequential part assembly. The input to our network is a 3D shape segmented into parts, where each part is first encoded into a feature representation using a part autoencoder. The core component of PQ-NET is a sequence-to-sequence or Seq2Seq autoencoder which encodes a sequence of part features into a latent vector of fixed size, and the decoder reconstructs the 3D shape, one part at a time, resulting in a sequential assembly. The latent space formed by the Seq2Seq encoder encodes both part structure and fine part geometry. The decoder can be adapted to perform several generative tasks including shape autoencoding, interpolation, novel shape generation, and single-view 3D reconstruction, where the generated shapes are all composed of meaningful parts.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 20; 2023: 28; 2024: 30; 2025: 16; 2026: 4.
118 papers.
Sort:
By area:
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
38 more
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 57
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
- 2022Breaking Bad: A Dataset for Geometric Fracture and Reassemblycited by 38
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 36
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2021RGL-NET: A Recurrent Graph Learning framework for Progressive Part Assemblycited by 35
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2022Learning to Generate 3D Shapes from a Single Examplecited by 31
- 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 27
- 2023Jigsaw: Learning to Assemble Multiple Fractured Objectscited by 26
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 20233DQD: Generalized Deep 3D Shape Prior via Part-Discretized Diffusion Processcited by 25
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2023Category-Level Multi-Part Multi-Joint 3D Shape Assemblycited by 22
- 2021SP-GAN: Sphere-Guided 3D Shape Generation and Manipulationcited by 21
- 2022Point Scene Understanding via Disentangled Instance Mesh Reconstructioncited by 20
- 2023Graph Transformer GANs for Graph-Constrained House Generationcited by 19
- 2023Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterpartscited by 18
- 20223D Part Assembly Generation with Instance Encoded Transformercited by 17
- 2024Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passingcited by 17
- 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solvingcited by 17
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstructioncited by 16
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Cloudscited by 15
- 2024PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verifycited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
- 2021AutoMate: A Dataset and Learning Approach for Automatic Mating of CAD Assembliescited by 13
- 2022Implicit field supervision for robust non-rigid shape matchingcited by 13
- 2023Scalable Geometric Fracture Assembly via Co-creation Space among Assemblerscited by 13
- 2024Topology-Aware Latent Diffusion for 3D Shape Generationcited by 13
- 2022An Implicit Parametric Morphable Dental Modelcited by 12
- 2024GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesiscited by 12
- 2025GARF: Learning Generalizable 3D Reassembly for Real-World Fracturescited by 12
50 most cited of 118 All 118 (JSON)
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects13 May 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025E-M3RF: An Equivariant Multimodal 3D Re-assembly Framework26 Nov 2025
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Pottery6 Oct 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds20 Aug 2025
- 2025Combinative Matching for Geometric Shape Assembly13 Aug 2025
- 2025Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion20 Jun 2025
- 2025SAR2Struct: Extracting 3D Semantic Structural Representation of Aircraft Targets from Single-View SAR Image7 Jun 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
38 more
- 2025Pl"uckeRF: A Line-based 3D Representation for Few-view Reconstruction4 Jun 2025
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography21 May 2025
- 2025Two by Two: Learning Multi-Task Pairwise Objects Assembly for Generalizable Robot Manipulation9 Apr 2025
- 2025GARF: Learning Generalizable 3D Reassembly for Real-World Fractures7 Apr 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Second9 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers16 Dec 2024
- 2024Manual-PA: Learning 3D Part Assembly from Instruction Diagrams27 Nov 2024
- 2024Geometric Point Attention Transformer for 3D Shape Reassembly26 Nov 2024
- 2024IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos18 Nov 2024
- 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving31 Oct 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2024AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning20 Oct 2024
- 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts18 Oct 2024
- 2024Jigsaw++: Imagining Complete Shape Priors for Object Reassembly15 Oct 2024
- 2024Parameterize Structure with Differentiable Template for 3D Shape Generation14 Oct 2024
- 2024Neurally Integrated Finite Elements for Differentiable Elasticity on Evolving Domains12 Oct 2024
- 2024GaussianBlock: Building Part-Aware Compositional and Editable 3D Scene by Primitives and Gaussians2 Oct 2024
- 2024SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Image24 Sep 2024
- 2024TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly22 Jul 2024
- 2024Component Selection for Craft Assembly Tasks19 Jul 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Clouds17 Jul 2024
- 20243D Geometric Shape Assembly via Efficient Point Cloud Matching15 Jul 2024
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Design14 Jun 2024
- 2024PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verify1 Jun 2024
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image27 May 2024
- 2024PT43D: A Probabilistic Transformer for Generating 3D Shapes from Single Highly-Ambiguous RGB Images20 May 2024
- 2024G-FARS: Gradient-Field-based Auto-Regressive Sampling for 3D Part Grouping10 May 2024
- 2024Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fields2 May 2024
- 2024SPAFormer: Sequential 3D Part Assembly with Transformers9 Mar 2024
- 2024Generative 3D Part Assembly via Part-Whole-Hierarchy Message Passing27 Feb 2024
- 2024GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesis26 Feb 2024
- 2024Topology-Aware Latent Diffusion for 3D Shape Generation31 Jan 2024
- 2024Diverse Part Synthesis for 3D Shape Creation17 Jan 2024
- 2024Graph Transformer GANs with Graph Masked Modeling for Architectural Layout Generation15 Jan 2024
50 newest of 118 All 118 (JSON)
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 27
- 2024Topology-Aware Latent Diffusion for 3D Shape Generationcited by 13
- 2024Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fieldscited by 5
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image27 May 2024
- 2024Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fields2 May 2024
- 2024Topology-Aware Latent Diffusion for 3D Shape Generation31 Jan 2024
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D26 Dec 2023
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar 2023
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec 2022
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 57
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
12 most cited of 110 All 110 (JSON)
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects13 May 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025E-M3RF: An Equivariant Multimodal 3D Re-assembly Framework26 Nov 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds20 Aug 2025
- 2025Combinative Matching for Geometric Shape Assembly13 Aug 2025
- 2025Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion20 Jun 2025
- 2025SAR2Struct: Extracting 3D Semantic Structural Representation of Aircraft Targets from Single-View SAR Image7 Jun 2025
- 2025Pl"uckeRF: A Line-based 3D Representation for Few-view Reconstruction4 Jun 2025
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography21 May 2025
12 newest of 110 All 110 (JSON)