3D Shape Segmentation with Projective Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
This paper introduces a deep architecture for segmenting 3D objects into their labeled semantic parts. Our architecture combines image-based Fully Convolutional Networks (FCNs) and surface-based Conditional Random Fields (CRFs) to yield coherent segmentations of 3D shapes. The image-based FCNs are used for efficient view-based reasoning about 3D object parts. Through a special projection layer, FCN outputs are effectively aggregated across multiple views and scales, then are projected onto the 3D object surfaces. Finally, a surface-based CRF combines the projected outputs with geometric consistency cues to yield coherent segmentations. The whole architecture (multi-view FCNs and CRF) is trained end-to-end. Our approach significantly outperforms the existing state-of-the-art methods in the currently largest segmentation benchmark (ShapeNet). Finally, we demonstrate promising segmentation results on noisy 3D shapes acquired from consumer-grade depth cameras.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 21; 2023: 10; 2024: 7; 2025: 5.
63 papers.
Sort:
By area:
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2021Adaptive Graph Convolution for Point Cloud Analysiscited by 60
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2024Segment Any Meshcited by 37
- 2021PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoningcited by 34
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 2024Query2CAD: Generating CAD models using natural language queriescited by 28
- 2023PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillationcited by 27
- 2021Voint Cloud: Multi-View Point Cloud Representation for 3D Understandingcited by 22
38 more
- 20223D Vision with Transformers: A Surveycited by 21
- 2022Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysiscited by 19
- 2021A Fine-Grained Dataset and its Efficient Semantic Segmentation for Unstructured Driving Scenarioscited by 18
- 2022RIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structurescited by 18
- 2025LitePT: Lighter Yet Stronger Point Transformercited by 17
- 2021Residual 3D Scene Flow Learning with Context-Aware Feature Extractioncited by 15
- 2023CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programscited by 15
- 2024Geometric Deep Learning for Computer-Aided Design: A Surveycited by 14
- 2024iSeg: Interactive 3D Segmentation via Interactive Attentioncited by 14
- 2022AGConv: Adaptive Graph Convolution on 3D Point Cloudscited by 13
- 2023Neural Semantic Surface Mapscited by 13
- 2022Laplacian2Mesh: Laplacian-Based Mesh Understandingcited by 11
- 2022MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentationcited by 10
- 2022SegNeRF: 3D Part Segmentation with Neural Radiance Fieldscited by 9
- 2022Semi-supervised 3D shape segmentation with multilevel consistency and part substitutioncited by 8
- 2023A Review of Panoptic Segmentation for Mobile Mapping Point Cloudscited by 8
- 2021Continuous Conditional Random Field Convolution for Point Cloud Segmentationcited by 7
- 2022MVTN: Learning Multi-View Transformations for 3D Understandingcited by 7
- 2022Neural Part Priors: Learning to Optimize Part-Based Object Completion in RGB-D Scanscited by 6
- 2022Unsupervised Domain Adaptation through Shape Modeling for Medical Image Segmentationcited by 6
- 2021HybridSDF: Combining Deep Implicit Shapes and Geometric Primitives for 3D Shape Representation and Manipulationcited by 5
- 2022Photo-to-Shape Material Transfer for Diverse Structurescited by 5
- 2023Test-Time Augmentation for 3D Point Cloud Classification and Segmentationcited by 4
- 2021Medial Spectral Coordinates for 3D Shape Analysiscited by 3
- 2023Multi-View Representation is What You Need for Point-Cloud Pre-Trainingcited by 3
- 2023MeT: A Graph Transformer for Semantic Segmentation of 3D Meshescited by 3
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Surveycited by 3
- 2025Name That Part: 3D Part Segmentation and Namingcited by 3
- 2021CLOI: An Automated Benchmark Framework For Generating Geometric Digital Twins Of Industrial Facilitiescited by 2
- 2022Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentationcited by 2
- 2022Seg&Struct: The Interplay Between Part Segmentation and Structure Inference for 3D Shape Parsingcited by 2
- 2022Parsing Objects at a Finer Granularity: A Surveycited by 2
- 2021ActivationNet: Representation learning to predict contact quality of interacting 3-D surfaces in engineering designscited by 1
- 2021Learning 3D Mineral Prospectivity from 3D Geological Models Using Convolutional Neural Networks: Application to a Structure-controlled Hydrothermal Gold Depositcited by 1
- 2021iSeg3D: An Interactive 3D Shape Segmentation Toolcited by 1
- 2023Conformal Predictions Enhanced Expert-guided Meshing with Graph Neural Networkscited by 1
- 20233DFusion, A real-time 3D object reconstruction pipeline based on streamed instance segmented datacited by 1
- 2024Constraint-Aware Feature Learning for Parametric Point Cloudcited by 1
50 most cited of 63 All 63 (JSON)
- 2025Name That Part: 3D Part Segmentation and Naming19 Dec 2025
- 2025LitePT: Lighter Yet Stronger Point Transformer15 Dec 2025
- 2025A data-driven approach to linking design features with manufacturing process data for sustainable product development10 Dec 2025
- 2025Relaxed Total Generalized Variation Regularized Piecewise Smooth Mumford-Shah Model for Triangulated Surface Segmentation25 Jul 2025
- 2025InfoGNN: End-to-end deep learning on mesh via graph neural networks4 Mar 2025
- 2024Constraint-Aware Feature Learning for Parametric Point Cloud12 Nov 2024
- 2024Segment Any Mesh24 Aug 2024
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers26 Jul 2024
- 2024Query2CAD: Generating CAD models using natural language queries31 May 2024
- 2024iSeg: Interactive 3D Segmentation via Interactive Attention4 Apr 2024
- 2024Geometric Deep Learning for Computer-Aided Design: A Survey27 Feb 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
38 more
- 2023PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation7 Dec 2023
- 2023CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs28 Nov 2023
- 2023Test-Time Augmentation for 3D Point Cloud Classification and Segmentation22 Nov 2023
- 20233DFusion, A real-time 3D object reconstruction pipeline based on streamed instance segmented data11 Nov 2023
- 2023Neural Semantic Surface Maps9 Sep 2023
- 2023Conformal Predictions Enhanced Expert-guided Meshing with Graph Neural Networks14 Aug 2023
- 2023MeT: A Graph Transformer for Semantic Segmentation of 3D Meshes3 Jul 2023
- 2023Multi-View Representation is What You Need for Point-Cloud Pre-Training5 Jun 2023
- 2023A Review of Panoptic Segmentation for Mobile Mapping Point Clouds27 Apr 2023
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapes11 Apr 2023
- 2022Parsing Objects at a Finer Granularity: A Survey28 Dec 2022
- 2022MVTN: Learning Multi-View Transformations for 3D Understanding27 Dec 2022
- 2022Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis17 Dec 2022
- 2022SegNeRF: 3D Part Segmentation with Neural Radiance Fields21 Nov 2022
- 2022Deep scene-scale material estimation from multi-view indoor captures15 Nov 2022
- 2022Seg&Struct: The Interplay Between Part Segmentation and Structure Inference for 3D Shape Parsing1 Nov 2022
- 2022HAVANA: Hard negAtiVe sAmples aware self-supervised coNtrastive leArning for Airborne laser scanning point clouds semantic segmentation19 Oct 2022
- 2022Shrinking unit: a Graph Convolution-Based Unit for CNN-like 3D Point Cloud Feature Extractors26 Sep 2022
- 2022MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentation18 Aug 2022
- 20223D Vision with Transformers: A Survey8 Aug 2022
- 2022Unsupervised Domain Adaptation through Shape Modeling for Medical Image Segmentation6 Jul 2022
- 2022Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation27 Jun 2022
- 2022AGConv: Adaptive Graph Convolution on 3D Point Clouds9 Jun 2022
- 2022Photo-to-Shape Material Transfer for Diverse Structures9 May 2022
- 2022Synthetic Point Cloud Generation for Class Segmentation Applications7 May 2022
- 2022Semi-supervised 3D shape segmentation with multilevel consistency and part substitution19 Apr 2022
- 2022Neural Part Priors: Learning to Optimize Part-Based Object Completion in RGB-D Scans17 Mar 2022
- 2022Contrastive Boundary Learning for Point Cloud Segmentation10 Mar 2022
- 2022Laplacian2Mesh: Laplacian-Based Mesh Understanding1 Feb 2022
- 2022RIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structures30 Jan 2022
- 2022Learning Semantic Abstraction of Shape via 3D Region of Interest13 Jan 2022
- 2021iSeg3D: An Interactive 3D Shape Segmentation Tool24 Dec 2021
- 2021Cloud Sphere: A 3D Shape Representation via Progressive Deformation21 Dec 2021
- 2021Set Twister for Single-hop Node Classification17 Dec 2021
- 2021PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning9 Dec 2021
- 2021Voint Cloud: Multi-View Point Cloud Representation for 3D Understanding30 Nov 2021
- 2021Medial Spectral Coordinates for 3D Shape Analysis26 Nov 2021
- 2021Continuous Conditional Random Field Convolution for Point Cloud Segmentation12 Oct 2021
50 newest of 63 All 63 (JSON)
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2021Adaptive Graph Convolution for Point Cloud Analysiscited by 60
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2024Segment Any Meshcited by 37
- 2021PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoningcited by 34
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 2024Query2CAD: Generating CAD models using natural language queriescited by 28
- 2021Voint Cloud: Multi-View Point Cloud Representation for 3D Understandingcited by 22
- 20223D Vision with Transformers: A Surveycited by 21
12 most cited of 62 All 62 (JSON)
- 2025Name That Part: 3D Part Segmentation and Naming19 Dec 2025
- 2025LitePT: Lighter Yet Stronger Point Transformer15 Dec 2025
- 2025A data-driven approach to linking design features with manufacturing process data for sustainable product development10 Dec 2025
- 2025Relaxed Total Generalized Variation Regularized Piecewise Smooth Mumford-Shah Model for Triangulated Surface Segmentation25 Jul 2025
- 2025InfoGNN: End-to-end deep learning on mesh via graph neural networks4 Mar 2025
- 2024Constraint-Aware Feature Learning for Parametric Point Cloud12 Nov 2024
- 2024Segment Any Mesh24 Aug 2024
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers26 Jul 2024
- 2024Query2CAD: Generating CAD models using natural language queries31 May 2024
- 2024iSeg: Interactive 3D Segmentation via Interactive Attention4 Apr 2024
- 2024Geometric Deep Learning for Computer-Aided Design: A Survey27 Feb 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
12 newest of 62 All 62 (JSON)