Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a deep learning architecture which addresses the problem of 3D semantic segmentation of unstructured point clouds. Compared to previous work, we introduce grouping techniques which define point neighborhoods in the initial world space and the learned feature space. Neighborhoods are important as they allow to compute local or global point features depending on the spatial extend of the neighborhood. Additionally, we incorporate dedicated loss functions to further structure the learned point feature space: the pairwise distance loss and the centroid loss. We show how to apply these mechanisms to the task of 3D semantic segmentation of point clouds and report state-of-the-art performance on indoor and outdoor datasets.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 7; 2023: 4; 2024: 7; 2025: 1.
22 papers.
Sort:
By area:
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 20223D Segmentation of Humans in Point Clouds with Synthetic Datacited by 24
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 24
- 2023Clustering based Point Cloud Representation Learning for 3D Analysiscited by 23
- 2024Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentationcited by 20
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentationcited by 18
- 2023Recent Advances in Multi-modal 3D Intelligence: A Comprehensive Survey and Evaluationcited by 12
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
10 more
- 2022PST: Plant segmentation transformer for 3D point clouds of rapeseed plants at the podding stagecited by 6
- 2022Sequential Point Clouds: A Surveycited by 5
- 2023Full Point Encoding for Local Feature Aggregation in 3D Point Cloudscited by 5
- 2022Understanding the Challenges When 3D Semantic Segmentation Faces Class Imbalanced and OOD Datacited by 4
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Surveycited by 3
- 2025Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gapcited by 1
- 2021Point Cloud Segmentation Using Sparse Temporal Local Attentioncited by 0
- 2022Deep Algebraic Fitting for Multiple Circle Primitives Extraction from Raw Point Cloudscited by 0
- 2024Region-Transformer: Self-Attention Region Based Class-Agnostic Point Cloud Segmentationcited by 0
- 2024Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsamplingcited by 0
- 2025Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap8 Sep 2025
- 2024Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentation29 Oct 2024
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models18 Jul 2024
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directions9 Jun 2024
- 2024Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling21 Mar 2024
- 2024Region-Transformer: Self-Attention Region Based Class-Agnostic Point Cloud Segmentation3 Mar 2024
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentation1 Mar 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
- 2023Recent Advances in Multi-modal 3D Intelligence: A Comprehensive Survey and Evaluation24 Oct 2023
- 2023Clustering based Point Cloud Representation Learning for 3D Analysis27 Jul 2023
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentation23 Jun 2023
- 2023Full Point Encoding for Local Feature Aggregation in 3D Point Clouds8 Mar 2023
10 more
- 20223D Segmentation of Humans in Point Clouds with Synthetic Data1 Dec 2022
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregation29 Sep 2022
- 2022PST: Plant segmentation transformer for 3D point clouds of rapeseed plants at the podding stage27 Jun 2022
- 2022Sequential Point Clouds: A Survey20 Apr 2022
- 2022Deep Algebraic Fitting for Multiple Circle Primitives Extraction from Raw Point Clouds2 Apr 2022
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Dataset17 Mar 2022
- 2022Understanding the Challenges When 3D Semantic Segmentation Faces Class Imbalanced and OOD Data1 Mar 2022
- 2021Point Cloud Segmentation Using Sparse Temporal Local Attention1 Dec 2021
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception12 Sep 2021
- 2021Deep Learning Based 3D Segmentation: A Survey9 Mar 2021
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 20223D Segmentation of Humans in Point Clouds with Synthetic Datacited by 24
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 24
- 2023Clustering based Point Cloud Representation Learning for 3D Analysiscited by 23
- 2024Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentationcited by 20
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentationcited by 18
- 2023Recent Advances in Multi-modal 3D Intelligence: A Comprehensive Survey and Evaluationcited by 12
- 2022PST: Plant segmentation transformer for 3D point clouds of rapeseed plants at the podding stagecited by 6
12 most cited of 21 All 21 (JSON)
- 2025Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap8 Sep 2025
- 2024Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentation29 Oct 2024
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directions9 Jun 2024
- 2024Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling21 Mar 2024
- 2024Region-Transformer: Self-Attention Region Based Class-Agnostic Point Cloud Segmentation3 Mar 2024
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentation1 Mar 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
- 2023Recent Advances in Multi-modal 3D Intelligence: A Comprehensive Survey and Evaluation24 Oct 2023
- 2023Clustering based Point Cloud Representation Learning for 3D Analysis27 Jul 2023
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentation23 Jun 2023
- 2023Full Point Encoding for Local Feature Aggregation in 3D Point Clouds8 Mar 2023
- 20223D Segmentation of Humans in Point Clouds with Synthetic Data1 Dec 2022
12 newest of 21 All 21 (JSON)