mlsanityData to 7 Oct 2026

Deep Learning-Based 3D Instance and Semantic Segmentation: A Review

arXiv 2406.13308 ↗First posted 19 Jun 2024cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The process of segmenting point cloud data into several homogeneous areas with points in the same region having the same attributes is known as 3D segmentation. Segmentation is challenging with point cloud data due to substantial redundancy, fluctuating sample density and lack of apparent organization. The research area has a wide range of robotics applications, including intelligent vehicles, autonomous mapping and navigation. A number of researchers have introduced various methodologies and algorithms. Deep learning has been successfully used to a spectrum of 2D vision domains as a prevailing A.I. methods. However, due to the specific problems of processing point clouds with deep neural networks, deep learning on point clouds is still in its initial stages. This study examines many strategies that have been presented to 3D instance and semantic segmentation and gives a complete assessment of current developments in deep learning-based 3D segmentation. In these approaches benefits, draw backs, and design mechanisms are studied and addressed. This study evaluates the impact of various segmentation algorithms on competitiveness on various publicly accessible datasets, as well as the most often used pipelines, their advantages and limits, insightful findings and intriguing future research directions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 19 Jun 2024.

Builds on

29 of 57 references.

References · 29

  1. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  2. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  3. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  4. 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
  5. 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
  6. 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
  7. 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 318
  8. 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
  9. 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 216
  10. 2020OccuSeg: Occupancy-aware 3D Instance Segmentationcited by 177
  11. 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
  12. 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
17 more
  1. 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 168
  2. 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
  3. 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 140
  4. 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 97
  5. 2019Associatively Segmenting Instances and Semantics in Point Cloudscited by 86
  6. 2017Deep Projective 3D Semantic Segmentationcited by 81
  7. 20193D Instance Segmentation via Multi-Task Metric Learningcited by 79
  8. 2018Depth-aware CNN for RGB-D Segmentationcited by 73
  9. 2019JSIS3D: Joint Semantic-Instance Segmentation of 3D Point Clouds with Multi-Task Pointwise Networks and Multi-Value Conditional Random Fieldscited by 62
  10. 2013Indoor Semantic Segmentation using depth informationcited by 56
  11. 2016Joint Semantic Segmentation and Depth Estimation with Deep Convolutional Networkscited by 36
  12. 2020Review: deep learning on 3D point cloudscited by 29
  13. 2018Affinity Derivation and Graph Merge for Instance Segmentationcited by 25
  14. 2016Learning Common and Specific Features for RGB-D Semantic Segmentation with Deconvolutional Networkscited by 24
  15. 2018Real-time Progressive 3D Semantic Segmentation for Indoor Scenecited by 18
  16. 2016Exploiting Depth from Single Monocular Images for Object Detection and Semantic Segmentationcited by 10
  17. 2017Incorporating Depth into both CNN and CRF for Indoor Semantic Segmentationcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.