# Are We Hungry for 3D LiDAR Data for Semantic Segmentation? A Survey and Experimental Study

arXiv: https://arxiv.org/abs/2006.04307 · HTML: https://mlsanity.com/paper/2006.04307/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Jun 2020.

## Built on by (most cited first, 12 of 12)

- [3D Semantic Scene Completion: a Survey](https://mlsanity.com/paper/2103.07466/) (2021)
- [LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds](https://mlsanity.com/paper/2210.08064/) (2022)
- [Dual Adaptive Transformations for Weakly Supervised Point Cloud Segmentation](https://mlsanity.com/paper/2207.09084/) (2022)
- [Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation](https://mlsanity.com/paper/2411.02969/) (2024)
- [Understanding the Challenges When 3D Semantic Segmentation Faces Class Imbalanced and OOD Data](https://mlsanity.com/paper/2203.00214/) (2022)
- [Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving](https://mlsanity.com/paper/2302.08785/) (2023)
- [COVERED, CollabOratiVE Robot Environment Dataset for 3D Semantic segmentation](https://mlsanity.com/paper/2302.12656/) (2023)
- [An Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation](https://mlsanity.com/paper/2202.09002/) (2022)
- [A Benchmark for Out of Distribution Detection in Point Cloud 3D Semantic Segmentation](https://mlsanity.com/paper/2211.06241/) (2022)
- [TrueCity: Real and Simulated Urban Data for Cross-Domain 3D Scene Understanding](https://mlsanity.com/paper/2511.07007/) (2025)
- [Semantic Segmentation on 3D Point Clouds with High Density Variations](https://mlsanity.com/paper/2307.01489/) (2023)
- [Enhancing Human-Robot Collaboration: A Sim2Real Domain Adaptation Algorithm for Point Cloud Segmentation in Industrial Environments](https://mlsanity.com/paper/2506.09552/) (2025)

## Abstract (arXiv)

3D semantic segmentation is a fundamental task for robotic and autonomous driving applications. Recent works have been focused on using deep learning techniques, whereas developing fine-annotated 3D LiDAR datasets is extremely labor intensive and requires professional skills. The performance limitation caused by insufficient datasets is called data hunger problem. This research provides a comprehensive survey and experimental study on the question: are we hungry for 3D LiDAR data for semantic segmentation? The studies are conducted at three levels. First, a broad review to the main 3D LiDAR datasets is conducted, followed by a statistical analysis on three representative datasets to gain an in-depth view on the datasets' size and diversity, which are the critical factors in learning deep models. Second, a systematic review to the state-of-the-art 3D semantic segmentation is conducted, followed by experiments and cross examinations of three representative deep learning methods to find out how the size and diversity of the datasets affect deep models' performance. Finally, a systematic survey to the existing efforts to solve the data hunger problem is conducted on both methodological and dataset's viewpoints, followed by an insightful discussion of remaining problems and open questions To the best of our knowledge, this is the first work to analyze the data hunger problem for 3D semantic segmentation using deep learning techniques that are addressed in the literature review, statistical analysis, and cross-dataset and cross-algorithm experiments. We share findings and discussions, which may lead to potential topics in future works.
