# The Hessigheim 3D (H3D) Benchmark on Semantic Segmentation of High-Resolution 3D Point Clouds and Textured Meshes from UAV LiDAR and Multi-View-Stereo

arXiv: https://arxiv.org/abs/2102.05346 · HTML: https://mlsanity.com/paper/2102.05346/

## Key facts

- Cited by 37 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 43 references that are in the map.
- First posted on arXiv 10 Feb 2021.

## Builds on (most cited first, 9 of 9)

- [nuScenes: A multimodal dataset for autonomous driving](https://mlsanity.com/paper/1903.11027/) (2019)
- [ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes](https://mlsanity.com/paper/1702.04405/) (2017)
- [3D Semantic Segmentation with Submanifold Sparse Convolutional Networks](https://mlsanity.com/paper/1711.10275/) (2017)
- [Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark](https://mlsanity.com/paper/1704.03847/) (2017)
- [Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges](https://mlsanity.com/paper/2009.03137/) (2020)
- [DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentation](https://mlsanity.com/paper/2004.11985/) (2020)
- [Paris-Lille-3D: a large and high-quality ground truth urban point cloud dataset for automatic segmentation and classification](https://mlsanity.com/paper/1712.00032/) (2017)
- [DublinCity: Annotated LiDAR Point Cloud and its Applications](https://mlsanity.com/paper/1909.03613/) (2019)
- [A review on deep learning techniques for 3D sensed data classification](https://mlsanity.com/paper/1907.04444/) (2019)

## Built on by (most cited first, 30 of 37)

- [STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Dataset](https://mlsanity.com/paper/2203.09065/) (2022)
- [SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Clouds](https://mlsanity.com/paper/2201.04494/) (2022)
- [EarthNets: Empowering AI in Earth Observation](https://mlsanity.com/paper/2210.04936/) (2022)
- [UAVScenes: A Multi-Modal Dataset for UAVs](https://mlsanity.com/paper/2507.22412/) (2025)
- [UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentation](https://mlsanity.com/paper/2305.02627/) (2023)
- [SUM: A Benchmark Dataset of Semantic Urban Meshes](https://mlsanity.com/paper/2103.00355/) (2021)
- [GauU-Scene V2: Assessing the Reliability of Image-Based Metrics with Expansive Lidar Image Dataset Using 3DGS and NeRF](https://mlsanity.com/paper/2404.04880/) (2024)
- [A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation](https://mlsanity.com/paper/2405.11903/) (2024)
- [A new weakly supervised approach for ALS point cloud semantic segmentation](https://mlsanity.com/paper/2110.01462/) (2021)
- [3D Instance Segmentation of MVS Buildings](https://mlsanity.com/paper/2112.09902/) (2021)
- [FRACTAL: An Ultra-Large-Scale Aerial Lidar Dataset for 3D Semantic Segmentation of Diverse Landscapes](https://mlsanity.com/paper/2405.04634/) (2024)
- [Deep Learning on 3D Semantic Segmentation: A Detailed Review](https://mlsanity.com/paper/2411.02104/) (2024)
- [PSSNet: Planarity-sensible Semantic Segmentation of Large-scale Urban Meshes](https://mlsanity.com/paper/2202.03209/) (2022)
- [One Class One Click: Quasi Scene-level Weakly Supervised Point Cloud Semantic Segmentation with Active Learning](https://mlsanity.com/paper/2211.12657/) (2022)
- [TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Dataset](https://mlsanity.com/paper/2505.07396/) (2025)
- [LiDAR Remote Sensing Meets Weak Supervision: Concepts, Methods, and Perspectives](https://mlsanity.com/paper/2503.18384/) (2025)
- [DC3DCD: unsupervised learning for multiclass 3D point cloud change detection](https://mlsanity.com/paper/2305.05421/) (2023)
- [3DSES: an indoor Lidar point cloud segmentation dataset with real and pseudo-labels from a 3D model](https://mlsanity.com/paper/2501.17534/) (2025)
- [AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World](https://mlsanity.com/paper/2606.29716/) (2026)
- [HRHD-HK: A benchmark dataset of high-rise and high-density urban scenes for 3D semantic segmentation of photogrammetric point clouds](https://mlsanity.com/paper/2307.07976/) (2023)
- [APCoTTA: Continual Test-Time Adaptation for Semantic Segmentation of Airborne LiDAR Point Clouds](https://mlsanity.com/paper/2505.09971/) (2025)
- [CitySeg: A 3D Open Vocabulary Semantic Segmentation Foundation Model in City-scale Scenarios](https://mlsanity.com/paper/2508.09470/) (2025)
- [OpenTrench3D: A Photogrammetric 3D Point Cloud Dataset for Semantic Segmentation of Underground Utilities](https://mlsanity.com/paper/2404.07711/) (2024)
- [Depth Supervised Neural Surface Reconstruction from Airborne Imagery](https://mlsanity.com/paper/2404.16429/) (2024)
- [SUM Parts: Benchmarking Part-Level Semantic Segmentation of Urban Meshes](https://mlsanity.com/paper/2503.15300/) (2025)
- [Turin3D: Evaluating Adaptation Strategies under Label Scarcity in Urban LiDAR Segmentation with Semi-Supervised Techniques](https://mlsanity.com/paper/2504.05882/) (2025)
- [Source-Free Domain Adaptation for Geospatial Point Cloud Semantic Segmentation](https://mlsanity.com/paper/2601.08375/) (2026)
- [Effective Utilisation of Multiple Open-Source Datasets to Improve Generalisation Performance of Point Cloud Segmentation Models](https://mlsanity.com/paper/2211.15877/) (2022)
- [LMSeg: An end-to-end geometric message-passing network on barycentric dual graphs for large-scale landscape mesh segmentation](https://mlsanity.com/paper/2407.04326/) (2024)
- [Ground Awareness in Deep Learning for Large Outdoor Point Cloud Segmentation](https://mlsanity.com/paper/2501.18246/) (2025)

## Abstract (arXiv)

Automated semantic segmentation and object detection are of great importance in geospatial data analysis. However, supervised machine learning systems such as convolutional neural networks require large corpora of annotated training data. Especially in the geospatial domain, such datasets are quite scarce. Within this paper, we aim to alleviate this issue by introducing a new annotated 3D dataset that is unique in three ways: i) The dataset consists of both an Unmanned Aerial Vehicle (UAV) laser scanning point cloud and a 3D textured mesh. ii) The point cloud features a mean point density of about 800 pts/sqm and the oblique imagery used for 3D mesh texturing realizes a ground sampling distance of about 2-3 cm. This enables the identification of fine-grained structures and represents the state of the art in UAV-based mapping. iii) Both data modalities will be published for a total of three epochs allowing applications such as change detection. The dataset depicts the village of Hessigheim (Germany), henceforth referred to as H3D. It is designed to promote research in the field of 3D data analysis on one hand and to evaluate and rank existing and emerging approaches for semantic segmentation of both data modalities on the other hand. Ultimately, we hope that H3D will become a widely used benchmark dataset in company with the well-established ISPRS Vaihingen 3D Semantic Labeling Challenge benchmark (V3D). The dataset can be downloaded from https://ifpwww.ifp.uni-stuttgart.de/benchmark/hessigheim/default.aspx.