SUM: A Benchmark Dataset of Semantic Urban Meshes
Not on the map. Why?
Abstract (arXiv)
Recent developments in data acquisition technology allow us to collect 3D texture meshes quickly. Those can help us understand and analyse the urban environment, and as a consequence are useful for several applications like spatial analysis and urban planning. Semantic segmentation of texture meshes through deep learning methods can enhance this understanding, but it requires a lot of labelled data. The contributions of this work are threefold: (1) a new benchmark dataset of semantic urban meshes, (2) a novel semi-automatic annotation framework, and (3) an annotation tool for 3D meshes. In particular, our dataset covers about 4 km2 in Helsinki (Finland), with six classes, and we estimate that we save about 600 hours of labelling work using our annotation framework, which includes initial segmentation and interactive refinement. We also compare the performance of several state-of-theart 3D semantic segmentation methods on the new benchmark dataset. Other researchers can use our results to train their networks: the dataset is publicly available, and the annotation tool is released as open-source.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 14 of its 55 references that are in the map. First posted on arXiv 27 Feb 2021.
Builds on
14 of 55 references.
References · 14
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 385
- 2017Semantic3D.net: A new Large-scale Point Cloud Classification Benchmarkcited by 158
- 2020Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challengescited by 80
- 2020Toronto-3D: A Large-scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadwayscited by 77
- 2020DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentationcited by 66
- 2017Paris-Lille-3D: a large and high-quality ground truth urban point cloud dataset for automatic segmentation and classificationcited by 65
- 2021The Hessigheim 3D (H3D) Benchmark on Semantic Segmentation of High-Resolution 3D Point Clouds and Textured Meshes from UAV LiDAR and Multi-View-Stereocited by 37
- 2019DublinCity: Annotated LiDAR Point Cloud and its Applicationscited by 31
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 5; 2024: 2; 2025: 8; 2026: 3.
23 papers.
Sort:
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentationcited by 24
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
- 20213D Instance Segmentation of MVS Buildingscited by 12
- 2021Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecturecited by 7
- 2022PSSNet: Planarity-sensible Semantic Segmentation of Large-scale Urban Meshescited by 5
- 2023Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scanscited by 5
- 2025TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Datasetcited by 5
- 2023Human Vision Based 3D Point Cloud Semantic Segmentation of Large-Scale Outdoor Scenecited by 4
- 2025PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Groupingcited by 4
- 2023AutoEncoding Tree for City Generation and Applicationscited by 3
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observationcited by 3
11 more
- 2025CitySeg: A 3D Open Vocabulary Semantic Segmentation Foundation Model in City-scale Scenarioscited by 2
- 2025SUM Parts: Benchmarking Part-Level Semantic Segmentation of Urban Meshescited by 1
- 2025Turin3D: Evaluating Adaptation Strategies under Label Scarcity in Urban LiDAR Segmentation with Semi-Supervised Techniquescited by 1
- 2025BuildingWorld: A Structured 3D Building Dataset for Urban Foundation Modelscited by 1
- 2022Effective Utilisation of Multiple Open-Source Datasets to Improve Generalisation Performance of Point Cloud Segmentation Modelscited by 0
- 2023Semantic Segmentation of Urban Textured Meshes Through Point Samplingcited by 0
- 2024LMSeg: An end-to-end geometric message-passing network on barycentric dual graphs for large-scale landscape mesh segmentationcited by 0
- 2025OpenUrban3D: Annotation-Free Open-Vocabulary Semantic Segmentation of Large-Scale Urban Point Cloudscited by 0
- 2026Semantic Segmentation of Textured Non-manifold 3D Meshes using Transformerscited by 0
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shiftscited by 0
- 2026Polis: 3D Self-Supervision at City Scalecited by 0
- 2026Polis: 3D Self-Supervision at City Scale29 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Semantic Segmentation of Textured Non-manifold 3D Meshes using Transformers2 Apr 2026
- 2025BuildingWorld: A Structured 3D Building Dataset for Urban Foundation Models9 Nov 2025
- 2025OpenUrban3D: Annotation-Free Open-Vocabulary Semantic Segmentation of Large-Scale Urban Point Clouds13 Sep 2025
- 2025CitySeg: A 3D Open Vocabulary Semantic Segmentation Foundation Model in City-scale Scenarios13 Aug 2025
- 2025TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Dataset12 May 2025
- 2025Turin3D: Evaluating Adaptation Strategies under Label Scarcity in Urban LiDAR Segmentation with Semi-Supervised Techniques8 Apr 2025
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes20 Mar 2025
- 2025SUM Parts: Benchmarking Part-Level Semantic Segmentation of Urban Meshes19 Mar 2025
- 2025PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Grouping3 Jan 2025
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observation5 Nov 2024
11 more
- 2024LMSeg: An end-to-end geometric message-passing network on barycentric dual graphs for large-scale landscape mesh segmentation5 Jul 2024
- 2023AutoEncoding Tree for City Generation and Applications27 Sep 2023
- 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentation4 May 2023
- 2023Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scans19 Apr 2023
- 2023Semantic Segmentation of Urban Textured Meshes Through Point Sampling21 Feb 2023
- 2023Human Vision Based 3D Point Cloud Semantic Segmentation of Large-Scale Outdoor Scene30 Jan 2023
- 2022Effective Utilisation of Multiple Open-Source Datasets to Improve Generalisation Performance of Point Cloud Segmentation Models29 Nov 2022
- 2022EarthNets: Empowering AI in Earth Observation10 Oct 2022
- 2022PSSNet: Planarity-sensible Semantic Segmentation of Large-scale Urban Meshes7 Feb 2022
- 20213D Instance Segmentation of MVS Buildings18 Dec 2021
- 2021Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecture26 Apr 2021
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentationcited by 24
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
- 20213D Instance Segmentation of MVS Buildingscited by 12
- 2021Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecturecited by 7
- 2022PSSNet: Planarity-sensible Semantic Segmentation of Large-scale Urban Meshescited by 5
- 2023Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scanscited by 5
- 2025TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Datasetcited by 5
- 2023Human Vision Based 3D Point Cloud Semantic Segmentation of Large-Scale Outdoor Scenecited by 4
- 2025PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Groupingcited by 4
- 2023AutoEncoding Tree for City Generation and Applicationscited by 3
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observationcited by 3
12 most cited of 23 All 23 (JSON)
- 2026Polis: 3D Self-Supervision at City Scale29 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Semantic Segmentation of Textured Non-manifold 3D Meshes using Transformers2 Apr 2026
- 2025BuildingWorld: A Structured 3D Building Dataset for Urban Foundation Models9 Nov 2025
- 2025OpenUrban3D: Annotation-Free Open-Vocabulary Semantic Segmentation of Large-Scale Urban Point Clouds13 Sep 2025
- 2025CitySeg: A 3D Open Vocabulary Semantic Segmentation Foundation Model in City-scale Scenarios13 Aug 2025
- 2025TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Dataset12 May 2025
- 2025Turin3D: Evaluating Adaptation Strategies under Label Scarcity in Urban LiDAR Segmentation with Semi-Supervised Techniques8 Apr 2025
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes20 Mar 2025
- 2025SUM Parts: Benchmarking Part-Level Semantic Segmentation of Urban Meshes19 Mar 2025
- 2025PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Grouping3 Jan 2025
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observation5 Nov 2024
12 newest of 23 All 23 (JSON)