Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
The ability to deploy robots that can operate safely in diverse environments is crucial for developing embodied intelligent agents. As a community, we have made tremendous progress in within-domain LiDAR semantic segmentation. However, do these methods generalize across domains? To answer this question, we design the first experimental setup for studying domain generalization (DG) for LiDAR semantic segmentation (DG-LSS). Our results confirm a significant gap between methods, evaluated in a cross-domain setting: for example, a model trained on the source dataset (SemanticKITTI) obtains 26.53 mIoU on the target data, compared to 48.49 mIoU obtained by the model trained on the target domain (nuScenes). To tackle this gap, we propose the first method specifically designed for DG-LSS, which obtains 34.88 mIoU on the target domain, outperforming all baselines. Our method augments a sparse-convolutional encoder-decoder 3D segmentation network with an additional, dense 2D convolutional decoder that learns to classify a birds-eye view of the point cloud. This simple auxiliary task encourages the 3D network to learn features that are robust to sensor placement shifts and resolution, and are transferable across domains. With this work, we aim to inspire the community to develop and evaluate future models in such cross-domain conditions.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 23 Apr 2023.
Builds on
56 of 69 references.
References · 56
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2020Point Transformercited by 1,462
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
38 more
- 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 745
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 422
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
- 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2020A survey of loss functions for semantic segmentationcited by 216
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2021A Unified Objective for Novel Class Discoverycited by 161
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
- 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2019Learning Robust Representations by Projecting Superficial Statistics Outcited by 123
- 2020MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Datacited by 121
- 2020Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Cloudscited by 116
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2015Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalizationcited by 96
- 2020Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learningcited by 93
- 2022Style-Hallucinated Dual Consistency Learning for Domain Generalized Semantic Segmentationcited by 88
- 2021Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentationcited by 76
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 2021PointCutMix: Regularization Strategy for Point Cloud Classificationcited by 69
- 2018Domain Generalization with Domain-Specific Aggregation Modulescited by 61
- 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
- 20203D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentationcited by 58
- 2020ePointDA: An End-to-End Simulation-to-Real Domain Adaptation Framework for LiDAR Point Cloud Segmentationcited by 56
- 2022CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentationcited by 54
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2023: 6; 2024: 3; 2025: 3; 2026: 1.
13 papers.
Sort:
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidarcited by 43
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weathercited by 24
- 2023WildScenes: A Benchmark for 2D and 3D Semantic Segmentation in Large-scale Natural Environmentscited by 16
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentationcited by 11
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous drivingcited by 8
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domainscited by 7
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentationcited by 6
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perceptioncited by 5
- 2024Subspace Prototype Guidance for Mitigating Class Imbalance in Point Cloud Semantic Segmentationcited by 4
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shiftcited by 2
- 2025UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehiclescited by 0
- 2026Cross-view Domain Generalization via Geometric Consistency for LiDAR Semantic Segmentation16 Feb 2026
- 2025UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehicles23 Nov 2025
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Construction17 Mar 2025
- 2024Subspace Prototype Guidance for Mitigating Class Imbalance in Point Cloud Semantic Segmentation20 Aug 2024
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentation17 Jul 2024
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weather8 Apr 2024
- 2023WildScenes: A Benchmark for 2D and 3D Semantic Segmentation in Large-scale Natural Environments23 Dec 2023
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domains19 Dec 2023
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous driving6 Nov 2023
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentation31 Oct 2023
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidar26 Oct 2023
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidarcited by 43
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weathercited by 24
- 2023WildScenes: A Benchmark for 2D and 3D Semantic Segmentation in Large-scale Natural Environmentscited by 16
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentationcited by 11
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous drivingcited by 8
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domainscited by 7
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentationcited by 6
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perceptioncited by 5
- 2024Subspace Prototype Guidance for Mitigating Class Imbalance in Point Cloud Semantic Segmentationcited by 4
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shiftcited by 2
- 2025UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehiclescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Cross-view Domain Generalization via Geometric Consistency for LiDAR Semantic Segmentation16 Feb 2026
- 2025UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehicles23 Nov 2025
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Construction17 Mar 2025
- 2024Subspace Prototype Guidance for Mitigating Class Imbalance in Point Cloud Semantic Segmentation20 Aug 2024
- 2024HGL: Hierarchical Geometry Learning for Test-time Adaptation in 3D Point Cloud Segmentation17 Jul 2024
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weather8 Apr 2024
- 2023WildScenes: A Benchmark for 2D and 3D Semantic Segmentation in Large-scale Natural Environments23 Dec 2023
- 2023Rethinking LiDAR Domain Generalization: Single Source as Multiple Density Domains19 Dec 2023
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous driving6 Nov 2023
- 2023Annotator: A Generic Active Learning Baseline for LiDAR Semantic Segmentation31 Oct 2023
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidar26 Oct 2023
12 newest of 13 All 13 (JSON)