mlsanityData to 7 Oct 2026

Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentation

arXiv 2304.11705 ↗First posted 23 Apr 2023cs.CV cs.AI cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

The ability to deploy robots that can operate safely in diverse environments is crucial for developing embodied intelligent agents. As a community, we have made tremendous progress in within-domain LiDAR semantic segmentation. However, do these methods generalize across domains? To answer this question, we design the first experimental setup for studying domain generalization (DG) for LiDAR semantic segmentation (DG-LSS). Our results confirm a significant gap between methods, evaluated in a cross-domain setting: for example, a model trained on the source dataset (SemanticKITTI) obtains 26.53 mIoU on the target data, compared to 48.49 mIoU obtained by the model trained on the target domain (nuScenes). To tackle this gap, we propose the first method specifically designed for DG-LSS, which obtains 34.88 mIoU on the target domain, outperforming all baselines. Our method augments a sparse-convolutional encoder-decoder 3D segmentation network with an additional, dense 2D convolutional decoder that learns to classify a birds-eye view of the point cloud. This simple auxiliary task encourages the 3D network to learn features that are robust to sensor placement shifts and resolution, and are transferable across domains. With this work, we aim to inspire the community to develop and evaluate future models in such cross-domain conditions.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 23 Apr 2023.

Builds on

56 of 69 references.

References · 56

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  6. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  7. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  8. 2020Point Transformercited by 1,462
  9. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  10. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  11. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  12. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
38 more
  1. 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 745
  2. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
  3. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
  4. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  5. 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 422
  6. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
  7. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  8. 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
  9. 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
  10. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
  11. 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
  12. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  13. 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
  14. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  15. 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
  16. 2020A survey of loss functions for semantic segmentationcited by 216
  17. 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
  18. 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
  19. 2021A Unified Objective for Novel Class Discoverycited by 161
  20. 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
  21. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
  22. 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
  23. 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
  24. 2019Learning Robust Representations by Projecting Superficial Statistics Outcited by 123
  25. 2020MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Datacited by 121
  26. 2020Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Cloudscited by 116
  27. 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
  28. 2015Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalizationcited by 96
  29. 2020Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learningcited by 93
  30. 2022Style-Hallucinated Dual Consistency Learning for Domain Generalized Semantic Segmentationcited by 88
  31. 2021Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentationcited by 76
  32. 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
  33. 2021PointCutMix: Regularization Strategy for Point Cloud Classificationcited by 69
  34. 2018Domain Generalization with Domain-Specific Aggregation Modulescited by 61
  35. 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
  36. 20203D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentationcited by 58
  37. 2020ePointDA: An End-to-End Simulation-to-Real Domain Adaptation Framework for LiDAR Point Cloud Segmentationcited by 56
  38. 2022CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentationcited by 54

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 3; 2025: 3; 2026: 1.

13 papers.

Sort: