mlsanityData to 7 Oct 2026

SFPNet: Sparse Focal Point Network for Semantic Segmentation on General LiDAR Point Clouds

arXiv 2407.11569 ↗First posted 16 Jul 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Although LiDAR semantic segmentation advances rapidly, state-of-the-art methods often incorporate specifically designed inductive bias derived from benchmarks originating from mechanical spinning LiDAR. This can limit model generalizability to other kinds of LiDAR technologies and make hyperparameter tuning more complex. To tackle these issues, we propose a generalized framework to accommodate various types of LiDAR prevalent in the market by replacing window-attention with our sparse focal point modulation. Our SFPNet is capable of extracting multi-level contexts and dynamically aggregating them using a gate mechanism. By implementing a channel-wise information query, features that incorporate both local and global contexts are encoded. We also introduce a novel large-scale hybrid-solid LiDAR semantic segmentation dataset for robotic applications. SFPNet demonstrates competitive performance on conventional benchmarks derived from mechanical spinning LiDAR, while achieving state-of-the-art results on benchmark derived from solid-state LiDAR. Additionally, it outperforms existing methods on our novel dataset sourced from hybrid-solid LiDAR. Code and dataset are available at https://github.com/Cavendish518/SFPNet and https://www.semanticindustry.top.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 59 of its 66 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

59 of 66 references.

References · 59

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2016Layer Normalizationcited by 5,579
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  8. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  9. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  10. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  11. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  12. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
38 more
  1. 2018Spherical CNNscited by 452
  2. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
  3. 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 422
  4. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  5. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
  6. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  7. 2021Focal Self-attention for Local-Global Interactions in Vision Transformerscited by 286
  8. 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
  9. 2021Voxel Transformer for 3D Object Detectioncited by 247
  10. 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 238
  11. 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
  12. 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
  13. 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
  14. 2017Submanifold Sparse Convolutional Networkscited by 223
  15. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  16. 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
  17. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
  18. 2022Focal Modulation Networkscited by 186
  19. 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
  20. 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
  21. 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
  22. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
  23. 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
  24. 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
  25. 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
  26. 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
  27. 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
  28. 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
  29. 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 118
  30. 2021SuMa++: Efficient LiDAR-based Semantic SLAMcited by 100
  31. 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 92
  32. 2020AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentationcited by 87
  33. 2021Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 87
  34. 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
  35. 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
  36. 2022LargeKernel3D: Scaling up Kernels in 3D Sparse CNNscited by 71
  37. 2021Learning 3D Semantic Segmentation with only 2D Image Supervisioncited by 60
  38. 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 11.

13 papers.

Sort: