mlsanityData to 7 Oct 2026

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

arXiv 2407.09697 ↗First posted 12 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Range-View(RV)-based 3D point cloud segmentation is widely adopted due to its compact data form. However, RV-based methods fall short in providing robust segmentation for the occluded points and suffer from distortion of projected RGB images due to the sparse nature of 3D point clouds. To alleviate these problems, we propose a new LiDAR and Camera Range-view-based 3D point cloud semantic segmentation method (LaCRange). Specifically, a distortion-compensating knowledge distillation (DCKD) strategy is designed to remedy the adverse effect of RV projection of RGB images. Moreover, a context-based feature fusion module is introduced for robust and preservative sensor fusion. Finally, in order to address the limited resolution of RV and its insufficiency of 3D topology, a new point refinement scheme is devised for proper aggregation of features in 2D and augmentation of point features in 3D. We evaluated the proposed method on large-scale autonomous driving datasets ie SemanticKITTI and nuScenes. In addition to being real-time, the proposed method achieves state-of-the-art results on nuScenes benchmark

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 60 references that are in the map. First posted on arXiv 12 Jul 2024.

Builds on

47 of 60 references.

References · 47

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  7. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  9. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  10. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  11. 2016Pyramid Scene Parsing Networkcited by 2,472
  12. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
35 more
  1. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  2. 2020Knowledge Distillation: A Surveycited by 1,578
  3. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  4. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  5. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  6. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  7. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  8. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  9. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
  10. 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 422
  11. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
  12. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  13. 2019Structured Knowledge Distillation for Dense Predictioncited by 277
  14. 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
  15. 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
  16. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  17. 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
  18. 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
  19. 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
  20. 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
  21. 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
  22. 2017Pointwise Convolutional Neural Networkscited by 126
  23. 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 118
  24. 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
  25. 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
  26. 2020AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentationcited by 87
  27. 2021EfficientLPS: Efficient LiDAR Panoptic Segmentationcited by 76
  28. 2021STEP: Segmenting and Tracking Every Pixelcited by 72
  29. 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
  30. 2020Inter-Region Affinity Distillation for Road Marking Segmentationcited by 58
  31. 2019SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Drivingcited by 57
  32. 2019RGB and LiDAR fusion based 3D Semantic Segmentation for Autonomous Drivingcited by 39
  33. 2020TORNADO-Net: mulTiview tOtal vaRiatioN semAntic segmentation with Diamond inceptiOn modulecited by 36
  34. 2018Improving Fast Segmentation With Teacher-student Learningcited by 34
  35. 2017Semantic Segmentation with Reverse Attentioncited by 12

Built on by

Not cited yet.