Is clustering enough for LiDAR instance segmentation? A state-of-the-art training-free baseline
Not on the map. Why?
Abstract (arXiv)
Panoptic segmentation of LiDAR point clouds is fundamental to outdoor scene understanding, with autonomous driving being a primary application. While state-of-the-art approaches typically rely on end-to-end deep learning architectures and extensive manual annotations of instances, the significant cost and time investment required for labeling large-scale point cloud datasets remains a major bottleneck in this field. In this work, we demonstrate that competitive panoptic segmentation can be achieved using only semantic labels, with instances predicted without any training or annotations. Our method outperforms {most} state-of-the-art supervised methods on standard benchmarks including SemanticKITTI and nuScenes, and outperforms every publicly available method on SemanticKITTI as a drop-in instance head replacement, while running in real-time on a single-threaded CPU and requiring no instance labels. It is fully explainable, and requires no learning or parameter tuning. Alpine combined with state-of-the-art semantic segmentation ranks first on the official panoptic segmentation leaderboard of SemanticKITTI. Code is available at https://github.com/valeoai/Alpine/
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 87 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
52 of 87 references.
References · 52
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2020Point Transformercited by 1,470
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
38 more
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 275
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 128
- 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
- 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
- 2020LiDAR-based Panoptic Segmentation via Dynamic Shifting Networkcited by 84
- 2021EfficientLPS: Efficient LiDAR Panoptic Segmentationcited by 76
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2021PointMixer: MLP-Mixer for Point Cloud Understandingcited by 71
- 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
- 2019SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Drivingcited by 57
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebasecited by 57
- 2020MOPT: Multi-Object Panoptic Trackingcited by 53
- 2023Using a Waffle Iron for Automotive Point Cloud Semantic Segmentationcited by 53
- 2022Learning to Detect Mobile Objects from LiDAR Scans Without Labelscited by 44
- 2022LESS: Label-Efficient Semantic Segmentation for LiDAR Point Cloudscited by 41
- 2021GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Networkcited by 37
- 2020TORNADO-Net: mulTiview tOtal vaRiatioN semAntic segmentation with Diamond inceptiOn modulecited by 36
- 2022GFNet: Geometric Flow Network for 3D Point Cloud Semantic Segmentationcited by 36
- 2023BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Cloudscited by 24
- 2022Sparse Cross-scale Attention Network for Efficient LiDAR Panoptic Segmentationcited by 22
- 2023LiDAR-Camera Panoptic Segmentation via Geometry-Consistent and Semantic-Aware Alignmentcited by 18
- 2023Position-Guided Point Cloud Panoptic Segmentation Transformercited by 17
- 2023PUPS: Point Cloud Unified Panoptic Segmentationcited by 16
- 2022MaskRange: A Mask-classification Model for Range-view based LiDAR Segmentationcited by 15
- 2021CPSeg: Cluster-free Panoptic Segmentation of 3D LiDAR Point Cloudscited by 14
- 2024Scalable 3D Panoptic Segmentation As Superpoint Graph Clusteringcited by 14
- 2021SMAC-Seg: LiDAR Panoptic Segmentation via Sparse Multi-directional Attention Clusteringcited by 11
- 2021A Technical Survey and Evaluation of Traditional Point Cloud Clustering Methods for LiDAR Panoptic Segmentationcited by 10
- 2021A Divide-and-Merge Point Cloud Clustering Algorithm for LiDAR Panoptic Segmentationcited by 9
- 2023Lidar Panoptic Segmentation and Tracking without Bells and Whistlescited by 7
- 2021VIN: Voxel-based Implicit Network for Joint 3D Object Detection and Segmentation for Lidarscited by 6
- 2023Center Focusing Network for Real-Time LiDAR Panoptic Segmentationcited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.