RangeSAM: On the Potential of Visual Foundation Models for Range-View represented LiDAR segmentation
Not on the map. Why?
Abstract (arXiv)
Point cloud segmentation is central to autonomous driving and 3D scene understanding. While voxel- and point-based methods dominate recent research due to their compatibility with deep architectures and ability to capture fine-grained geometry, they often incur high computational cost, irregular memory access, and limited real-time efficiency. In contrast, range-view methods, though relatively underexplored - can leverage mature 2D semantic segmentation techniques for fast and accurate predictions. Motivated by the rapid progress in Visual Foundation Models (VFMs) for captioning, zero-shot recognition, and multimodal tasks, we investigate whether SAM2, the current state-of-the-art VFM for segmentation tasks, can serve as a strong backbone for LiDAR point cloud segmentation in the range view. We present , to our knowledge, the first range-view framework that adapts SAM2 to 3D segmentation, coupling efficient 2D feature extraction with standard projection/back-projection to operate on point clouds. To optimize SAM2 for range-view representations, we implement several architectural modifications to the encoder: (1) a novel module that emphasizes horizontal spatial dependencies inherent in LiDAR range images, (2) a customized configuration of tailored to the geometric properties of spherical projections, and (3) an adapted mechanism in the encoder backbone specifically designed to capture the unique spatial patterns and discontinuities present in range-view pseudo-images. Our approach achieves competitive performance on SemanticKITTI while benefiting from the speed, scalability, and deployment simplicity of 2D-centric pipelines. This work highlights the viability of VFMs as general-purpose backbones for 3D perception and opens a path toward unified, foundation-model-driven LiDAR segmentation. Results lets us conclude that range-view segmentation methods using VFMs leads to promising results.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 87 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
68 of 87 references.
References · 68
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
38 more
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021Florence: A New Foundation Model for Computer Visioncited by 804
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 657
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 385
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 275
- 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 232
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
- 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
- 20203D Object Detection with Pointformercited by 194
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 181
- 2017Receptive Field Block Net for Accurate and Fast Object Detectioncited by 141
- 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 141
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 128
- 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 119
- 2020Cylinder3D: An Effective 3D Framework for Driving-scene LiDAR Semantic Segmentationcited by 112
- 2018A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillationcited by 110
- 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
- 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 86
50 most cited of 68 All 68 (JSON)
Built on by
Not cited yet.