SNAP: Towards Segmenting Anything in Any Point Cloud
Not on the map. Why?
Abstract (arXiv)
Interactive 3D point cloud segmentation enables efficient annotation of complex 3D scenes through user-guided prompts. However, current approaches are typically restricted in scope to a single domain (indoor or outdoor), and to a single form of user interaction (either spatial clicks or textual prompts). Moreover, training on multiple datasets often leads to negative transfer, resulting in domain-specific tools that lack generalizability. To address these limitations, we present SNAP (Segment aNything in Any Point cloud), a unified model for interactive 3D segmentation that supports both point-based and text-based prompts across diverse domains. Our approach achieves cross-domain generalizability by training on 7 datasets spanning indoor, outdoor, and aerial environments, while employing domain-adaptive normalization to prevent negative transfer. For text-prompted segmentation, we automatically generate mask proposals without human intervention and match them against CLIP embeddings of textual queries, enabling both panoptic and open-vocabulary segmentation. Extensive experiments demonstrate that SNAP consistently delivers high-quality segmentation results. We achieve state-of-the-art performance on 8 out of 9 zero-shot benchmarks for spatial-prompted segmentation and demonstrate competitive results on all 5 text-prompted benchmarks. These results show that a unified model can match or exceed specialized domain-specific approaches, providing a practical tool for scalable 3D annotation. Project page is at, https://neu-vi.github.io/SNAP/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
35 of 45 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2018Panoptic Segmentationcited by 796
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
23 more
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2023SAM3D: Segment Anything in 3D Scenescited by 155
- 2022Habitat-Matterport 3D Semantics Datasetcited by 109
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2023OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentationcited by 82
- 2020DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentationcited by 65
- 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labelscited by 64
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
- 2024Better Call SAL: Towards Learning to Segment Anything in Lidarcited by 47
- 2023SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Instance Segmentationcited by 44
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2024ODIN: A Single Model for 2D and 3D Segmentationcited by 25
- 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentationcited by 24
- 2023Mask4Former: Mask Transformer for 4D Panoptic Segmentationcited by 24
- 2024Interactive4D: Interactive 4D LiDAR Segmentationcited by 4
Built on by
Not cited yet.