Resolving Long-Tail Ambiguity in Unsupervised 3D Point Cloud Segmentation with Language Priors
Not on the map. Why?
Abstract (arXiv)
Existing approaches for unsupervised 3D point cloud segmentation predominantly rely on a purely visual similarity-based learning-by-clustering paradigm, which suffers from a fundamental limitation: long-tail ambiguity. In such a paradigm, features of minor classes are consistently absorbed by dominant clusters, leading to severely imbalanced predictions. To address this issue, we propose LangTail, a language-guided hierarchical learning framework that leverages the balanced world knowledge encoded in language models to mitigate long-tail ambiguity in unsupervised 3D segmentation. The key idea is to establish multi-level associations between language-derived semantic priors and visually underrepresented minor classes, thereby compensating for the biased attention of purely visual clustering toward dominant classes. Specifically, LangTail first constructs an entity-level semantic prior from language models, capturing balanced and fine-grained world knowledge across categories. These priors are injected into a hierarchical clustering framework via contrastive alignment. This guides multi-granularity semantic structure formation and prevents minor classes from being absorbed by dominant clusters, yielding more discriminative representations for underrepresented categories. Extensive experiments on ScanNet-v2, S3DIS, and nuScenes demonstrate that LangTail consistently outperforms existing methods by significant margins, ie, +13.5, +12.9, and +8.9 mIoU, respectively. These results demonstrate the effectiveness of language priors in improving the representation of minority classes in 3D point clouds. The code will be released at: https://github.com/Whisky0129/langtailofficial.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 49 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
45 of 49 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen3 Technical Reportcited by 8,820
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
33 more
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
- 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 455
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
- 2025Seed1.5-VL Technical Reportcited by 373
- 2020SCAN: Learning to Classify Images without Labelscited by 352
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
- 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 94
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 82
- 2020Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challengescited by 80
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2023GrowSP: Unsupervised Semantic Segmentation of 3D Point Cloudscited by 34
- 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
- 2021Digging into Uncertainty in Self-supervised Multi-view Stereocited by 31
- 2023U3DS3: Unsupervised 3D Semantic Scene Segmentationcited by 16
- 2023PointDC:Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clusteringcited by 15
- 2025Foundational Models for 3D Point Clouds: A Survey and Outlookcited by 12
- 2023CostFormer:Cost Transformer for Cost Aggregation in Multi-view Stereocited by 9
- 2025LogoSP: Local-global Grouping of Superpoints for Unsupervised Semantic Segmentation of 3D Point Cloudscited by 8
- 2022Semi-supervised Deep Multi-view Stereocited by 5
- 2024RobustMVS: Single Domain Generalized Deep Multi-view Stereocited by 5
- 2024ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Modelcited by 3
- 2025Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularizationcited by 3
- 2026P-SLCR: Unsupervised Point Cloud Semantic Segmentation via Prototypes Structure Learning and Consistent Reasoningcited by 2
Built on by
Not cited yet.