mlsanityData to 7 Oct 2026

LLM-Guided Taxonomy and Hierarchical Uncertainty for 3D Point Cloud Active Learning

arXiv 2505.18924 ↗First posted 25 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a novel active learning framework for 3D point cloud semantic segmentation that, for the first time, integrates large language models (LLMs) to construct hierarchical label structures and guide uncertainty-based sample selection. Unlike prior methods that treat labels as flat and independent, our approach leverages LLM prompting to automatically generate multi-level semantic taxonomies and introduces a recursive uncertainty projection mechanism that propagates uncertainty across hierarchy levels. This enables spatially diverse, label-aware point selection that respects the inherent semantic structure of 3D scenes. Experiments on S3DIS and ScanNet v2 show that our method achieves up to 4% mIoU improvement under extremely low annotation budgets (e.g., 0.02%), substantially outperforming existing baselines. Our results highlight the untapped potential of LLMs as knowledge priors in 3D vision and establish hierarchical uncertainty modeling as a powerful paradigm for efficient point cloud annotation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

27 of 39 references.

References · 27

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  4. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  5. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  6. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
  7. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  8. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  9. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
  10. 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
  11. 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
  12. 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
15 more
  1. 2021Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 87
  2. 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64
  3. 2021SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Networkcited by 54
  4. 2021ReDAL: Region-based and Diversity-aware Active Learning for Point Cloud Semantic Segmentationcited by 52
  5. 2024OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentationcited by 43
  6. 2018Dynamic-structured Semantic Propagation Networkcited by 38
  7. 2022VIBUS: Data-efficient 3D Scene Parsing with VIewpoint Bottleneck and Uncertainty-Spectrum Modelingcited by 21
  8. 2023Hierarchical Point-based Active Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 21
  9. 2021Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Cloudscited by 19
  10. 2022Active Learning for Point Cloud Semantic Segmentation via Spatial-Structural Diversity Reasoningcited by 16
  11. 2022Hierarchical Nearest Neighbor Graph Embedding for Efficient Dimensionality Reductioncited by 14
  12. 2022Weakly Supervised 3D Point Cloud Segmentation via Multi-Prototype Learningcited by 13
  13. 2024SHiNe: Semantic Hierarchy Nexus for Open-vocabulary Object Detectioncited by 11
  14. 2022GaIA: Graphical Information Gain based Attention Network for Weakly Supervised Point Cloud Semantic Segmentationcited by 9
  15. 2023Learning from Mistakes: Self-Regularizing Hierarchical Representations in Point Cloud Semantic Segmentationcited by 5

Built on by

Not cited yet.