3D Weakly Supervised Semantic Segmentation via Class-Aware and Geometry-Guided Pseudo-Label Refinement
Not on the map. Why?
Abstract (arXiv)
3D weakly supervised semantic segmentation (3D WSSS) aims to achieve semantic segmentation by leveraging sparse or low-cost annotated data, significantly reducing reliance on dense point-wise annotations. Previous works mainly employ class activation maps or pre-trained vision-language models to address this challenge. However, the low quality of pseudo-labels and the insufficient exploitation of 3D geometric priors jointly create significant technical bottlenecks in developing high-performance 3D WSSS models. In this paper, we propose a simple yet effective 3D weakly supervised semantic segmentation method that integrates 3D geometric priors into a class-aware guidance mechanism to generate high-fidelity pseudo labels. Concretely, our designed methodology first employs Class-Aware Label Refinement module to generate more balanced and accurate pseudo labels for semantic categrories. This initial refinement stage focuses on enhancing label quality through category-specific optimization. Subsequently, the Geometry-Aware Label Refinement component is developed, which strategically integrates implicit 3D geometric constraints to effectively filter out low-confidence pseudo labels that fail to comply with geometric plausibility. Moreover, to address the challenge of extensive unlabeled regions, we propose a Label Update strategy that integrates Self-Training to propagate labels into these areas. This iterative process continuously enhances pseudo-label quality while expanding label coverage, ultimately fostering the development of high-performance 3D WSSS models. Comprehensive experimental validation reveals that our proposed methodology achieves state-of-the-art performance on both ScanNet and S3DIS benchmarks while demonstrating remarkable generalization capability in unsupervised settings, maintaining competitive accuracy through its robust design.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 73 of its 92 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
73 of 92 references.
References · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2020Point Transformercited by 1,462
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
38 more
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2022Language-driven Semantic Segmentationcited by 711
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 471
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 470
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
- 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 424
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 384
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
- 2019Zero-Shot Semantic Segmentationcited by 245
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
- 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2019Revisiting Self-Training for Neural Sequence Generationcited by 154
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 115
- 2023Learning Open-vocabulary Semantic Segmentation Models From Natural Language Supervisioncited by 99
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
- 2021PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Trainingcited by 80
- 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
- 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognitioncited by 77
- 2019Multi-view PointNet for 3D Scene Understandingcited by 76
- 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
- 2020Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation on Point Cloudscited by 71
- 2023CLIP2: Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Datacited by 69
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FOLK: Fast Open-Vocabulary 3D Instance Segmentation via Label-guided Knowledge Distillation
- 20253D-PointZshotS: Geometry-Aware 3D Point Cloud Zero-Shot Semantic Segmentation Narrowing the Visual-Semantic Gap
- 2023A Language-Guided Benchmark for Weakly Supervised Open Vocabulary Semantic Segmentation
- 2025PGOV3D: Open-Vocabulary 3D Semantic Segmentation with Partial-to-Global Curriculum
- 2025GeoPurify: A Data-Efficient Geometric Distillation Framework for Open-Vocabulary 3D Segmentation
- 2025HQ-OV3D: A High Box Quality Open-World 3D Detection Framework based on Diffision Model
- 2024Label-efficient Semantic Scene Completion with Scribble Annotations
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model