mlsanityData to 7 Oct 2026

3D Weakly Supervised Semantic Segmentation via Class-Aware and Geometry-Guided Pseudo-Label Refinement

arXiv 2510.17875 ↗First posted 17 Oct 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

3D weakly supervised semantic segmentation (3D WSSS) aims to achieve semantic segmentation by leveraging sparse or low-cost annotated data, significantly reducing reliance on dense point-wise annotations. Previous works mainly employ class activation maps or pre-trained vision-language models to address this challenge. However, the low quality of pseudo-labels and the insufficient exploitation of 3D geometric priors jointly create significant technical bottlenecks in developing high-performance 3D WSSS models. In this paper, we propose a simple yet effective 3D weakly supervised semantic segmentation method that integrates 3D geometric priors into a class-aware guidance mechanism to generate high-fidelity pseudo labels. Concretely, our designed methodology first employs Class-Aware Label Refinement module to generate more balanced and accurate pseudo labels for semantic categrories. This initial refinement stage focuses on enhancing label quality through category-specific optimization. Subsequently, the Geometry-Aware Label Refinement component is developed, which strategically integrates implicit 3D geometric constraints to effectively filter out low-confidence pseudo labels that fail to comply with geometric plausibility. Moreover, to address the challenge of extensive unlabeled regions, we propose a Label Update strategy that integrates Self-Training to propagate labels into these areas. This iterative process continuously enhances pseudo-label quality while expanding label coverage, ultimately fostering the development of high-performance 3D WSSS models. Comprehensive experimental validation reveals that our proposed methodology achieves state-of-the-art performance on both ScanNet and S3DIS benchmarks while demonstrating remarkable generalization capability in unsupervised settings, maintaining competitive accuracy through its robust design.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 73 of its 92 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

73 of 92 references.

References · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  8. 2020Point Transformercited by 1,462
  9. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  10. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  11. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  12. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
38 more
  1. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  2. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
  3. 2022Language-driven Semantic Segmentationcited by 711
  4. 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
  5. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
  6. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  7. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  8. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  9. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 471
  10. 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 470
  11. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
  12. 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 424
  13. 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 384
  14. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
  15. 2019Zero-Shot Semantic Segmentationcited by 245
  16. 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
  17. 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
  18. 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
  19. 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
  20. 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
  21. 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
  22. 2019Revisiting Self-Training for Neural Sequence Generationcited by 154
  23. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
  24. 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
  25. 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 115
  26. 2023Learning Open-vocabulary Semantic Segmentation Models From Natural Language Supervisioncited by 99
  27. 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
  28. 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
  29. 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
  30. 2021PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Trainingcited by 80
  31. 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
  32. 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognitioncited by 77
  33. 2019Multi-view PointNet for 3D Scene Understandingcited by 76
  34. 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
  35. 2020Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation on Point Cloudscited by 71
  36. 2023CLIP2: Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Datacited by 69
  37. 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
  38. 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025FOLK: Fast Open-Vocabulary 3D Instance Segmentation via Label-guided Knowledge Distillation
  2. 20253D-PointZshotS: Geometry-Aware 3D Point Cloud Zero-Shot Semantic Segmentation Narrowing the Visual-Semantic Gap
  3. 2023A Language-Guided Benchmark for Weakly Supervised Open Vocabulary Semantic Segmentation
  4. 2025PGOV3D: Open-Vocabulary 3D Semantic Segmentation with Partial-to-Global Curriculum
  5. 2025GeoPurify: A Data-Efficient Geometric Distillation Framework for Open-Vocabulary 3D Segmentation
  6. 2025HQ-OV3D: A High Box Quality Open-World 3D Detection Framework based on Diffision Model
  7. 2024Label-efficient Semantic Scene Completion with Scribble Annotations
  8. 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model