Improving Open-Set Semantic Segmentation in 3D Point Clouds by Conditional Channel Capacity Maximization: Preliminary Results
Not on the map. Why?
Abstract (arXiv)
Point-cloud semantic segmentation underpins a wide range of critical applications. Although recent deep architectures and large-scale datasets have driven impressive closed-set performance, these models struggle to recognize or properly segment objects outside their training classes. This gap has sparked interest in Open-Set Semantic Segmentation (O3S), where models must both correctly label known categories and detect novel, unseen classes. In this paper, we propose a plug and play framework for O3S. By modeling the segmentation pipeline as a conditional Markov chain, we derive a novel regularizer term dubbed Conditional Channel Capacity Maximization (3CM), that maximizes the mutual information between features and predictions conditioned on each class. When incorporated into standard loss functions, 3CM encourages the encoder to retain richer, label-dependent features, thereby enhancing the network's ability to distinguish and segment previously unseen categories. Experimental results demonstrate effectiveness of proposed method on detecting unseen objects. We further outline future directions for dynamic open-world adaptation and efficient information-theoretic estimation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 9 May 2025.
Builds on
14 of 32 references.
References · 14
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Informationcited by 25
- 2023Novel Class Discovery for 3D Point Cloud Semantic Segmentationcited by 21
- 2023Conditional Mutual Information Constrained Deep Learning for Classificationcited by 18
- 2021APEX: Unsupervised, Object-Centric Scene Segmentation and Tracking for Robot Manipulationcited by 16
- 2022PointCaM: Cut-and-Mix for Open-Set Point Cloud Learningcited by 11
- 2024PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentationcited by 4
- 2025Distributed Quasi-Newton Method for Fair and Fast Federated Learningcited by 4
Built on by
Not cited yet.