Confidence Self-Calibration for Multi-Label Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
The partial label challenge in Multi-Label Class-Incremental Learning (MLCIL) arises when only the new classes are labeled during training, while past and future labels remain unavailable. This issue leads to a proliferation of false-positive errors due to erroneously high confidence multi-label predictions, exacerbating catastrophic forgetting within the disjoint label space. In this paper, we aim to refine multi-label confidence calibration in MLCIL and propose a Confidence Self-Calibration (CSC) approach. Firstly, for label relationship calibration, we introduce a class-incremental graph convolutional network that bridges the isolated label spaces by constructing learnable, dynamically extended label relationship graph. Then, for confidence calibration, we present a max-entropy regularization for each multi-label increment, facilitating confidence self-calibration through the penalization of over-confident output distributions. Our approach attains new state-of-the-art results in MLCIL tasks on both MS-COCO and PASCAL VOC datasets, with the calibration of label confidences confirmed through our methodology.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 19 Mar 2024.
Builds on
47 of 54 references.
References · 47
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2018Experience Replay for Continual Learningcited by 1,074
- 2021Learning to Prompt for Continual Learningcited by 938
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
35 more
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2018Progress & Compress: A scalable framework for continual learningcited by 516
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
- 2020Calibrating Deep Neural Networks using Focal Losscited by 353
- 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2016CNN-RNN: A Unified Framework for Multi-label Image Classificationcited by 189
- 2020Modeling the Background for Incremental Learning in Semantic Segmentationcited by 189
- 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 143
- 2021Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learningcited by 140
- 2020TResNet: High Performance GPU-Dedicated Architecturecited by 119
- 2019Learning Semantic-Specific Graph Representation for Multi-Label Image Recognitioncited by 116
- 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 87
- 2017Multi-label Image Recognition by Recurrently Discovering Attentional Regionscited by 83
- 2020Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognitioncited by 80
- 2020Imbalanced Continual Learning with Partitioning Reservoir Samplingcited by 71
- 2021SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learningcited by 71
- 2020Knowledge-Guided Multi-Label Few-Shot Learning for General Image Recognitioncited by 69
- 2023Class-Incremental Exemplar Compression for Class-Incremental Learningcited by 50
- 2022Exploring Example Influence in Continual Learningcited by 44
- 2021Transformer-based Dual Relation Graph for Multi-label Image Recognitioncited by 41
- 2020Incremental Learning via Rate Reductioncited by 31
- 2020Multi-Domain Multi-Task Rehearsal for Lifelong Learningcited by 24
- 2021Lifelong Teacher-Student Network Learningcited by 18
- 2022Rebalancing Batch Normalization for Exemplar-based Class-Incremental Learningcited by 16
- 2022AGCN: Augmented Graph Convolutional Network for Lifelong Multi-label Image Recognitioncited by 16
- 2022Optimizing Class Distribution in Memory for Multi-Label Online Continual Learningcited by 12
- 2022Multi-Label Continual Learning using Augmented Graph Convolutional Networkcited by 12
- 2022D3Former: Debiased Dual Distilled Transformer for Incremental Learningcited by 10
- 2023Knowledge Restore and Transfer for Multi-label Class-Incremental Learningcited by 7
- 2024Variational Continual Test-Time Adaptationcited by 7
- 2023Centroid Distance Distillation for Effective Rehearsal in Continual Learningcited by 4
- 2023Long-Tailed Learning as Multi-Objective Optimizationcited by 4
- 2024Elastic Multi-Gradient Descent for Parallel Continual Learningcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2025Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentationcited by 6
- 2025L3A: Label-Augmented Analytic Adaptation for Multi-Label Class Incremental Learningcited by 3
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1
- 2025Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learningcited by 1
- 2026P2L-CA: An Effective Parameter Tuning Framework for Rehearsal-Free Multi-Label Class-Incremental Learningcited by 0
- 2026Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learningcited by 0
- 2026Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning31 Aug 2026
- 2026P2L-CA: An Effective Parameter Tuning Framework for Rehearsal-Free Multi-Label Class-Incremental Learning19 Jan 2026
- 2025L3A: Label-Augmented Analytic Adaptation for Multi-Label Class Incremental Learning1 Jun 2025
- 2025Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentation28 Mar 2025
- 2025Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning1 Mar 2025
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation3 Oct 2024