mlsanityData to 7 Oct 2026

Confidence Self-Calibration for Multi-Label Class-Incremental Learning

arXiv 2403.12559 ↗First posted 19 Mar 2024cs.CV cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

The partial label challenge in Multi-Label Class-Incremental Learning (MLCIL) arises when only the new classes are labeled during training, while past and future labels remain unavailable. This issue leads to a proliferation of false-positive errors due to erroneously high confidence multi-label predictions, exacerbating catastrophic forgetting within the disjoint label space. In this paper, we aim to refine multi-label confidence calibration in MLCIL and propose a Confidence Self-Calibration (CSC) approach. Firstly, for label relationship calibration, we introduce a class-incremental graph convolutional network that bridges the isolated label spaces by constructing learnable, dynamically extended label relationship graph. Then, for confidence calibration, we present a max-entropy regularization for each multi-label increment, facilitating confidence self-calibration through the penalization of over-confident output distributions. Our approach attains new state-of-the-art results in MLCIL tasks on both MS-COCO and PASCAL VOC datasets, with the calibration of label confidences confirmed through our methodology.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 19 Mar 2024.

Builds on

47 of 54 references.

References · 47

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2016Learning without Forgettingcited by 2,465
  6. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  7. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2017Continual Learning with Deep Generative Replaycited by 1,152
  10. 2018Experience Replay for Continual Learningcited by 1,074
  11. 2021Learning to Prompt for Continual Learningcited by 938
  12. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
35 more
  1. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  2. 2018Progress & Compress: A scalable framework for continual learningcited by 516
  3. 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
  4. 2020Calibrating Deep Neural Networks using Focal Losscited by 353
  5. 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
  6. 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
  7. 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
  8. 2016CNN-RNN: A Unified Framework for Multi-label Image Classificationcited by 189
  9. 2020Modeling the Background for Incremental Learning in Semantic Segmentationcited by 189
  10. 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 143
  11. 2021Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learningcited by 140
  12. 2020TResNet: High Performance GPU-Dedicated Architecturecited by 119
  13. 2019Learning Semantic-Specific Graph Representation for Multi-Label Image Recognitioncited by 116
  14. 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 87
  15. 2017Multi-label Image Recognition by Recurrently Discovering Attentional Regionscited by 83
  16. 2020Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognitioncited by 80
  17. 2020Imbalanced Continual Learning with Partitioning Reservoir Samplingcited by 71
  18. 2021SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learningcited by 71
  19. 2020Knowledge-Guided Multi-Label Few-Shot Learning for General Image Recognitioncited by 69
  20. 2023Class-Incremental Exemplar Compression for Class-Incremental Learningcited by 50
  21. 2022Exploring Example Influence in Continual Learningcited by 44
  22. 2021Transformer-based Dual Relation Graph for Multi-label Image Recognitioncited by 41
  23. 2020Incremental Learning via Rate Reductioncited by 31
  24. 2020Multi-Domain Multi-Task Rehearsal for Lifelong Learningcited by 24
  25. 2021Lifelong Teacher-Student Network Learningcited by 18
  26. 2022Rebalancing Batch Normalization for Exemplar-based Class-Incremental Learningcited by 16
  27. 2022AGCN: Augmented Graph Convolutional Network for Lifelong Multi-label Image Recognitioncited by 16
  28. 2022Optimizing Class Distribution in Memory for Multi-Label Online Continual Learningcited by 12
  29. 2022Multi-Label Continual Learning using Augmented Graph Convolutional Networkcited by 12
  30. 2022D3Former: Debiased Dual Distilled Transformer for Incremental Learningcited by 10
  31. 2023Knowledge Restore and Transfer for Multi-label Class-Incremental Learningcited by 7
  32. 2024Variational Continual Test-Time Adaptationcited by 7
  33. 2023Centroid Distance Distillation for Effective Rehearsal in Continual Learningcited by 4
  34. 2023Long-Tailed Learning as Multi-Objective Optimizationcited by 4
  35. 2024Elastic Multi-Gradient Descent for Parallel Continual Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.