Multi-Label Bayesian Active Learning with Inter-Label Relationships
Not on the map. Why?
Abstract (arXiv)
The primary challenge of multi-label active learning, differing it from multi-class active learning, lies in assessing the informativeness of an indefinite number of labels while also accounting for the inherited label correlation. Existing studies either require substantial computational resources to leverage correlations or fail to fully explore label dependencies. Additionally, real-world scenarios often require addressing intrinsic biases stemming from imbalanced data distributions. In this paper, we propose a new multi-label active learning strategy to address both challenges. Our method incorporates progressively updated positive and negative correlation matrices to capture co-occurrence and disjoint relationships within the label space of annotated samples, enabling a holistic assessment of uncertainty rather than treating labels as isolated elements. Furthermore, alongside diversity, our model employs ensemble pseudo labeling and beta scoring rules to address data imbalances. Extensive experiments on four realistic datasets demonstrate that our strategy consistently achieves more reliable and superior performance, compared to several established methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 64 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
26 of 64 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2018Gradient Descent Finds Global Minima of Deep Neural Networkscited by 574
- 2020A Survey of Deep Active Learningcited by 554
- 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
- 2017Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samplescited by 147
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2015A Sensitivity Analysis of (and Practitioners' Guide to) Convolutional Neural Networks for Sentence Classificationcited by 92
- 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
14 more
- 2021Influence Selection for Active Learningcited by 84
- 2021Towards Fewer Annotations: Active Learning via Region Impurity and Prediction Uncertainty for Domain Adaptive Semantic Segmentationcited by 57
- 2019Rethinking deep active learning: Using unlabeled data at model trainingcited by 39
- 2019Sampling Bias in Deep Active Classification: An Empirical Studycited by 36
- 2018Addressing the Item Cold-start Problem by Attribute-driven Active Learningcited by 33
- 2022Improved Multi-label Classification under Temporal Concept Drift: Rethinking Group-Robust Algorithms in a Label-Wise Settingcited by 23
- 2023An Exploration of Encoder-Decoder Approaches to Multi-Label Classification for Legal and Biomedical Textcited by 23
- 2020DEAL: Deep Evidential Active Learning for Image Classificationcited by 22
- 2020Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphscited by 19
- 2023Re-thinking Federated Active Learning based on Inter-class Diversitycited by 14
- 2022Deep Active Learning for Multi-Label Classification of Remote Sensing Imagescited by 6
- 2023Bayesian Estimate of Mean Proper Scores for Diversity-Enhanced Active Learningcited by 6
- 2023Active Learning Guided Fine-Tuning for enhancing Self-Supervised Based Multi-Label Classification of Remote Sensing Imagescited by 3
- 2024Harnessing the Power of Beta Scoring in Deep Active Learning for Multi-Label Text Classificationcited by 1
Built on by
Not cited yet.