MoBYv2AL: Self-supervised Active Learning for Image Classification
Not on the map. Why?
Abstract (arXiv)
Active learning(AL) has recently gained popularity for deep learning(DL) models. This is due to efficient and informative sampling, especially when the learner requires large-scale labelled datasets. Commonly, the sampling and training happen in stages while more batches are added. One main bottleneck in this strategy is the narrow representation learned by the model that affects the overall AL selection. We present MoBYv2AL, a novel self-supervised active learning framework for image classification. Our contribution lies in lifting MoBY, one of the most successful self-supervised learning algorithms, to the AL pipeline. Thus, we add the downstream task-aware objective function and optimize it jointly with contrastive loss. Further, we derive a data-distribution selection function from labelling the new examples. Finally, we test and study our pipeline robustness and performance for image classification tasks. We successfully achieved state-of-the-art results when compared to recent AL methods. Code available: https://github.com/razvancaramalau/MoBYv2AL
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 4 Jan 2023.
Builds on
33 of 43 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Wide Residual Networkscited by 3,057
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
21 more
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2019Learning Loss for Active Learningcited by 335
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
- 2019Variational Adversarial Active Learningcited by 284
- 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
- 2021Active Learning by Acquiring Contrastive Examplescited by 154
- 2020Contextual Diversity for Active Learningcited by 139
- 2021Self-Supervised Learning with Swin Transformerscited by 121
- 2019Consistency-based Semi-supervised Active Learning: Towards Minimizing Labeling Costcited by 114
- 2013Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networkscited by 84
- 2020Task-Aware Variational Adversarial Active Learningcited by 84
- 2020Sequential Graph Convolutional Network for Active Learningcited by 69
- 2021Semi-Supervised Active Learning with Temporal Output Discrepancycited by 50
- 2021Reducing Label Effort: Self-Supervised meets Active Learningcited by 42
- 2017Cost-Effective Active Learning for Melanoma Segmentationcited by 40
- 2021Test Distribution-Aware Active Learning: A Principled Approach Against Distribution Shift and Outlierscited by 22
- 2020Active Learning for Bayesian 3D Hand Pose Estimationcited by 13
- 2020Confident Coreset for Active Learning in Medical Image Analysiscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2.
3 papers.