Deep Active Learning for Computer Vision: Past and Future
Not on the map. Why?
Abstract (arXiv)
As an important data selection schema, active learning emerges as the essential component when iterating an Artificial Intelligence (AI) model. It becomes even more critical given the dominance of deep neural network based models, which are composed of a large number of parameters and data hungry, in application. Despite its indispensable role for developing AI models, research on active learning is not as intensive as other research directions. In this paper, we present a review of active learning through deep active learning approaches from the following perspectives: 1) technical advancements in active learning, 2) applications of active learning in computer vision, 3) industrial systems leveraging or with potential to leverage active learning for data iteration, 4) current limitations and future research directions. We expect this paper to clarify the significance of active learning in a modern AI model manufacturing process and to bring additional research attention to active learning. By addressing data automation challenges and coping with automated machine learning systems, active learning will facilitate democratization of AI technologies by boosting model production at scale.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 76 of its 126 references that are in the map. First posted on arXiv 27 Nov 2022.
Builds on
76 of 126 references.
References · 76
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
38 more
- 2020A Survey of Deep Active Learningcited by 547
- 2017Progressive Neural Architecture Searchcited by 483
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
- 2019Learning Loss for Active Learningcited by 335
- 2019Label Propagation for Deep Semi-supervised Learningcited by 287
- 2019Variational Adversarial Active Learningcited by 284
- 2018Meta-Learning: A Surveycited by 254
- 2017Cost-Effective Active Learning for Deep Image Classificationcited by 165
- 2018Adversarial Active Learning for Deep Networks: a Margin Based Approachcited by 155
- 2017Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentationcited by 145
- 2020Contextual Diversity for Active Learningcited by 139
- 2021Batch Active Learning at Scalecited by 127
- 2019Consistency-based Semi-supervised Active Learning: Towards Minimizing Labeling Costcited by 114
- 2021MST: Masked Self-Supervised Transformer for Visual Representationcited by 114
- 2017Deep Active Learning for Named Entity Recognitioncited by 108
- 2019Discriminative Active Learningcited by 97
- 2019ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentationcited by 95
- 2019Deep Active Learning: Unified and Principled Method for Query and Trainingcited by 92
- 2019Diverse mini-batch Active Learningcited by 88
- 2022A Comparative Survey of Deep Active Learningcited by 88
- 2020Task-Aware Variational Adversarial Active Learningcited by 84
- 2021SIMILAR: Submodular Information Measures Based Active Learning In Realistic Scenarioscited by 83
- 2017Deep Active Learning over the Long Tailcited by 82
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2021Multiple instance active learning for object detectioncited by 77
- 2017Generative Adversarial Active Learningcited by 69
- 2020Sequential Graph Convolutional Network for Active Learningcited by 69
- 2019Active Learning for Deep Detection Neural Networkscited by 62
- 2020State-Relabeling Adversarial Active Learningcited by 60
- 2019Bayesian Generative Active Deep Learningcited by 57
- 2020Reinforced active learning for image segmentationcited by 56
- 2022Entropy-based Active Learning for Object Detection with Progressive Diversity Constraintcited by 53
- 2018Active Learning for Deep Object Detectioncited by 49
- 2018Localization-Aware Active Learning for Object Detectioncited by 48
- 2018CEREALS - Cost-Effective REgion-based Active Learning for Semantic Segmentationcited by 47
- 2019Deep Active Learning for Efficient Training of a LiDAR 3D Object Detectorcited by 45
- 2019Batch Active Learning Using Determinantal Point Processescited by 42
50 most cited of 76 All 76 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 2.
7 papers.
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 53
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2024Improving Interpretability of Deep Active Learning for Flood Inundation Mapping Through Class Ambiguity Indices Using Multi-spectral Satellite Imagerycited by 6
- 2024Diverse Feature Learning by Self-distillation and Resetcited by 2
- 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learningcited by 1
- 2025Dependency-aware Maximum Likelihood Estimation for Active Learningcited by 0
- 2025Active Learning Methods for Efficient Data Utilization and Model Performance Enhancementcited by 0
- 2025Active Learning Methods for Efficient Data Utilization and Model Performance Enhancement21 Apr 2025
- 2025Dependency-aware Maximum Likelihood Estimation for Active Learning7 Mar 2025
- 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learning8 Oct 2024
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontiers1 May 2024
- 2024Improving Interpretability of Deep Active Learning for Flood Inundation Mapping Through Class Ambiguity Indices Using Multi-spectral Satellite Imagery29 Apr 2024
- 2024Diverse Feature Learning by Self-distillation and Reset29 Mar 2024
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023