A Method for Stopping Active Learning Based on Stabilizing Predictions and the Need for User-Adjustable Stopping
Not on the map. Why?
Abstract (arXiv)
A survey of existing methods for stopping active learning (AL) reveals the needs for methods that are: more widely applicable; more aggressive in saving annotations; and more stable across changing datasets. A new method for stopping AL based on stabilizing predictions is presented that addresses these needs. Furthermore, stopping methods are required to handle a broad range of different annotation/performance tradeoff valuations. Despite this, the existing body of work is dominated by conservative methods with little (if any) attention paid to providing users with control over the behavior of stopping methods. The proposed method is shown to fill a gap in the level of aggressiveness available for stopping AL and supports providing users with control over stopping behavior.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Sep 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 2; 2024: 4; 2025: 1; 2026: 4.
21 papers.
Sort:
By area:
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2021Small-Text: Active Learning for Text Classification in Pythoncited by 19
- 2021Hitting the Target: Stopping Active Learning at the Cost-Based Optimumcited by 9
- 2022OneLabeler: A Flexible System for Building Data Labeling Toolscited by 9
- 2022CitySurfaces: City-Scale Semantic Segmentation of Sidewalk Materialscited by 8
- 2021Stopping Criterion for Active Learning Based on Error Stabilitycited by 6
- 2021Active Learning for Network Traffic Classification: A Technical Studycited by 5
- 2023Robust online active learningcited by 5
- 2022Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysiscited by 4
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimationcited by 4
- 2026Finding Needles in the Haystack: Transductive Active Labeling in Ecologycited by 3
- 2022Impact of Stop Sets on Stopping Active Learning for Text Classificationcited by 2
9 more
- 2022ALANNO: An Active Learning Annotation System for Mortalscited by 1
- 2024Early stopping by correlating online indicators in neural networkscited by 0
- 2024Modeling of learning curves with applications to pos taggingcited by 0
- 2024Adaptive scheduling for adaptive sampling in POS taggers constructioncited by 0
- 2024Absolute convergence and error thresholds in non-active adaptive samplingcited by 0
- 2025An (ε,δ)-accurate level set estimation with a stopping criterioncited by 0
- 2026Learnable Weighting of Intra-Attribute Distances for Categorical Data Clustering with Nominal and Ordinal Attributescited by 0
- 2026How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classificationcited by 0
- 2026Active Inference as Context Acquisition for AI Agentscited by 0
- 2026How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classification4 Aug 2026
- 2026Learnable Weighting of Intra-Attribute Distances for Categorical Data Clustering with Nominal and Ordinal Attributes6 Jul 2026
- 2026Active Inference as Context Acquisition for AI Agents8 Jun 2026
- 2026Finding Needles in the Haystack: Transductive Active Labeling in Ecology2 Jun 2026
- 2025An (ε,δ)-accurate level set estimation with a stopping criterion26 Mar 2025
- 2024Absolute convergence and error thresholds in non-active adaptive sampling4 Feb 2024
- 2024Adaptive scheduling for adaptive sampling in POS taggers construction4 Feb 2024
- 2024Modeling of learning curves with applications to pos tagging4 Feb 2024
- 2024Early stopping by correlating online indicators in neural networks4 Feb 2024
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimation8 Nov 2023
- 2023Robust online active learning1 Feb 2023
- 2022Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysis20 Dec 2022
9 more
- 2022ALANNO: An Active Learning Annotation System for Mortals11 Nov 2022
- 2022A Survey of Active Learning for Natural Language Processing18 Oct 2022
- 2022OneLabeler: A Flexible System for Building Data Labeling Tools27 Mar 2022
- 2022Impact of Stop Sets on Stopping Active Learning for Text Classification8 Jan 2022
- 2022CitySurfaces: City-Scale Semantic Segmentation of Sidewalk Materials6 Jan 2022
- 2021Hitting the Target: Stopping Active Learning at the Cost-Based Optimum7 Oct 2021
- 2021Small-Text: Active Learning for Text Classification in Python21 Jul 2021
- 2021Active Learning for Network Traffic Classification: A Technical Study13 Jun 2021
- 2021Stopping Criterion for Active Learning Based on Error Stability5 Apr 2021
- 2026Active Inference as Context Acquisition for AI Agentscited by 0
- 2026Active Inference as Context Acquisition for AI Agents8 Jun 2026
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2021Small-Text: Active Learning for Text Classification in Pythoncited by 19
- 2021Hitting the Target: Stopping Active Learning at the Cost-Based Optimumcited by 9
- 2022OneLabeler: A Flexible System for Building Data Labeling Toolscited by 9
- 2022CitySurfaces: City-Scale Semantic Segmentation of Sidewalk Materialscited by 8
- 2021Stopping Criterion for Active Learning Based on Error Stabilitycited by 6
- 2021Active Learning for Network Traffic Classification: A Technical Studycited by 5
- 2023Robust online active learningcited by 5
- 2022Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysiscited by 4
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimationcited by 4
- 2026Finding Needles in the Haystack: Transductive Active Labeling in Ecologycited by 3
- 2022Impact of Stop Sets on Stopping Active Learning for Text Classificationcited by 2
12 most cited of 20 All 20 (JSON)
- 2026How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classification4 Aug 2026
- 2026Learnable Weighting of Intra-Attribute Distances for Categorical Data Clustering with Nominal and Ordinal Attributes6 Jul 2026
- 2026Finding Needles in the Haystack: Transductive Active Labeling in Ecology2 Jun 2026
- 2025An (ε,δ)-accurate level set estimation with a stopping criterion26 Mar 2025
- 2024Absolute convergence and error thresholds in non-active adaptive sampling4 Feb 2024
- 2024Adaptive scheduling for adaptive sampling in POS taggers construction4 Feb 2024
- 2024Modeling of learning curves with applications to pos tagging4 Feb 2024
- 2024Early stopping by correlating online indicators in neural networks4 Feb 2024
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimation8 Nov 2023
- 2023Robust online active learning1 Feb 2023
- 2022Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysis20 Dec 2022
- 2022ALANNO: An Active Learning Annotation System for Mortals11 Nov 2022
12 newest of 20 All 20 (JSON)