Dropout-based Active Learning for Regression
Not on the map. Why?
Abstract (arXiv)
Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time for data processing. In this paper, we propose a fast active learning algorithm for regression, tailored for neural network models. It is based on uncertainty estimation from stochastic dropout output of the network. Experiments on both synthetic and real-world datasets show comparable or better performance (depending on the accuracy metric) as compared to the baselines. This approach can be generalized to other deep learning architectures. It can be used to systematically improve a machine-learning model as it offers a computationally efficient way of sampling additional data.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 6; 2024: 6; 2025: 1.
24 papers.
Sort:
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 47
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimationcited by 27
- 2024Active Learning for Neural PDE Solverscited by 22
- 2025Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Modelscited by 18
- 2022Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regressioncited by 11
- 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillationcited by 11
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learningcited by 10
- 2024Querying Easily Flip-flopped Samples for Deep Active Learningcited by 7
- 2021Backdoor Attack and Defense for Deep Regressioncited by 6
- 2021Active learning for reducing labeling effort in text classification taskscited by 4
- 2022When Bioprocess Engineering Meets Machine Learning: A Survey from the Perspective of Automated Bioprocess Developmentcited by 4
- 2024Learning from the Best: Active Learning for Wireless Communicationscited by 4
12 more
- 2022Bucketized Active Sampling for Learning ACOPFcited by 3
- 2023Scalable Batch Acquisition for Deep Bayesian Active Learningcited by 2
- 2023Crowd-Powered Photo Enhancement Featuring an Active Learning Based Local Filtercited by 2
- 2021Robust and Active Learning for Deep Neural Network Regressioncited by 1
- 2022Facilitating automated conversion of scientific knowledge into scientific simulation models with the Machine Assisted Generation, Calibration, and Comparison (MAGCC) Frameworkcited by 1
- 2023Does Deep Active Learning Work in the Wild?cited by 1
- 2024Benchmarking Active Learning for NILMcited by 1
- 2021Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximationcited by 0
- 2022Towards Robust Deep Active Learning for Scientific Computingcited by 0
- 2022Scalable computation of prediction intervals for neural networks via matrix sketchingcited by 0
- 2023Active Learning Framework for Cost-Effective TCR-Epitope Binding Affinity Predictioncited by 0
- 2023Model Uncertainty based Active Learning on Tabular Data using Boosted Treescited by 0
- 2025Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Models20 Feb 2025
- 2024Benchmarking Active Learning for NILM24 Nov 2024
- 2024Active Learning for Neural PDE Solvers2 Aug 2024
- 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation27 Feb 2024
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation16 Feb 2024
- 2024Learning from the Best: Active Learning for Wireless Communications23 Jan 2024
- 2024Querying Easily Flip-flopped Samples for Deep Active Learning18 Jan 2024
- 2023Model Uncertainty based Active Learning on Tabular Data using Boosted Trees30 Oct 2023
- 2023Active Learning Framework for Cost-Effective TCR-Epitope Binding Affinity Prediction16 Oct 2023
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning17 Jul 2023
- 2023Crowd-Powered Photo Enhancement Featuring an Active Learning Based Local Filter15 Jun 2023
- 2023Does Deep Active Learning Work in the Wild?31 Jan 2023
12 more
- 2023Scalable Batch Acquisition for Deep Bayesian Active Learning13 Jan 2023
- 2022Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regression16 Nov 2022
- 2022When Bioprocess Engineering Meets Machine Learning: A Survey from the Perspective of Automated Bioprocess Development2 Sep 2022
- 2022Bucketized Active Sampling for Learning ACOPF16 Aug 2022
- 2022Scalable computation of prediction intervals for neural networks via matrix sketching6 May 2022
- 2022Facilitating automated conversion of scientific knowledge into scientific simulation models with the Machine Assisted Generation, Calibration, and Comparison (MAGCC) Framework21 Apr 2022
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regression17 Mar 2022
- 2022Towards Robust Deep Active Learning for Scientific Computing29 Jan 2022
- 2021Active learning for reducing labeling effort in text classification tasks10 Sep 2021
- 2021Backdoor Attack and Defense for Deep Regression6 Sep 2021
- 2021Robust and Active Learning for Deep Neural Network Regression28 Jul 2021
- 2021Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation29 Mar 2021
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 47
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimationcited by 27
- 2024Active Learning for Neural PDE Solverscited by 22
- 2025Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Modelscited by 18
- 2022Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regressioncited by 11
- 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillationcited by 11
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learningcited by 10
- 2024Querying Easily Flip-flopped Samples for Deep Active Learningcited by 7
- 2021Backdoor Attack and Defense for Deep Regressioncited by 6
- 2021Active learning for reducing labeling effort in text classification taskscited by 4
- 2022When Bioprocess Engineering Meets Machine Learning: A Survey from the Perspective of Automated Bioprocess Developmentcited by 4
- 2024Learning from the Best: Active Learning for Wireless Communicationscited by 4
12 most cited of 24 All 24 (JSON)
- 2025Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Models20 Feb 2025
- 2024Benchmarking Active Learning for NILM24 Nov 2024
- 2024Active Learning for Neural PDE Solvers2 Aug 2024
- 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation27 Feb 2024
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation16 Feb 2024
- 2024Learning from the Best: Active Learning for Wireless Communications23 Jan 2024
- 2024Querying Easily Flip-flopped Samples for Deep Active Learning18 Jan 2024
- 2023Model Uncertainty based Active Learning on Tabular Data using Boosted Trees30 Oct 2023
- 2023Active Learning Framework for Cost-Effective TCR-Epitope Binding Affinity Prediction16 Oct 2023
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning17 Jul 2023
- 2023Crowd-Powered Photo Enhancement Featuring an Active Learning Based Local Filter15 Jun 2023
- 2023Does Deep Active Learning Work in the Wild?31 Jan 2023
12 newest of 24 All 24 (JSON)