Deep Active Learning with a Neural Architecture Search
Not on the map. Why?
Abstract (arXiv)
We consider active learning of deep neural networks. Most active learning works in this context have focused on studying effective querying mechanisms and assumed that an appropriate network architecture is a priori known for the problem at hand. We challenge this assumption and propose a novel active strategy whereby the learning algorithm searches for effective architectures on the fly, while actively learning. We apply our strategy using three known querying techniques (softmax response, MC-dropout, and coresets) and show that the proposed approach overwhelmingly outperforms active learning using fixed architectures.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 1; 2025: 3; 2026: 3.
17 papers.
Sort:
By area:
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 54
- 2023Active Prompt Learning in Vision Language Modelscited by 25
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Reviewcited by 16
- 2023Self-Expanding Neural Networkscited by 14
- 2023Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Searchcited by 5
- 2023DP-HyPO: An Adaptive Private Hyperparameter Optimization Frameworkcited by 4
- 2022Integrating Transformer and Autoencoder Techniques with Spectral Graph Algorithms for the Prediction of Scarcely Labeled Molecular Datacited by 2
- 2023Active Learning for Video Classification with Frame Level Queriescited by 2
- 2025Causal Discovery via Bayesian Optimizationcited by 1
- 2025FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inferencecited by 1
- 2023Deep Active Learning with Structured Neural Depth Searchcited by 0
- 2023ResBuilder: Automated Learning of Depth with Residual Structurescited by 0
5 more
- 2023BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Explorationcited by 0
- 2025ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learningcited by 0
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimizationcited by 0
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AIcited by 0
- 2026Are Candidate Models Really Needed for Active Learning?cited by 0
- 2026Are Candidate Models Really Needed for Active Learning?14 May 2026
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI23 Feb 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2025FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference26 Oct 2025
- 2025ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning10 Mar 2025
- 2025Causal Discovery via Bayesian Optimization25 Jan 2025
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontiers1 May 2024
- 2023Active Prompt Learning in Vision Language Models18 Nov 2023
- 2023BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Exploration16 Aug 2023
- 2023ResBuilder: Automated Learning of Depth with Residual Structures16 Aug 2023
- 2023Active Learning for Video Classification with Frame Level Queries10 Jul 2023
- 2023Self-Expanding Neural Networks10 Jul 2023
5 more
- 2023DP-HyPO: An Adaptive Private Hyperparameter Optimization Framework9 Jun 2023
- 2023Deep Active Learning with Structured Neural Depth Search5 Jun 2023
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Review24 May 2023
- 2023Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search11 Apr 2023
- 2022Integrating Transformer and Autoencoder Techniques with Spectral Graph Algorithms for the Prediction of Scarcely Labeled Molecular Data12 Nov 2022
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 54
- 2023Label-Efficient Learning in Agriculture: A Comprehensive Reviewcited by 16
- 2023Self-Expanding Neural Networkscited by 14
- 2023Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Searchcited by 5
- 2023DP-HyPO: An Adaptive Private Hyperparameter Optimization Frameworkcited by 4
- 2022Integrating Transformer and Autoencoder Techniques with Spectral Graph Algorithms for the Prediction of Scarcely Labeled Molecular Datacited by 2
- 2023Active Learning for Video Classification with Frame Level Queriescited by 2
- 2025Causal Discovery via Bayesian Optimizationcited by 1
- 2023Deep Active Learning with Structured Neural Depth Searchcited by 0
- 2023ResBuilder: Automated Learning of Depth with Residual Structurescited by 0
- 2023BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Explorationcited by 0
- 2025ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learningcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Are Candidate Models Really Needed for Active Learning?14 May 2026
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI23 Feb 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2025ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning10 Mar 2025
- 2025Causal Discovery via Bayesian Optimization25 Jan 2025
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontiers1 May 2024
- 2023BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Exploration16 Aug 2023
- 2023ResBuilder: Automated Learning of Depth with Residual Structures16 Aug 2023
- 2023Active Learning for Video Classification with Frame Level Queries10 Jul 2023
- 2023Self-Expanding Neural Networks10 Jul 2023
- 2023DP-HyPO: An Adaptive Private Hyperparameter Optimization Framework9 Jun 2023
- 2023Deep Active Learning with Structured Neural Depth Search5 Jun 2023
12 newest of 15 All 15 (JSON)