Auto-Keras: An Efficient Neural Architecture Search System
Not on the map. Why?
Abstract (arXiv)
Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the functionality of a neural network while changing its neural architecture, could be helpful for NAS by enabling more efficient training during the search. In this paper, we propose a novel framework enabling Bayesian optimization to guide the network morphism for efficient neural architecture search. The framework develops a neural network kernel and a tree-structured acquisition function optimization algorithm to efficiently explores the search space. Intensive experiments on real-world benchmark datasets have been done to demonstrate the superior performance of the developed framework over the state-of-the-art methods. Moreover, we build an open-source AutoML system based on our method, namely Auto-Keras. The system runs in parallel on CPU and GPU, with an adaptive search strategy for different GPU memory limits.
Key facts. Cited by 169 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 44; 2022: 37; 2023: 29; 2024: 25; 2025: 23; 2026: 11.
169 papers.
Sort:
By area:
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2021Parameter Prediction for Unseen Deep Architecturescited by 89
- 2023MedViT: A Robust Vision Transformer for Generalized Medical Image Classificationcited by 89
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 84
- 2021NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Searchcited by 55
- 2022AMLB: an AutoML Benchmarkcited by 55
- 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinementcited by 52
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Modelscited by 43
38 more
- 2023Sequential Subset Matching for Dataset Distillationcited by 40
- 2021Automated Machine Learning on Graphs: A Surveycited by 38
- 2023AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Riskscited by 34
- 2021LightAutoML: AutoML Solution for a Large Financial Services Ecosystemcited by 32
- 2023Transfer Learning for Bayesian Optimization: A Surveycited by 27
- 2021Benchmarking Multimodal AutoML for Tabular Data with Text Fieldscited by 24
- 20213D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysiscited by 23
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learningcited by 23
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
- 2024Transformers and Large Language Models for Efficient Intrusion Detection Systems: A Comprehensive Surveycited by 21
- 2021PyGlove: Symbolic Programming for Automated Machine Learningcited by 19
- 2023Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOBcited by 18
- 2024Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarioscited by 18
- 2025AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Paperscited by 18
- 2022IoT Data Analytics in Dynamic Environments: From An Automated Machine Learning Perspectivecited by 15
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2021AutoGL: A Library for Automated Graph Learningcited by 14
- 2022Efficient Automated Deep Learning for Time Series Forecastingcited by 14
- 2024AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Taskscited by 14
- 2024Automated data processing and feature engineering for deep learning and big data applications: a surveycited by 14
- 2021Automated Evolutionary Approach for the Design of Composite Machine Learning Pipelinescited by 13
- 2021Automated Deep Learning: Neural Architecture Search Is Not the Endcited by 13
- 2024Multi-conditioned Graph Diffusion for Neural Architecture Searchcited by 13
- 2022A Survey on Computationally Efficient Neural Architecture Searchcited by 12
- 2021Accelerating Evolutionary Neural Architecture Search via Multi-Fidelity Evaluationcited by 9
- 2023Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoMLcited by 9
- 2023Dataset Distillation via Adversarial Prediction Matchingcited by 9
- 2022Automated Graph Machine Learning: Approaches, Libraries, Benchmarks and Directionscited by 8
- 2025MedKAN: An Advanced Kolmogorov-Arnold Network for Medical Image Classificationcited by 8
- 2025Agentic AI framework for End-to-End Medical Data Inferencecited by 8
- 2021Improving Neural Networks for Time Series Forecasting using Data Augmentation and AutoMLcited by 7
- 2025KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problemscited by 7
- 2021AutoVideo: An Automated Video Action Recognition Systemcited by 6
- 2022TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasetscited by 6
- 2022Task Selection for AutoML System Evaluationcited by 6
- 2023TransNAS-TSAD: Harnessing Transformers for Multi-Objective Neural Architecture Search in Time Series Anomaly Detectioncited by 6
- 2023Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraintcited by 6
- 2023AutoXPCR: Automated Multi-Objective Model Selection for Time Series Forecastingcited by 6
50 most cited of 169 All 169 (JSON)
- 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Models30 Sep 2026
- 2026Combinatorial Network-Based Manifold Topological Deep Learning for Image Analysis21 Sep 2026
- 2026Agentic Search Spaces for Tabular Machine Learning14 Sep 2026
- 2026Agentic ML Exploration (A-MLE) for Ads Ranking8 Sep 2026
- 2026LEMUR 2: Unlocking Neural Network Diversity for AI7 Jul 2026
- 2026Compression-Driven Anomaly Detection in Brain MRI Using an Interpretable Quantum Autoencoder25 Jun 2026
- 2026Evaluation of AutoML Frameworks for IDS under Imbalanced Data Conditions of the NSL-KDD Dataset10 Jun 2026
- 2026Optimized Weighted Voting System for Brain Tumor Classification Using MRI Images30 Mar 2026
- 2026G-LoG Bi-filtration for Medical Image Classification20 Feb 2026
- 2026iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML15 Feb 2026
- 2026When Agents Fail: A Comprehensive Study of Bugs in LLM Agents with Automated Labeling21 Jan 2026
- 2025DeepCAVE: A Visualization and Analysis Tool for Automated Machine Learning1 Dec 2025
38 more
- 2025Neural Architecture Search for global multi-step Forecasting of Energy Production Time Series27 Oct 2025
- 2025FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference26 Oct 2025
- 2025BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data7 Oct 2025
- 2025TACO-Net: Topological Signatures Triumph in 3D Object Classification29 Sep 2025
- 2025Neuroplasticity-inspired dynamic ANNs for multi-task demand forecasting29 Sep 2025
- 2025Quickly Tuning Foundation Models for Image Segmentation24 Aug 2025
- 2025KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problems13 Aug 2025
- 2025MedSymmFlow: Bridging Generative Modeling and Classification in Medical Imaging through Symmetrical Flow Matching25 Jul 2025
- 2025Agentic AI framework for End-to-End Medical Data Inference24 Jul 2025
- 2025Gradients: When Markets Meet Fine-tuning -- A Distributed Approach to Model Optimisation9 Jun 2025
- 2025PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs9 Jun 2025
- 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinement27 May 2025
- 2025AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Papers28 Apr 2025
- 2025Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review15 Apr 2025
- 2025Tin-Tin: Towards Tiny Learning on Tiny Devices with Integer-based Neural Network Training13 Apr 2025
- 2025An experimental survey and Perspective View on Meta-Learning for Automated Algorithms Selection and Parametrization8 Apr 2025
- 2025Hybrid machine learning data assimilation for marine biogeochemistry7 Apr 2025
- 2025Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank1 Apr 2025
- 2025MedKAN: An Advanced Kolmogorov-Arnold Network for Medical Image Classification25 Feb 2025
- 2025Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attention19 Feb 2025
- 2025AIDE: AI-Driven Exploration in the Space of Code18 Feb 2025
- 2025Benchmarking MedMNIST dataset on real quantum hardware18 Feb 2025
- 2024Bel Esprit: Multi-Agent Framework for Building AI Model Pipelines19 Dec 2024
- 2024ILASH: A Predictive Neural Architecture Search Framework for Multi-Task Applications3 Dec 2024
- 2024Can Models Help Us Create Better Models? Evaluating LLMs as Data Scientists30 Oct 2024
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning22 Oct 2024
- 2024Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios22 Oct 2024
- 2024Automating Data Science Pipelines with Tensor Completion8 Oct 2024
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML3 Oct 2024
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputation11 Sep 2024
- 2024Towards Automated Machine Learning Research9 Sep 2024
- 2024Maintainability Challenges in ML: A Systematic Literature Review17 Aug 2024
- 2024Transformers and Large Language Models for Efficient Intrusion Detection Systems: A Comprehensive Survey14 Aug 2024
- 2024Prioritize Alignment in Dataset Distillation6 Aug 2024
- 2024Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach7 Jun 2024
- 2024drGT: Attention-Guided Gene Assessment of Drug Response Utilizing a Drug-Cell-Gene Heterogeneous Network14 May 2024
- 2024Deep Learning Library Testing: Definition, Methods and Challenges27 Apr 2024
- 2024On the Fourier analysis in the SO(3) space : EquiLoPO Network24 Apr 2024
50 newest of 169 All 169 (JSON)
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 84
- 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinementcited by 52
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learningcited by 23
- 2025AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Paperscited by 18
- 2025Agentic AI framework for End-to-End Medical Data Inferencecited by 8
- 2025KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problemscited by 7
- 2026When Agents Fail: A Comprehensive Study of Bugs in LLM Agents with Automated Labelingcited by 6
- 2026Agentic ML Exploration (A-MLE) for Ads Rankingcited by 0
- 2026Agentic Search Spaces for Tabular Machine Learningcited by 0
- 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Modelscited by 0
- 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Models30 Sep 2026
- 2026Agentic Search Spaces for Tabular Machine Learning14 Sep 2026
- 2026Agentic ML Exploration (A-MLE) for Ads Ranking8 Sep 2026
- 2026When Agents Fail: A Comprehensive Study of Bugs in LLM Agents with Automated Labeling21 Jan 2026
- 2025KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problems13 Aug 2025
- 2025Agentic AI framework for End-to-End Medical Data Inference24 Jul 2025
- 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinement27 May 2025
- 2025AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Papers28 Apr 2025
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning22 Oct 2024
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML3 Oct 2024
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2021Parameter Prediction for Unseen Deep Architecturescited by 89
- 2023MedViT: A Robust Vision Transformer for Generalized Medical Image Classificationcited by 89
- 2021NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Searchcited by 55
- 2022AMLB: an AutoML Benchmarkcited by 55
- 2023Sequential Subset Matching for Dataset Distillationcited by 40
- 2021Automated Machine Learning on Graphs: A Surveycited by 38
- 2023AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Riskscited by 34
12 most cited of 154 All 154 (JSON)
- 2026Combinatorial Network-Based Manifold Topological Deep Learning for Image Analysis21 Sep 2026
- 2026LEMUR 2: Unlocking Neural Network Diversity for AI7 Jul 2026
- 2026Compression-Driven Anomaly Detection in Brain MRI Using an Interpretable Quantum Autoencoder25 Jun 2026
- 2026Evaluation of AutoML Frameworks for IDS under Imbalanced Data Conditions of the NSL-KDD Dataset10 Jun 2026
- 2026Optimized Weighted Voting System for Brain Tumor Classification Using MRI Images30 Mar 2026
- 2026G-LoG Bi-filtration for Medical Image Classification20 Feb 2026
- 2026iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML15 Feb 2026
- 2025DeepCAVE: A Visualization and Analysis Tool for Automated Machine Learning1 Dec 2025
- 2025Neural Architecture Search for global multi-step Forecasting of Energy Production Time Series27 Oct 2025
- 2025BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data7 Oct 2025
- 2025TACO-Net: Topological Signatures Triumph in 3D Object Classification29 Sep 2025
- 2025Neuroplasticity-inspired dynamic ANNs for multi-task demand forecasting29 Sep 2025
12 newest of 154 All 154 (JSON)