# AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data

arXiv: https://arxiv.org/abs/2010.16358 · HTML: https://mlsanity.com/paper/2010.16358/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Oct 2020.

## Built on by (most cited first, 9 of 9)

- [AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification](https://mlsanity.com/paper/2110.13511/) (2021)
- [TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets](https://mlsanity.com/paper/2204.07615/) (2022)
- [Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles](https://mlsanity.com/paper/2302.09748/) (2023)
- [pTNAS: Progressive Neural Architecture Search for Tabular Data](https://mlsanity.com/paper/2403.10318/) (2024)
- [Parallel Multi-Objective Hyperparameter Optimization with Uniform Normalization and Bounded Objectives](https://mlsanity.com/paper/2309.14936/) (2023)
- [Towards Neural Architecture Search for Transfer Learning in 6G Networks](https://mlsanity.com/paper/2406.02333/) (2024)
- [Learning Continually on a Sequence of Graphs -- The Dynamical System Way](https://mlsanity.com/paper/2305.12030/) (2023)
- [Understanding Patterns of Deep Learning ModelEvolution in Network Architecture Search](https://mlsanity.com/paper/2309.12576/) (2023)
- [Automated Model Design using Gated Neuron Selection in Telecom](https://mlsanity.com/paper/2602.10854/) (2026)

## Abstract (arXiv)

Developing high-performing predictive models for large tabular data sets is a challenging task. The state-of-the-art methods are based on expert-developed model ensembles from different supervised learning methods. Recently, automated machine learning (AutoML) is emerging as a promising approach to automate predictive model development. Neural architecture search (NAS) is an AutoML approach that generates and evaluates multiple neural network architectures concurrently and improves the accuracy of the generated models iteratively. A key issue in NAS, particularly for large data sets, is the large computation time required to evaluate each generated architecture. While data-parallel training is a promising approach that can address this issue, its use within NAS is difficult. For different data sets, the data-parallel training settings such as the number of parallel processes, learning rate, and batch size need to be adapted to achieve high accuracy and reduction in training time. To that end, we have developed AgEBO-Tabular, an approach to combine aging evolution (AgE), a parallel NAS method that searches over neural architecture space, and an asynchronous Bayesian optimization method for tuning the hyperparameters of the data-parallel training simultaneously. We demonstrate the efficacy of the proposed method to generate high-performing neural network models for large tabular benchmark data sets. Furthermore, we demonstrate that the automatically discovered neural network models using our method outperform the state-of-the-art AutoML ensemble models in inference speed by two orders of magnitude while reaching similar accuracy values.