# Amazon SageMaker Autopilot: a white box AutoML solution at scale

arXiv: https://arxiv.org/abs/2012.08483 · HTML: https://mlsanity.com/paper/2012.08483/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Dec 2020.

## Built on by (most cited first, 20 of 20)

- [LightAutoML: AutoML Solution for a Large Financial Services Ecosystem](https://mlsanity.com/paper/2109.01528/) (2021)
- [AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Papers](https://mlsanity.com/paper/2504.20115/) (2025)
- [Automated data processing and feature engineering for deep learning and big data applications: a survey](https://mlsanity.com/paper/2403.11395/) (2024)
- [XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning](https://mlsanity.com/paper/2202.11954/) (2022)
- [On Efficient Approximate Queries over Machine Learning Models](https://mlsanity.com/paper/2206.02845/) (2022)
- [Deep Active Learning for Computer Vision: Past and Future](https://mlsanity.com/paper/2211.14819/) (2022)
- [How Can We Train Deep Learning Models Across Clouds and Continents? An Experimental Study](https://mlsanity.com/paper/2306.03163/) (2023)
- [AutoDOViz: Human-Centered Automation for Decision Optimization](https://mlsanity.com/paper/2302.09688/) (2023)
- [Mining Robust Default Configurations for Resource-constrained AutoML](https://mlsanity.com/paper/2202.09927/) (2022)
- [Institutional Platform for Secure Self-Service Large Language Model Exploration](https://mlsanity.com/paper/2402.00913/) (2024)
- [ACE: Adaptive Constraint-aware Early Stopping in Hyperparameter Optimization](https://mlsanity.com/paper/2208.02922/) (2022)
- [Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelines](https://mlsanity.com/paper/2302.04977/) (2023)
- [Integration Of Evolutionary Automated Machine Learning With Structural Sensitivity Analysis For Composite Pipelines](https://mlsanity.com/paper/2312.14770/) (2023)
- [A Simple and Fast Baseline for Tuning Large XGBoost Models](https://mlsanity.com/paper/2111.06924/) (2021)
- [3D Adapted Random Forest Vision (3DARFV) for Untangling Heterogeneous-Fabric Exceeding Deep Learning Semantic Segmentation Efficiency at the Utmost Accuracy](https://mlsanity.com/paper/2203.12469/) (2022)
- [Active-Learning-as-a-Service: An Automatic and Efficient MLOps System for Data-Centric AI](https://mlsanity.com/paper/2207.09109/) (2022)
- [Clustering Indices based Automatic Classification Model Selection](https://mlsanity.com/paper/2305.13926/) (2023)
- [A knowledge-driven AutoML architecture](https://mlsanity.com/paper/2311.17124/) (2023)
- [Feedback-driven object detection and iterative model improvement](https://mlsanity.com/paper/2411.19835/) (2024)
- [FLStore: Efficient Federated Learning Storage for non-training workloads](https://mlsanity.com/paper/2503.00323/) (2025)

## Abstract (arXiv)

AutoML systems provide a black-box solution to machine learning problems by selecting the right way of processing features, choosing an algorithm and tuning the hyperparameters of the entire pipeline. Although these systems perform well on many datasets, there is still a non-negligible number of datasets for which the one-shot solution produced by each particular system would provide sub-par performance. In this paper, we present Amazon SageMaker Autopilot: a fully managed system providing an automated ML solution that can be modified when needed. Given a tabular dataset and the target column name, Autopilot identifies the problem type, analyzes the data and produces a diverse set of complete ML pipelines including feature preprocessing and ML algorithms, which are tuned to generate a leaderboard of candidate models. In the scenario where the performance is not satisfactory, a data scientist is able to view and edit the proposed ML pipelines in order to infuse their expertise and business knowledge without having to revert to a fully manual solution. This paper describes the different components of Autopilot, emphasizing the infrastructure choices that allow scalability, high quality models, editable ML pipelines, consumption of artifacts of offline meta-learning, and a convenient integration with the entire SageMaker suite allowing these trained models to be used in a production setting.