# Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science

arXiv: https://arxiv.org/abs/1603.06212 · HTML: https://mlsanity.com/paper/1603.06212/

## Key facts

- Cited by 75 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Mar 2016.

## Built on by (most cited first, 30 of 75)

- [SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization](https://mlsanity.com/paper/2109.09831/) (2021)
- [Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges](https://mlsanity.com/paper/2107.05847/) (2021)
- [Neural Architecture Search: Insights from 1000 Papers](https://mlsanity.com/paper/2301.08727/) (2023)
- [AMLB: an AutoML Benchmark](https://mlsanity.com/paper/2207.12560/) (2022)
- [Automated Machine Learning on Graphs: A Survey](https://mlsanity.com/paper/2103.00742/) (2021)
- [Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loop](https://mlsanity.com/paper/2101.04296/) (2021)
- [Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML](https://mlsanity.com/paper/2303.08485/) (2023)
- [Fast and Informative Model Selection using Learning Curve Cross-Validation](https://mlsanity.com/paper/2111.13914/) (2021)
- [Efficient Automated Deep Learning for Time Series Forecasting](https://mlsanity.com/paper/2205.05511/) (2022)
- [AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation](https://mlsanity.com/paper/2406.19251/) (2024)
- [Flexora: Flexible Low Rank Adaptation for Large Language Models](https://mlsanity.com/paper/2408.10774/) (2024)
- [Online AutoML: An adaptive AutoML framework for online learning](https://mlsanity.com/paper/2201.09750/) (2022)
- [Automated Graph Machine Learning: Approaches, Libraries, Benchmarks and Directions](https://mlsanity.com/paper/2201.01288/) (2022)
- [The AI Cosmologist I: An Agentic System for Automated Data Analysis](https://mlsanity.com/paper/2504.03424/) (2025)
- [SubStrat: A Subset-Based Strategy for Faster AutoML](https://mlsanity.com/paper/2206.03070/) (2022)
- [Q(D)O-ES: Population-based Quality (Diversity) Optimisation for Post Hoc Ensemble Selection in AutoML](https://mlsanity.com/paper/2307.08364/) (2023)
- [Manas: Mining Software Repositories to Assist AutoML](https://mlsanity.com/paper/2112.03395/) (2021)
- [Automatic MILP Solver Configuration By Learning Problem Similarities](https://mlsanity.com/paper/2307.00670/) (2023)
- [A Comparison of Recent Algorithms for Symbolic Regression to Genetic Programming](https://mlsanity.com/paper/2406.03585/) (2024)
- [An Empirical Study on the Usage of Automated Machine Learning Tools](https://mlsanity.com/paper/2208.13116/) (2022)
- [AutoDES: AutoML Pipeline Generation of Classification with Dynamic Ensemble Strategy Selection](https://mlsanity.com/paper/2201.00207/) (2022)
- [SapientML: Synthesizing Machine Learning Pipelines by Learning from Human-Written Solutions](https://mlsanity.com/paper/2202.10451/) (2022)
- [AutoMLBench: A Comprehensive Experimental Evaluation of Automated Machine Learning Frameworks](https://mlsanity.com/paper/2204.08358/) (2022)
- [ARLO: A Framework for Automated Reinforcement Learning](https://mlsanity.com/paper/2205.10416/) (2022)
- [AutoDOViz: Human-Centered Automation for Decision Optimization](https://mlsanity.com/paper/2302.09688/) (2023)
- [The Potential of AutoML for Recommender Systems](https://mlsanity.com/paper/2402.04453/) (2024)
- [Automated Machine Learning Techniques for Data Streams](https://mlsanity.com/paper/2106.07317/) (2021)
- [Multi-level Stress Assessment from ECG in a Virtual Reality Environment using Multimodal Fusion](https://mlsanity.com/paper/2107.04566/) (2021)
- [Automated Machine Learning, Bounded Rationality, and Rational Metareasoning](https://mlsanity.com/paper/2109.04744/) (2021)
- [Pairwise Difference Learning for Classification](https://mlsanity.com/paper/2406.20031/) (2024)

## Abstract (arXiv)

As the field of data science continues to grow, there will be an ever-increasing demand for tools that make machine learning accessible to non-experts. In this paper, we introduce the concept of tree-based pipeline optimization for automating one of the most tedious parts of machine learning---pipeline design. We implement an open source Tree-based Pipeline Optimization Tool (TPOT) in Python and demonstrate its effectiveness on a series of simulated and real-world benchmark data sets. In particular, we show that TPOT can design machine learning pipelines that provide a significant improvement over a basic machine learning analysis while requiring little to no input nor prior knowledge from the user. We also address the tendency for TPOT to design overly complex pipelines by integrating Pareto optimization, which produces compact pipelines without sacrificing classification accuracy. As such, this work represents an important step toward fully automating machine learning pipeline design.