DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning
Not on the map. Why?
Abstract (arXiv)
Automated Machine Learning (AutoML) is used more than ever before to support users in determining efficient hyperparameters, neural architectures, or even full machine learning pipelines. However, users tend to mistrust the optimization process and its results due to a lack of transparency, making manual tuning still widespread. We introduce DeepCAVE, an interactive framework to analyze and monitor state-of-the-art optimization procedures for AutoML easily and ad hoc. By aiming for full and accessible transparency, DeepCAVE builds a bridge between users and AutoML and contributes to establishing trust. Our framework's modular and easy-to-extend nature provides users with automatically generated text, tables, and graphic visualizations. We show the value of DeepCAVE in an exemplary use-case of outlier detection, in which our framework makes it easy to identify problems, compare multiple runs and interpret optimization processes. The package is freely available on GitHub https://github.com/automl/DeepCAVE.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 7 Jun 2022.
Builds on
14 of 30 references.
References · 14
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
- 2015Non-stochastic Best Arm Identification and Hyperparameter Optimizationcited by 219
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2016Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasetscited by 131
- 2020Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligencecited by 81
- 2020Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDLcited by 67
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
- 2019Best Practices for Scientific Research on Neural Architecture Searchcited by 53
- 2020Trust in AutoML: Exploring Information Needs for Establishing Trust in Automated Machine Learning Systemscited by 36
- 2021DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly Detectioncited by 21
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 4; 2025: 5; 2026: 1.
14 papers.
Sort:
- 2023Hyperparameters in Reinforcement Learning and How To Tune Themcited by 58
- 2023PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspacescited by 15
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigmcited by 14
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoMLcited by 9
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learningcited by 8
- 2025The Role of Hyperparameters in Predictive Multiplicitycited by 4
- 2024ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learningcited by 3
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimizationcited by 2
- 2022From Xception to NEXcepTion: New Design Decisions and Neural Architecture Searchcited by 0
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Makingcited by 0
- 2025Survey of Active Learning Hyperparameters: Insights from a Large-Scale Experimental Gridcited by 0
- 2025Preference-Optimal Multi-Metric Weighting for Parallel Coordinate Plotscited by 0
- 2026Leveraging AutoML for Sustainable Deep Learning: A Multi-Objective HPO Approach on Deep Shift Neural Networks22 Jun 2026
- 2025Best Practices For Empirical Meta-Algorithmic Research: Guidelines from the COSEAL Research Network18 Dec 2025
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization4 Nov 2025
- 2025Preference-Optimal Multi-Metric Weighting for Parallel Coordinate Plots24 Jun 2025
- 2025Survey of Active Learning Hyperparameters: Insights from a Large-Scale Experimental Grid4 Jun 2025
- 2025The Role of Hyperparameters in Predictive Multiplicity13 Mar 2025
- 2024ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learning27 Sep 2024
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigm5 Jun 2024
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoML13 May 2024
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Making19 Mar 2024
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning7 Sep 2023
- 2023Hyperparameters in Reinforcement Learning and How To Tune Them2 Jun 2023
- 2023Hyperparameters in Reinforcement Learning and How To Tune Themcited by 58
- 2023PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspacescited by 15
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigmcited by 14
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoMLcited by 9
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learningcited by 8
- 2025The Role of Hyperparameters in Predictive Multiplicitycited by 4
- 2024ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learningcited by 3
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimizationcited by 2
- 2022From Xception to NEXcepTion: New Design Decisions and Neural Architecture Searchcited by 0
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Makingcited by 0
- 2025Survey of Active Learning Hyperparameters: Insights from a Large-Scale Experimental Gridcited by 0
- 2025Preference-Optimal Multi-Metric Weighting for Parallel Coordinate Plotscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Leveraging AutoML for Sustainable Deep Learning: A Multi-Objective HPO Approach on Deep Shift Neural Networks22 Jun 2026
- 2025Best Practices For Empirical Meta-Algorithmic Research: Guidelines from the COSEAL Research Network18 Dec 2025
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization4 Nov 2025
- 2025Preference-Optimal Multi-Metric Weighting for Parallel Coordinate Plots24 Jun 2025
- 2025Survey of Active Learning Hyperparameters: Insights from a Large-Scale Experimental Grid4 Jun 2025
- 2025The Role of Hyperparameters in Predictive Multiplicity13 Mar 2025
- 2024ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learning27 Sep 2024
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigm5 Jun 2024
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoML13 May 2024
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Making19 Mar 2024
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning7 Sep 2023
- 2023Hyperparameters in Reinforcement Learning and How To Tune Them2 Jun 2023
12 newest of 14 All 14 (JSON)