mlsanityData to 7 Oct 2026

Position: A Call to Action for a Human-Centered AutoML Paradigm

arXiv 2406.03348 ↗First posted 5 Jun 2024cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) workflows, aiding the research of new ML algorithms, and contributing to the democratization of ML by making it accessible to a broader audience. Over the past decade, commendable achievements in AutoML have primarily focused on optimizing predictive performance. This focused progress, while substantial, raises questions about how well AutoML has met its broader, original goals. In this position paper, we argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems, including their diverse roles, expectations, and expertise. We envision a more human-centered approach in future AutoML research, promoting the collaborative design of ML systems that tightly integrates the complementary strengths of human expertise and AutoML methodologies.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 70 of its 131 references that are in the map. First posted on arXiv 5 Jun 2024.

Builds on

70 of 131 references.

References · 70

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  4. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  5. 2016The Mythos of Model Interpretabilitycited by 716
  6. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
  7. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  8. 2016Learning to learn by gradient descent by gradient descentcited by 616
  9. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
  10. 2023Symbolic Discovery of Optimization Algorithmscited by 423
  11. 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
  12. 2019The many Shapley values for model explanationcited by 341
38 more
  1. 2020A Survey on Neural Network Interpretabilitycited by 291
  2. 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
  3. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  4. 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
  5. 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
  6. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
  7. 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
  8. 2021Primer: Searching for Efficient Transformers for Language Modelingcited by 162
  9. 2020Multi-Objective Counterfactual Explanationscited by 157
  10. 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 137
  11. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  12. 2019FLAML: A Fast and Lightweight AutoML Librarycited by 104
  13. 2018Tunability: Importance of Hyperparameters of Machine Learning Algorithmscited by 98
  14. 2019Unrestricted Permutation forces Extrapolation: Variable Importance Requires at least One More Model, or There Is No Free Variable Importancecited by 85
  15. 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 84
  16. 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 80
  17. 2019Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIcited by 79
  18. 2021Few-Shot Bayesian Optimization with Deep Kernel Surrogatescited by 70
  19. 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 69
  20. 2020AutoML to Date and Beyond: Challenges and Opportunitiescited by 63
  21. 2017Hyperparameter Importance Across Datasetscited by 62
  22. 2018Visualizing the Feature Importance for Black Box Modelscited by 55
  23. 2018Bayesian Optimization in AlphaGocited by 55
  24. 2020Fair Bayesian Optimizationcited by 45
  25. 2020Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodologycited by 41
  26. 2022Automated Dynamic Algorithm Configurationcited by 37
  27. 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overviewcited by 37
  28. 2020Trust in AutoML: Exploring Information Needs for Establishing Trust in Automated Machine Learning Systemscited by 36
  29. 2021Explaining Hyperparameter Optimization via Partial Dependence Plotscited by 35
  30. 2023AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Riskscited by 34
  31. 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learningcited by 31
  32. 2018AutoPrognosis: Automated Clinical Prognostic Modeling via Bayesian Optimization with Structured Kernel Learningcited by 22
  33. 2019Quantifying Model Complexity via Functional Decomposition for Better Post-Hoc Interpretabilitycited by 22
  34. 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
  35. 2023A General Framework for User-Guided Bayesian Optimizationcited by 22
  36. 2021Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loopcited by 21
  37. 2021How Much Automation Does a Data Scientist Want?cited by 20
  38. 2020PipelineProfiler: A Visual Analytics Tool for the Exploration of AutoML Pipelinescited by 19

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 8; 2026: 3.

14 papers.

Sort:

By area: