mlsanityData to 7 Oct 2026

iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML

arXiv 2602.13937 ↗First posted 15 Feb 2026cs.LG cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated Machine Learning (AutoML) has improved access to machine learning, yet existing techniques often remain limited in flexibility, transparency, and execution reliability. Code-driven AutoML offers a promising direction by synthesizing executable code for preprocessing, model training, and evaluation. However, current LLM-based approaches frequently generate code that is plausible in text yet brittle in execution, insufficiently grounded in the actual dataset, or restricted to narrow solution paths. In this paper, we introduce iML, a multi-agent code-driven AutoML framework designed around three requirements: executability, problem grounding, and broad exploration of valid solutions. iML first analyzes the task and profiles the data, then synthesizes a structured blueprint that guides modular code generation across multiple implementation tracks, including traditional ML,pretrained adaptation, and custom neural architectures. To improve reliability, iML enforces interface checking, dynamic execution, and iterative debugging during integration. We evaluate iML on MLE-BENCH and the newly introduced iML-BENCH, covering diverse Kaggle-style tasks. On MLE-BENCH, iML attains a 90% valid submission rate and a 45% medal rate, and an APS of 0.82, improving the average standardized performance score (APS) over the LLM-based baselines by 52%-273%. On iML-BENCH, it achieves the highest APS and demonstrates robust performance even when task descriptions are substantially stripped. These results establish iML as a reliable and competitive framework for code-driven AutoML.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

16 of 24 references.

References · 16

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
  3. 2019AutoML: A Survey of the State-of-the-Artcited by 388
  4. 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
  5. 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
  6. 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
  7. 2018Auto-Keras: An Efficient Neural Architecture Search Systemcited by 169
  8. 2023Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineeringcited by 125
  9. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 119
  10. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 84
  11. 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 80
  12. 2023MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Taskscited by 66
4 more
  1. 2022OpenFE: Automated Feature Generation with Expert-level Performancecited by 52
  2. 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinementcited by 52
  3. 2024Optimized Feature Generation for Tabular Data via LLMs with Decision Tree Reasoningcited by 48
  4. 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automationcited by 22

Built on by

Not cited yet.