AIBuildAI: An AI Agent for Automatically Building AI Models
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
AI models underpin modern intelligent systems, driving advances across science, medicine, finance, and technology. Yet developing high-performing AI models remains a labor-intensive process that requires expert practitioners to iteratively design architectures, engineer representations, implement training pipelines and refine approaches through empirical evaluation. Existing AutoML methods partially alleviate this burden but remain limited to narrow aspects such as hyperparameter optimization and model selection within predefined search spaces, leaving the full development lifecycle largely dependent on human expertise. To address this gap, we introduce AIBuildAI, an AI agent that automatically builds AI models from a task description and training data. AIBuildAI adopts a hierarchical agent architecture in which a manager agent coordinates three specialized sub-agents: a designer for modeling strategy, a coder for implementation and debugging, and a tuner for training and performance optimization. Each sub-agent is itself a large language model (LLM) based agent capable of multi-step reasoning and tool use, enabling end-to-end automation of the AI model development process that goes beyond the scope of existing AutoML approaches. We evaluate AIBuildAI on MLE-Bench, a benchmark of realistic Kaggle-style AI development tasks spanning visual, textual, time-series and tabular modalities. AIBuildAI ranks first on MLE-Bench with a medal rate of 63.1%, outperforming all existing baseline methods and matching the capability of highly experienced AI engineers. These results demonstrate that hierarchical agent systems can automate the full AI model development process from task specification to deployable model, suggesting a pathway toward broadly accessible AI development with minimal human intervention.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 47 of its 85 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
47 of 85 references.
Closest ancestors · 4
Same direction, newest first
- 2026MARS: Modular Agent with Reflective Search for Automated AI Research2 Feb
- 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-bench3 Jul
- 2025R&D-Agent: An LLM-Agent Framework Towards Autonomous Data Science20 May
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
Other references · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2022A ConvNet for the 2020scited by 3,545
31 more
- 2016Wide Residual Networkscited by 3,057
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2017Deep Reinforcement Learning that Matterscited by 727
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2019AutoML: A Survey of the State-of-the-Artcited by 388
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 57
- 2025MixLLM: Dynamic Routing in Mixed Large Language Modelscited by 56
- 2025InternAgent: When Agent Becomes the Scientist -- Building Closed-Loop System from Hypothesis to Verificationcited by 41
- 2024Crafting Personalized Agents through Retrieval-Augmented Generation on Editable Memory Graphscited by 38
- 2025The FM Agentcited by 20
- 2025AutoMLGen: Navigating Fine-Grained Optimization for Coding Agentscited by 17
- 2026KAPSO: A Knowledge-grounded framework for Autonomous Program Synthesis and Optimizationcited by 10
- 2025Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimizationcited by 6
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 20
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 10
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineeringcited by 7
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discoverycited by 4
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyondcited by 3
- 2026Beyond Solution-Centric Search: Adaptive Inquiry and Knowledge Revision for Autonomous ML Engineeringcited by 2
- 2026AIBuildAI-2: A Knowledge-Enhanced Agent for Automatically Building AI Modelscited by 1
- 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 1
- 2026Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skillscited by 1
- 2026AIBuildAI-2.5: Efficient Autonomous AI Model Development Through LLM-Guided Tree Searchcited by 0
- 2026AIBuildAI-2.5: Efficient Autonomous AI Model Development Through LLM-Guided Tree Search6 Sep 2026
- 2026Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills2 Sep 2026
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond14 Aug 2026
- 2026Beyond Solution-Centric Search: Adaptive Inquiry and Knowledge Revision for Autonomous ML Engineering3 Aug 2026
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering30 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery11 Jun 2026
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinement10 Jun 2026
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery4 Jun 2026
- 2026AIBuildAI-2: A Knowledge-Enhanced Agent for Automatically Building AI Models27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML
- 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Research
- 2026StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents
- 2026Toward Autonomous Long-Horizon Engineering for ML Research
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review
- 2026DeltaML-Bench: Evaluating Machine Learning Agents on Real-World Research Repositories
- 2026MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI