mlsanityData to 7 Oct 2026

ASIA: an Autonomous System Identification Agent

arXiv 2605.10480 ↗First posted 11 May 2026cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Over the years, research in system identification has provided a rich set of methods for learning dynamical models, together with well-established theoretical guarantees. In practice, however, the choice of model class, training algorithm, and hyperparameter tuning is still largely left to empirical trial-and-error, requiring substantial expert time and domain experience. Motivated by recent advances in agentic artificial intelligence, we present ASIA, a framework that delegates this iterative search to a large language model acting as an autonomous coding agent. Building on existing agentic platforms, ASIA closes the loop between hypothesis, implementation, and evaluation without human intervention, requiring only a plain-English description of the identification problem. We conduct an empirical study of ASIA on two system identification benchmarks and analyse the agent's search behaviour, the architectures and training strategies it discovers, and the quality of the resulting models. We also discuss the potential of the approach and its current limitations, including implicit test leakage, reduced methodological transparency, and reproducibility concerns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 7 of its 10 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

7 of 10 references.

References · 7

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  2. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  3. 2021Closed-form Continuous-time Neural Modelscited by 65
  4. 2020A Data-Driven Automatic Tuning Method for MPC under Uncertainty using Constrained Bayesian Optimizationcited by 15
  5. 2023Can Transformers Learn Optimal Filtering for Unknown Systems?cited by 15
  6. 2023From system models to class models: An in-context learning paradigmcited by 13
  7. 2025Nonlinear System Identification Nano-drone Benchmarkcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
  2. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
  3. 2026An Experimental Design Approach to Evaluating Agentic AI's Autonomous Model Discovery
  4. 2026The Path Ahead for Agentic AI: Challenges and Opportunities
  5. 2026The Auton Agentic AI Framework
  6. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review
  7. 2023A Survey on Large Language Model based Autonomous Agents
  8. 2025AI Agents: Evolution, Architecture, and Real-World Applications