AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation
Not on the map. Why?
Abstract (arXiv)
Scientific research proceeds through iterative cycles of hypothesis generation, experiment design, execution, and revision. AI agents can automate parts of this process, but existing approaches typically follow a single research trajectory or coordinate through a central planner with fixed objectives. As a result, they struggle to sustain parallel exploration, adapt as experimental evidence changes, or preserve knowledge of failed directions over long-running experiments. We introduce AutoScientists, a decentralized team of AI agents for long-running computational scientific experimentation. Agents interpret a shared experimental state, self-organize into teams around promising hypotheses, critique proposals before using experimental compute, and share successes and failures to reduce redundant exploration. Under matched experimental budgets, AutoScientists improves over prior AI agents across biomedical machine learning, language-model training optimization, and protein fitness prediction. On BioML-Bench, spanning biomedical imaging, protein engineering, single-cell omics, and drug discovery, AutoScientists achieves a mean leaderboard percentile of 74.4% across 24 tasks, improving over the strongest AI agent by +8.33%. On GPT training optimization, AutoScientists reaches a target validation bits-per-byte 1.9x faster than Autoresearch and continues discovering improvements from a starting champion where the single-agent approach finds none (7 vs. 0 accepted improvements). On ProteinGym fitness prediction, AutoScientists discovers a method for ACE2-Spike binding that improves over the current state-of-the-art model by +12.5% in Spearman correlation. Applied without modification across all 217 ProteinGym assays, the same method improves over the prior state of the art by +6.5% (Spearman correlation).
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 43 of its 78 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
43 of 78 references.
References · 43
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2018Model Cards for Model Reportingcited by 1,068
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
31 more
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2018CatBoost: gradient boosting with categorical features supportcited by 208
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2026Towards End-to-End Automation of AI Researchcited by 150
- 2025Towards a Science of Scaling Agent Systemscited by 125
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
- 2024Language Agents as Optimizable Graphscited by 81
- 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 78
- 2025TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Toolscited by 57
- 2025Robin: A multi-agent system for automating scientific discoverycited by 57
- 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 45
- 2025SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integrationcited by 40
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discoverycited by 38
- 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolutioncited by 33
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
- 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Researchcited by 29
- 2026Toward Ultra-Long-Horizon Agentic Science: Cognitive Accumulation for Machine Learning Engineeringcited by 26
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
- 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversitycited by 25
- 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discoverycited by 24
- 2025Emergent Coordination in Multi-Agent Language Modelscited by 22
- 2026Multi-Agent Teams Hold Experts Backcited by 16
- 2024Kermut: Composite kernel regression for protein variant effectscited by 11
- 2024Multi-Scale Representation Learning for Protein Fitness Predictioncited by 11
- 2026Can AI Agents Agree?cited by 7
- 2025GenoMAS: A Multi-Agent Framework for Scientific Discovery via Code-Driven Gene Expression Analysiscited by 6
- 2022Flat Teams Drive Scientific Innovationcited by 5
- 2025ChemBOMAS: Accelerated BO in Chemistry with LLM-Enhanced Multi-Agent Systemcited by 3
- 2025SelfAI: A self-directed framework for long-horizon scientific discoverycited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfercited by 5
- 2026auto-psych: Automating the science of mind using agent-driven theory discovery and experimentationcited by 4
- 2026Discovering Crystal Structure Prediction Algorithms with an AI Co-Scientistcited by 1
- 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 1
- 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agentscited by 0
- 2026Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrievalcited by 0
- 2026Can AI Scientists Coordinate at Runtime?cited by 0
- 2026Can AI Scientists Coordinate at Runtime?1 Oct 2026
- 2026Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrieval11 Sep 2026
- 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents31 Aug 2026
- 2026Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfer19 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026
- 2026auto-psych: Automating the science of mind using agent-driven theory discovery and experimentation24 Jun 2026
- 2026Discovering Crystal Structure Prediction Algorithms with an AI Co-Scientist22 Jun 2026