mlsanityData to 7 Oct 2026

AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation

arXiv 2605.28655 ↗First posted 27 May 2026cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Scientific research proceeds through iterative cycles of hypothesis generation, experiment design, execution, and revision. AI agents can automate parts of this process, but existing approaches typically follow a single research trajectory or coordinate through a central planner with fixed objectives. As a result, they struggle to sustain parallel exploration, adapt as experimental evidence changes, or preserve knowledge of failed directions over long-running experiments. We introduce AutoScientists, a decentralized team of AI agents for long-running computational scientific experimentation. Agents interpret a shared experimental state, self-organize into teams around promising hypotheses, critique proposals before using experimental compute, and share successes and failures to reduce redundant exploration. Under matched experimental budgets, AutoScientists improves over prior AI agents across biomedical machine learning, language-model training optimization, and protein fitness prediction. On BioML-Bench, spanning biomedical imaging, protein engineering, single-cell omics, and drug discovery, AutoScientists achieves a mean leaderboard percentile of 74.4% across 24 tasks, improving over the strongest AI agent by +8.33%. On GPT training optimization, AutoScientists reaches a target validation bits-per-byte 1.9x faster than Autoresearch and continues discovering improvements from a starting champion where the single-agent approach finds none (7 vs. 0 accepted improvements). On ProteinGym fitness prediction, AutoScientists discovers a method for ACE2-Spike binding that improves over the current state-of-the-art model by +12.5% in Spearman correlation. Applied without modification across all 217 ProteinGym assays, the same method improves over the prior state of the art by +6.5% (Spearman correlation).

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 43 of its 78 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

43 of 78 references.

References · 43

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  5. 2018Model Cards for Model Reportingcited by 1,068
  6. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  7. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  8. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  9. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  10. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  11. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  12. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
31 more
  1. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
  2. 2018CatBoost: gradient boosting with categorical features supportcited by 208
  3. 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
  4. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
  5. 2026Towards End-to-End Automation of AI Researchcited by 150
  6. 2025Towards a Science of Scaling Agent Systemscited by 125
  7. 2024Empowering Biomedical Discovery with AI Agentscited by 117
  8. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
  9. 2024Language Agents as Optimizable Graphscited by 81
  10. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 78
  11. 2025TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Toolscited by 57
  12. 2025Robin: A multi-agent system for automating scientific discoverycited by 57
  13. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 45
  14. 2025SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integrationcited by 40
  15. 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discoverycited by 38
  16. 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolutioncited by 33
  17. 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
  18. 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Researchcited by 29
  19. 2026Toward Ultra-Long-Horizon Agentic Science: Cognitive Accumulation for Machine Learning Engineeringcited by 26
  20. 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
  21. 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversitycited by 25
  22. 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discoverycited by 24
  23. 2025Emergent Coordination in Multi-Agent Language Modelscited by 22
  24. 2026Multi-Agent Teams Hold Experts Backcited by 16
  25. 2024Kermut: Composite kernel regression for protein variant effectscited by 11
  26. 2024Multi-Scale Representation Learning for Protein Fitness Predictioncited by 11
  27. 2026Can AI Agents Agree?cited by 7
  28. 2025GenoMAS: A Multi-Agent Framework for Scientific Discovery via Code-Driven Gene Expression Analysiscited by 6
  29. 2022Flat Teams Drive Scientific Innovationcited by 5
  30. 2025ChemBOMAS: Accelerated BO in Chemistry with LLM-Enhanced Multi-Agent Systemcited by 3
  31. 2025SelfAI: A self-directed framework for long-horizon scientific discoverycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.