mlsanityData to 14 Oct 2026

FARS: A Fully Automated Research System Deployed at Scale

arXiv 2606.31651 ↗First posted 30 Jun 2026cs.AIcited by 7

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Recent automated research systems show that language-model agents can generate hypotheses, run experiments, and write complete manuscripts, but most evidence still comes from selected examples, human-framed topics, or a few pre-defined research tasks. We present FARS (Fully Automated Research System), a fully automated AI-for-AI research system designed to operate across research topics at scale. FARS autonomously generates and advances projects through ideation, planning, experimentation, and writing, using stage-specific agents coordinated through a shared workspace that records proposals, code, logs, results, and manuscripts. In its first public deployment, FARS produced 166 complete research papers spanning 67 fine-grained AI/ML topics while preserving intermediate artifacts as an auditable corpus rather than a curated set of successes. We evaluate this corpus with 282 structured reviews from volunteer reviewers covering 140 papers, including overall ratings, sub-scores, integrity checks, and LLM-use disclosure. The reviews indicate that FARS can produce review-worthy and occasionally strong AI/ML research artifacts in a large-scale public deployment, while also exposing recurring failure modes in narrow experimental scope, methodological limitations, and integrity issues.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 31 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

22 of 31 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence25 May
  2. 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research26 May
  3. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
  4. 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
  5. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep
  6. 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents26 Aug
  7. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct

Other references · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2024A Survey on LLM-as-a-Judgecited by 1,423
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  4. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  5. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  6. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  7. 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 63
  8. 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 62
  9. 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 57
  10. 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
  11. 2023Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experimentcited by 34
  12. 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
3 more
  1. 2025All That Glitters is Not Novel: Plagiarism in AI Generated Researchcited by 18
  2. 2025SafeScientist: Toward Risk-Aware Scientific Discoveries by LLM Agentscited by 16
  3. 2025Insights from the ICLR Peer Review and Rebuttal Processcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
  2. 2026Towards End-to-End Automation of AI Research
  3. 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Research
  4. 2025AISSISTANT: Human-AI Collaborative Review and Perspective Research Workflows in Data Science
  5. 2025Deep Research: A Survey of Autonomous Research Agents
  6. 2026Toward Autonomous Long-Horizon Engineering for ML Research
  7. 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Science
  8. 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents