FARS: A Fully Automated Research System Deployed at Scale
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Recent automated research systems show that language-model agents can generate hypotheses, run experiments, and write complete manuscripts, but most evidence still comes from selected examples, human-framed topics, or a few pre-defined research tasks. We present FARS (Fully Automated Research System), a fully automated AI-for-AI research system designed to operate across research topics at scale. FARS autonomously generates and advances projects through ideation, planning, experimentation, and writing, using stage-specific agents coordinated through a shared workspace that records proposals, code, logs, results, and manuscripts. In its first public deployment, FARS produced 166 complete research papers spanning 67 fine-grained AI/ML topics while preserving intermediate artifacts as an auditable corpus rather than a curated set of successes. We evaluate this corpus with 282 structured reviews from volunteer reviewers covering 140 papers, including overall ratings, sub-scores, integrity checks, and LLM-use disclosure. The reviews indicate that FARS can produce review-worthy and occasionally strong AI/ML research artifacts in a large-scale public deployment, while also exposing recurring failure modes in narrow experimental scope, methodological limitations, and integrity issues.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 31 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
22 of 31 references.
Closest ancestors · 7
Same direction, newest first
- 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence25 May
- 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research26 May
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep
- 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents26 Aug
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct
Other references · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 63
- 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 62
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 57
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
- 2023Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experimentcited by 34
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
3 more
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Taskscited by 1
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2026IdeaTrail: Full-Process Agent Trajectories for Scientific Ideationcited by 0
- 2026Towards a new paradigm of scientific discovery with socialized artificial intelligencecited by 0
- 2026Beyond Natural Language: An Agent-Native Language for Autonomous Sciencecited by 0
- 2026Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Paperscited by 0
- 2026Verify Less, Evolve More: Training Idea-Level Critics for Verification-Efficient ML Evolving Agentscited by 0
- 2026Verify Less, Evolve More: Training Idea-Level Critics for Verification-Efficient ML Evolving Agents6 Oct 2026
- 2026Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Papers30 Sep 2026
- 2026Beyond Natural Language: An Agent-Native Language for Autonomous Science21 Sep 2026
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Tasks5 Aug 2026
- 2026Towards a new paradigm of scientific discovery with socialized artificial intelligence3 Aug 2026
- 2026IdeaTrail: Full-Process Agent Trajectories for Scientific Ideation11 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
- 2026Towards End-to-End Automation of AI Research
- 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Research
- 2025AISSISTANT: Human-AI Collaborative Review and Perspective Research Workflows in Data Science
- 2025Deep Research: A Survey of Autonomous Research Agents
- 2026Toward Autonomous Long-Horizon Engineering for ML Research
- 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Science
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents