Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language model-based agents are increasingly deployed as collaborators in scientific discovery yet most current work focuses on the autonomous capabilities of "AI Scientists". We argue that this overlooks the social aspects of scientific teamwork, and that studying AI Scientists as human-agent systems (HAS)--where the unit of analysis is the human-agent pair--is both underexplored and undervalued. We establish these points through literature and empirical analysis, and highlight recent incidences and studies which show that deploying agents in science without accounting for human-agent dynamics introduces near-term risks, including reduced diversity of scientific inquiry. Through analysis of real-world case studies, we show that scientists and agents can augment each other's capabilities. We call for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scientific discovery.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 58 of its 80 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
58 of 80 references.
Closest ancestors · 10
Same direction, newest first
- 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery9 Mar
- 2025AlphaResearch: Accelerating New Algorithm Discovery with Language Models11 Nov
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug
- 2025AI-Researcher: Autonomous Scientific Innovation24 May
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents31 Mar
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System12 Oct
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agent9 Oct
Other references · 48
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
- 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 163
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
- 2024Empowering Biomedical Discovery with AI Agentscited by 118
- 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
- 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 93
- 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
- 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samplescited by 72
36 more
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 65
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 63
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 57
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 53
- 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 53
- 2025InternAgent: When Agent Becomes the Scientist -- Building Closed-Loop System from Hypothesis to Verificationcited by 46
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 44
- 2025Early science acceleration experiments with GPT-5cited by 41
- 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidencecited by 35
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2025The More You Automate, the Less You See: Hidden Pitfalls of AI Scientist Systemscited by 29
- 2026Accelerating Scientific Research with Gemini: Case Studies and Common Techniquescited by 29
- 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 27
- 2025Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedbackcited by 25
- 2026How AI Impacts Skill Formationcited by 24
- 2025The Denario project: Deep knowledge AI agents for scientific discoverycited by 21
- 2026Multi-Agent Teams Hold Experts Backcited by 21
- 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 18
- 2025All That Glitters is Not Novel: Plagiarism in AI Generated Researchcited by 18
- 2025OmniScientist: Toward a Co-evolving Ecosystem of Human and AI Scientistscited by 18
- 2025Sparks: Multi-Agent Artificial Intelligence Model Discovers Protein Design Principlescited by 17
- 2026The Last Human-Written Paper: Agent-Native Research Artifactscited by 16
- 2025How Far Are AI Scientists from Changing the World?cited by 15
- 2025Jr. AI Scientist and Its Risk Report: Autonomous Scientific Exploration from a Baseline Papercited by 12
- 2025CentaurEval: Benchmarking Human-in-the-Loop Value in Agentic Codingcited by 12
- 2024MatPilot: an LLM-enabled AI Materials Scientist under the Framework of Human-Machine Collaborationcited by 11
- 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
- 2025Toward Greater Autonomy in Materials Discovery Agents: Unifying Planning, Physics, and Scientistscited by 10
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
- 2025Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automationcited by 9
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transitioncited by 6
- 2025Scaling Laws in Scientific Discovery with AI and Robot Scientistscited by 5
- 2026Ask Early, Ask Late, Ask Right: When Does Clarification Timing Matter for Long-Horizon Agents?cited by 4
- 2026SCICONVBENCH: Benchmarking LLMs on Multi-Turn Clarification for Task Formulation in Computational Sciencecited by 2
- 2026How to Steer Your Multi-Agent System: Human-LLM Collaborative Planningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery
- 2026AI Scientists as Engines of Discovery: A Case for Development within Reformed Institutions
- 2025Agent4S: The Transformation of Research Paradigms from the Perspective of Large Language Models
- 2026Atria Dawn: The Dawn of Agentic Superintelligence
- 2026A Society of Researchers: Designing Institutions for Populations of Autonomous Research Agents
- 2026AI scientists produce results without reasoning scientifically
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy
- 2026Harnessing the Collective Intelligence of AI Agents in the Wild for New Discoveries