Small Agent Group is the Future of Digital Health
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
The rapid adoption of large language models (LLMs) in digital health has been driven by a "scaling-first" philosophy, i.e., the assumption that clinical intelligence increases with model size and data. However, real-world clinical needs include not only effectiveness, but also reliability and reasonable deployment cost. Since clinical decision-making is inherently collaborative, we challenge the monolithic scaling paradigm and ask whether a Small Agent Group (SAG) can support better clinical reasoning. SAG shifts from single-model intelligence to collective expertise by distributing reasoning, evidence-based analysis, and critical audit through a collaborative deliberation process. To assess the clinical utility of SAG, we conduct extensive evaluations using diverse clinical metrics spanning effectiveness, reliability, and deployment cost. Our results show that SAG achieves superior performance compared to a single giant model, both with and without additional optimization or retrieval-augmented generation. These findings suggest that the synergistic reasoning represented by SAG can substitute for model parameter growth in clinical settings. Overall, SAG offers a scalable solution to digital health that better balances effectiveness, reliability, and deployment efficiency.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 38 of its 65 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
38 of 65 references.
References · 38
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
26 more
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
- 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 156
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
- 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 100
- 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 87
- 2023Diagnostic Reasoning Prompts Reveal the Potential for Large Language Model Interpretability in Medicinecited by 83
- 2024An Introduction to Centralized Training for Decentralized Execution in Cooperative Multi-Agent Reinforcement Learningcited by 46
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
- 2025Capabilities of GPT-5 on Multimodal Medical Reasoningcited by 35
- 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
- 2024MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answeringcited by 26
- 2025What is the Alignment Objective of GRPO?cited by 23
- 2025Multi-Agent Deep Research: Training Multi-Agent Systems with M-GRPOcited by 17
- 2024Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysiscited by 9
- 2025Incentivizing Truthful Language Models via Peer Elicitation Gamescited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Tasks
- 2025TeamMedAgents: Pareto-Efficient Multi-Agent Medical Reasoning Through Teamwork Theory
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?
- 2026AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Tasks
- 2026Why Specialist Models Still Matter: A Heterogeneous Multi-Agent Paradigm for Medical Artificial Intelligence
- 2026Deliberative multi-agent large language models improve clinical reasoning in ophthalmology
- 2025A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making
- 2024Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Bias