BioDisco: Multi-agent hypothesis generation with dual-mode evidence, iterative feedback and temporal evaluation
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Identifying novel hypotheses is essential to scientific research, yet this process risks being overwhelmed by the sheer volume and complexity of available information. Existing automated methods often struggle to generate novel and evidence-grounded hypotheses, lack robust iterative refinement and rarely undergo rigorous temporal evaluation for future discovery potential. To address this, we propose BioDisco, a multi-agent framework that draws upon language model-based reasoning and a dual-mode evidence system (biomedical knowledge graphs and automated literature retrieval) for grounded novelty, integrates an internal scoring and feedback loop for iterative refinement, and validates performance through pioneering temporal and human evaluations and a Bradley-Terry paired comparison model to provide statistically-grounded assessment. Our evaluations demonstrate superior novelty and significance over ablated configurations and generalist biomedical agents. Designed for flexibility and modularity, BioDisco allows seamless integration of custom language models or knowledge graphs, and can be run with just a few lines of code.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 84 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
22 of 84 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023Large Language Modelscited by 774
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
- 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 138
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 97
10 more
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 96
- 2023LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Modelscited by 66
- 2024Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the datacited by 46
- 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 40
- 2025HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generationcited by 34
- 2024Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluationcited by 33
- 2020AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approachcited by 21
- 2025A Survey on Hypothesis Generation for Scientific Discovery in the Era of Large Language Modelscited by 17
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 7
- 2018Large-Scale Validation of Hypothesis Generation Systems via Candidate Rankingcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?cited by 3
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
- 2025Interestingness First Classifierscited by 1
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents10 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?12 Apr 2026
- 2025Interestingness First Classifiers27 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025BioVerge: A Comprehensive Benchmark and Study of Self-Evaluating Agents for Biomedical Hypothesis Generation
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Research
- 2026Generating Biomedical Fact-Checking Reports with RL-Enhanced Agentic Search
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses
- 2025Biomedical reasoning in action: Multi-agent System for Auditable Biomedical Evidence Synthesis
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validation
- 2026VERITAS: A Multi-Agent Co-Scientist for Verifiable Image-Derived Hypothesis Testing ↗
- 2025Knowledge-Driven Agentic Scientific Corpus Distillation Framework for Biomedical Large Language Models Training