AI Co-Scientist for Knowledge Synthesis in Medical Contexts: A Proof of Concept
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
Research waste in biomedical science is driven by redundant studies, incomplete reporting, and the limited scalability of traditional evidence synthesis workflows. We present an AI co-scientist for scalable and transparent knowledge synthesis based on explicit formalization of Population, Intervention, Comparator, Outcome, and Study design (PICOS). The platform integrates relational storage, vector-based semantic retrieval, and a Neo4j knowledge graph. Evaluation was conducted on dementia-sport and non-communicable disease corpora. Automated PICOS compliance and study design classification from titles and abstracts were performed using a Bidirectional Long Short-Term Memory baseline and a transformer-based multi-task classifier fine-tuned from PubMedBERT. Full-text synthesis employed retrieval-augmented generation with hybrid vector and graph retrieval, while BERTopic was used to identify thematic structure, redundancy, and evidence gaps. The transformer model achieved 95.7% accuracy for study design classification with strong agreement against expert annotations, while the Bi-LSTM achieved 87% accuracy for PICOS compliance detection. Retrieval-augmented generation outperformed non-retrieval generation for queries requiring structured constraints, cross-study integration, and graph-based reasoning, whereas non-retrieval approaches remained competitive for high-level summaries. Topic modeling revealed substantial thematic redundancy and identified underexplored research areas. These results demonstrate that PICOS-aware and explainable natural language processing can improve the scalability, transparency, and efficiency of evidence synthesis. The proposed architecture is domain-agnostic and offers a practical framework for reducing research waste across biomedical disciplines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 5 of its 44 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
5 of 44 references.
References · 5
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2025Scientific Paper Retrieval with LLM-Guided Semantic-Based Rankingcited by 10
- 2025Advances in Pre-trained Language Models for Domain-Specific Text Classification: A Systematic Reviewcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Towards a Medical AI Scientist
- 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
- 2025Automated Construction of Medical Indicator Knowledge Graphs Using Retrieval Augmented Large Language Models
- 2025Explainable Biomedical Claim Verification with Large Language Models
- 2026Causal-Enhanced AI Agents for Medical Research Screening
- 2025FRAME: Feedback-Refined Agent Methodology for Enhancing Medical Research Insights
- 2026Evaluating AI-based Scientific Knowledge Synthesis with Epidemiological Systematic Reviews
- 2025An AI-Driven Live Systematic Reviews in the Brain-Heart Interconnectome: Minimizing Research Waste and Advancing Evidence Synthesis