Panacea: A foundation model for clinical trial search, summarization, design, and recruitment
Not on the map. Why?
Abstract (arXiv)
Clinical trials are fundamental in developing new drugs, medical devices, and treatments. However, they are often time-consuming and have low success rates. Although there have been initial attempts to create large language models (LLMs) for clinical trial design and patient-trial matching, these models remain task-specific and not adaptable to diverse clinical trial tasks. To address this challenge, we propose a clinical trial foundation model named Panacea, designed to handle multiple tasks, including trial search, trial summarization, trial design, and patient-trial matching. We also assemble a large-scale dataset, named TrialAlign, of 793,279 trial documents and 1,113,207 trial-related scientific papers, to infuse clinical knowledge into the model by pre-training. We further curate TrialInstruct, which has 200,866 of instruction data for fine-tuning. These resources enable Panacea to be widely applicable for a range of clinical trial tasks based on user requirements. We evaluated Panacea on a new benchmark, named TrialPanorama, which covers eight clinical trial tasks. Our method performed the best on seven of the eight tasks compared to six cutting-edge generic or medicine-specific LLMs. Specifically, Panacea showed great potential to collaborate with human experts in crafting the design of eligibility criteria, study arms, and outcome measures, in multi-round conversations. In addition, Panacea achieved 14.42% improvement in patient-trial matching, 41.78% to 52.02% improvement in trial search, and consistently ranked at the top for five aspects of trial summarization. Our approach demonstrates the effectiveness of Panacea in clinical trials and establishes a comprehensive resource, including training data, model, and benchmark, for developing clinical trial foundation models, paving the path for AI-based clinical trial development.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 27 of its 62 references that are in the map. First posted on arXiv 25 Jun 2024.
Builds on
27 of 62 references.
References · 27
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Mistral 7Bcited by 3,065
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
- 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
15 more
- 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
- 2023Towards Generalist Biomedical AIcited by 286
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2023Matching Patients to Clinical Trials with Large Language Modelscited by 68
- 2023WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipediacited by 67
- 2020Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarizationcited by 52
- 2020COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial Matchingcited by 37
- 2023Large Language Models for Healthcare Data Augmentation: An Example on Patient-Trial Matchingcited by 30
- 2023Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncologycited by 24
- 2023Large Language Models Streamline Automated Machine Learning for Clinical Studiescited by 24
- 2022Trial2Vec: Zero-Shot Clinical Trial Document Similarity Search using Self-Supervisioncited by 18
- 2023AutoTrial: Prompting Language Models for Clinical Trial Designcited by 11
- 2024TriSum: Learning Summarization Ability from Large Language Models with Structured Rationalecited by 10
Built on by
Citing papers per year: 2024: 3; 2025: 7.
10 papers.
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
- 2025SFT Doesn't Always Hurt General Capabilities: Revisiting Domain-Specific Fine-Tuning in LLMscited by 23
- 2025A foundation model for human-AI collaboration in medical literature miningcited by 11
- 2024A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challengescited by 8
- 2024Learning by Analogy: Enhancing Few-Shot Prompting for Math Word Problem Solving with Computational Graph-Based Retrievalcited by 4
- 2024Can Large Language Models Replace Data Scientists in Biomedical Research?cited by 1
- 2025The potential role of AI agents in transforming nuclear medicine research and cancer management in Indiacited by 1
- 2025InformGen: An AI Copilot for Accurate and Compliant Clinical Research Consent Document Generationcited by 1
- 2025TrialMatchAI: An End-to-End AI-powered Clinical Trial Recommendation System to Streamline Patient-to-Trial Matchingcited by 1
- 2025A systematic review of trial-matching pipelines using large language modelscited by 0
- 2025SFT Doesn't Always Hurt General Capabilities: Revisiting Domain-Specific Fine-Tuning in LLMs25 Sep 2025
- 2025A systematic review of trial-matching pipelines using large language models13 Sep 2025
- 2025TrialMatchAI: An End-to-End AI-powered Clinical Trial Recommendation System to Streamline Patient-to-Trial Matching13 May 2025
- 2025InformGen: An AI Copilot for Accurate and Compliant Clinical Research Consent Document Generation1 Apr 2025
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning31 Mar 2025
- 2025The potential role of AI agents in transforming nuclear medicine research and cancer management in India10 Mar 2025
- 2025A foundation model for human-AI collaboration in medical literature mining27 Jan 2025
- 2024Learning by Analogy: Enhancing Few-Shot Prompting for Math Word Problem Solving with Computational Graph-Based Retrieval25 Nov 2024
- 2024A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challenges28 Oct 2024
- 2024Can Large Language Models Replace Data Scientists in Biomedical Research?28 Oct 2024