mlsanityData to 7 Oct 2026

Panacea: A foundation model for clinical trial search, summarization, design, and recruitment

arXiv 2407.11007 ↗First posted 25 Jun 2024cs.CL cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Clinical trials are fundamental in developing new drugs, medical devices, and treatments. However, they are often time-consuming and have low success rates. Although there have been initial attempts to create large language models (LLMs) for clinical trial design and patient-trial matching, these models remain task-specific and not adaptable to diverse clinical trial tasks. To address this challenge, we propose a clinical trial foundation model named Panacea, designed to handle multiple tasks, including trial search, trial summarization, trial design, and patient-trial matching. We also assemble a large-scale dataset, named TrialAlign, of 793,279 trial documents and 1,113,207 trial-related scientific papers, to infuse clinical knowledge into the model by pre-training. We further curate TrialInstruct, which has 200,866 of instruction data for fine-tuning. These resources enable Panacea to be widely applicable for a range of clinical trial tasks based on user requirements. We evaluated Panacea on a new benchmark, named TrialPanorama, which covers eight clinical trial tasks. Our method performed the best on seven of the eight tasks compared to six cutting-edge generic or medicine-specific LLMs. Specifically, Panacea showed great potential to collaborate with human experts in crafting the design of eligibility criteria, study arms, and outcome measures, in multi-round conversations. In addition, Panacea achieved 14.42% improvement in patient-trial matching, 41.78% to 52.02% improvement in trial search, and consistently ranked at the top for five aspects of trial summarization. Our approach demonstrates the effectiveness of Panacea in clinical trials and establishes a comprehensive resource, including training data, model, and benchmark, for developing clinical trial foundation models, paving the path for AI-based clinical trial development.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 27 of its 62 references that are in the map. First posted on arXiv 25 Jun 2024.

Builds on

27 of 62 references.

References · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2023Mistral 7Bcited by 3,065
  6. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  7. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  8. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  9. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  10. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  11. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  12. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
15 more
  1. 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
  2. 2023Towards Generalist Biomedical AIcited by 286
  3. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  4. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  5. 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
  6. 2023Matching Patients to Clinical Trials with Large Language Modelscited by 68
  7. 2023WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipediacited by 67
  8. 2020Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarizationcited by 52
  9. 2020COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial Matchingcited by 37
  10. 2023Large Language Models for Healthcare Data Augmentation: An Example on Patient-Trial Matchingcited by 30
  11. 2023Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncologycited by 24
  12. 2023Large Language Models Streamline Automated Machine Learning for Clinical Studiescited by 24
  13. 2022Trial2Vec: Zero-Shot Clinical Trial Document Similarity Search using Self-Supervisioncited by 18
  14. 2023AutoTrial: Prompting Language Models for Clinical Trial Designcited by 11
  15. 2024TriSum: Learning Summarization Ability from Large Language Models with Structured Rationalecited by 10

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 7.

10 papers.