mlsanityData to 14 Oct 2026

Deep Learning-based Prediction of Clinical Trial Enrollment with Uncertainty Estimates

arXiv 2507.23607 ↗First posted 31 Jul 2025cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical trials are a systematic endeavor to assess the safety and efficacy of new drugs or treatments. Conducting such trials typically demands significant financial investment and meticulous planning, highlighting the need for accurate predictions of trial outcomes. Accurately predicting patient enrollment, a key factor in trial success, is one of the primary challenges during the planning phase. In this work, we propose a novel deep learning-based method to address this critical challenge. Our method, implemented as a neural network model, leverages pre-trained language models (PLMs) to capture the complexities and nuances of clinical documents, transforming them into expressive representations. These representations are then combined with encoded tabular features via an attention mechanism. To account for uncertainties in enrollment prediction, we enhance the model with a probabilistic layer based on the Gamma distribution, which enables range estimation. We apply the proposed model to predict clinical trial duration, assuming site-level enrollment follows a Poisson-Gamma process. We carry out extensive experiments on real-world clinical trial data, and show that the proposed method can effectively predict the number of patients enrolled at a number of sites for a given clinical trial, outperforming established baseline models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 31 Jul 2025.

Builds on

21 of 37 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2024The Llama 3 Herd of Modelscited by 14,715
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2016Layer Normalizationcited by 5,669
  9. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  11. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  12. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
9 more
  1. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
  2. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 69
  3. 2024Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultracited by 37
  4. 2022Trial2Vec: Zero-Shot Clinical Trial Document Similarity Search using Self-Supervisioncited by 18
  5. 2023SPOT: Sequential Predictive Modeling of Clinical Trial Outcome with Meta-Learningcited by 13
  6. 2024TrialDura: Hierarchical Attention Transformer for Interpretable Clinical Trial Duration Predictioncited by 7
  7. 2024Fine Tuning Large Language Models for Medicine: The Role and Importance of Direct Preference Optimizationcited by 6
  8. 2024TrialEnroll: Predicting Clinical Trial Enrollment Success with Deep & Cross Network and Large Language Modelscited by 4
  9. 2021A Machine Learning Approach for Recruitment Prediction in Clinical Trial Designcited by 2

Built on by

Not cited yet.