Clinical Trial Information Extraction with BERT
Not on the map. Why?
Abstract (arXiv)
Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical trial text. We trained named entity recognition (NER) models to extract eligibility criteria entities by fine-tuning a set of pre-trained BERT models. We then compared the performance of CT-BERT with recent baseline methods including attention-based BiLSTM and Criteria2Query. The results demonstrate the superiority of CT-BERT in clinical trial NLP.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 7 of its 10 references that are in the map. First posted on arXiv 11 Sep 2021.
Builds on
7 of 10 references.
References · 7
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
- 2021Applications of artificial intelligence in drug development using real-world datacited by 7
- 2020Information Extraction of Clinical Trial Eligibility Criteriacited by 6
- 2020Attention-Based LSTM Network for COVID-19 Clinical Trial Parsingcited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 4; 2025: 1; 2026: 2.
8 papers.
- 2024Exploring the Generalization of Cancer Clinical Trial Eligibility Classifiers Across Diseasescited by 3
- 2025A Survey on LLM-Assisted Clinical Trial Recruitmentcited by 2
- 2024Entity Recognition from Colloquial Textcited by 1
- 2024DAEDRA: A language model for predicting outcomes in passive pharmacovigilance reportingcited by 1
- 2024CTBench: A Comprehensive Benchmark for Evaluating Language Model Capabilities in Clinical Trial Designcited by 1
- 2026AI-assisted Protocol Information Extraction For Improved Accuracy and Efficiency in Clinical Trial Workflowscited by 1
- 2022Customizing Knowledge Graph Embedding to Improve Clinical Study Recommendationcited by 0
- 2026The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitizationcited by 0
- 2026The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitization13 Oct 2026
- 2026AI-assisted Protocol Information Extraction For Improved Accuracy and Efficiency in Clinical Trial Workflows19 Jan 2026
- 2025A Survey on LLM-Assisted Clinical Trial Recruitment18 Jun 2025
- 2024CTBench: A Comprehensive Benchmark for Evaluating Language Model Capabilities in Clinical Trial Design25 Jun 2024
- 2024Exploring the Generalization of Cancer Clinical Trial Eligibility Classifiers Across Diseases25 Mar 2024
- 2024DAEDRA: A language model for predicting outcomes in passive pharmacovigilance reporting10 Feb 2024
- 2024Entity Recognition from Colloquial Text9 Jan 2024
- 2022Customizing Knowledge Graph Embedding to Improve Clinical Study Recommendation28 Dec 2022