ELMTEX: Fine-Tuning Large Language Models for Structured Clinical Information Extraction. A Case Study on Clinical Reports
Not on the map. Why?
Abstract (arXiv)
Europe's healthcare systems require enhanced interoperability and digitalization, driving a demand for innovative solutions to process legacy clinical data. This paper presents the results of our project, which aims to leverage Large Language Models (LLMs) to extract structured information from unstructured clinical reports, focusing on patient history, diagnoses, treatments, and other predefined categories. We developed a workflow with a user interface and evaluated LLMs of varying sizes through prompting strategies and fine-tuning. Our results show that fine-tuned smaller models match or surpass larger counterparts in performance, offering efficiency for resource-limited settings. A new dataset of 60,000 annotated English clinical summaries and 24,000 German translations was validated with automated and manual checks. The evaluations used ROUGE, BERTScore, and entity-level metrics. The work highlights the approach's viability and outlines future improvements.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 8 Feb 2025.
Builds on
13 of 29 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 157
- 2023ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluationcited by 88
- 2023Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domaincited by 38
- 2021GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domaincited by 36
- 2023Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extractioncited by 32
- 2023Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AIcited by 11
- 2019Natural language processing of MIMIC-III clinical notes for identifying diagnosis and procedures with neural networkscited by 5
- 2020Intimate Partner Violence and Injury Prediction From Radiology Reportscited by 4
1 more
Built on by
Citing papers per year: 2025: 2.
2 papers.