Automatic detection of diseases in Spanish clinical notes combining medical language models and ontologies
Not on the map. Why?
Abstract (arXiv)
In this paper we present a hybrid method for the automatic detection of dermatological pathologies in medical reports. We use a large language model combined with medical ontologies to predict, given a first appointment or follow-up medical report, the pathology a person may suffer from. The results show that teaching the model to learn the type, severity and location on the body of a dermatological pathology, as well as in which order it has to learn these three features, significantly increases its accuracy. The article presents the demonstration of state-of-the-art results for classification of medical texts with a precision of 0.84, micro and macro F1-score of 0.82 and 0.75, and makes both the method and the data set used available to the community.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 69 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
16 of 69 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2019Neural Machine Translation: A Review and Surveycited by 99
- 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2022BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Samplingcited by 30
- 2024BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicinecited by 30
- 2015Top-k Multiclass SVMcited by 28
- 2021MedGPT: Medical Concept Prediction from Clinical Narrativescited by 24
- 2021Sequential Diagnosis Prediction with Transformer and Ontological Representationcited by 12
4 more
- 2021Where are we in semantic concept extraction for Spoken Language Understanding?cited by 11
- 2021Detecting of a Patient's Condition From Clinical Narratives Using Natural Language Representationcited by 8
- 2014Natural Language Processing in Biomedicine: A Unified System Architecture Overviewcited by 5
- 2020Trade-offs in Top-k Classification Accuracies on Losses for Deep Learningcited by 3
Built on by
Not cited yet.