mlsanityData to 7 Oct 2026

Automatic detection of diseases in Spanish clinical notes combining medical language models and ontologies

arXiv 2412.03176 ↗First posted 4 Dec 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper we present a hybrid method for the automatic detection of dermatological pathologies in medical reports. We use a large language model combined with medical ontologies to predict, given a first appointment or follow-up medical report, the pathology a person may suffer from. The results show that teaching the model to learn the type, severity and location on the body of a dermatological pathology, as well as in which order it has to learn these three features, significantly increases its accuracy. The article presents the demonstration of state-of-the-art results for classification of medical texts with a precision of 0.84, micro and macro F1-score of 0.82 and 0.75, and makes both the method and the data set used available to the community.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 69 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

16 of 69 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2019Neural Machine Translation: A Review and Surveycited by 99
  6. 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
  7. 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
  8. 2022BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Samplingcited by 30
  9. 2024BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicinecited by 30
  10. 2015Top-k Multiclass SVMcited by 28
  11. 2021MedGPT: Medical Concept Prediction from Clinical Narrativescited by 24
  12. 2021Sequential Diagnosis Prediction with Transformer and Ontological Representationcited by 12
4 more
  1. 2021Where are we in semantic concept extraction for Spoken Language Understanding?cited by 11
  2. 2021Detecting of a Patient's Condition From Clinical Narratives Using Natural Language Representationcited by 8
  3. 2014Natural Language Processing in Biomedicine: A Unified System Architecture Overviewcited by 5
  4. 2020Trade-offs in Top-k Classification Accuracies on Losses for Deep Learningcited by 3

Built on by

Not cited yet.