mlsanityData to 14 Oct 2026

Automated ICD Classification of Psychiatric Diagnoses: From Classical NLP to Large Language Models

arXiv 2605.21154 ↗First posted 20 May 2026cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Mental health has become a global priority, leading to a massive administrative burden in the coding of clinical diagnoses. This study proposes the automation of psychiatric diagnostic analysis by mapping free-text descriptions to the International Classification of Diseases (ICD) using Natural Language Processing (NLP) and Machine Learning (ML) techniques. Utilizing a specialized dataset of 145,513 Spanish psychiatric descriptions, various text representation paradigms were evaluated, ranging from classical frequency-based models (BoW, TF-IDF) to state-of-the-art Large Language Models (LLMs) such as e5large, BioLORD, and Llama-3-8B. Results indicate that transformer-based embeddings consistently outperform traditional methods by capturing implicit semantic cues and nuanced medical terminology. The e5large model, through end-to-end fine-tuning, achieved the highest performance with a F1micro score of 0.866. This research demonstrates that adapting LLMs to specific clinical nomenclature is essential for overcoming the challenges of ``long-tail'' label distributions and the inherent ambiguity of psychiatric discourse.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

17 of 31 references.

References · 17

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  5. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  7. 2014Distributed Representations of Sentences and Documentscited by 678
  8. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  9. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
  10. 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
  11. 2021Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classificationcited by 67
  12. 2022PLM-ICD: Automatic ICD Coding with Pretrained Language Modelscited by 49
5 more
  1. 2020A Label Attention Model for ICD Coding from Clinical Textcited by 48
  2. 2022Multi-label Few-shot ICD Coding as Autoregressive Generation with Promptcited by 17
  3. 2021Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenariocited by 11
  4. 2023Surpassing GPT-4 Medical Coding with a Two-Stage Approachcited by 6
  5. 2022Automated ICD Coding using Extreme Multi-label Long Text Transformer-based Modelscited by 5

Built on by

Not cited yet.