mlsanityData to 7 Oct 2026

Semi-self-supervised Automated ICD Coding

arXiv 2205.10088 ↗First posted 20 May 2022cs.CL cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical Text Notes (CTNs) contain physicians' reasoning process, written in an unstructured free text format, as they examine and interview patients. In recent years, several studies have been published that provide evidence for the utility of machine learning for predicting doctors' diagnoses from CTNs, a task known as ICD coding. Data annotation is time consuming, particularly when a degree of specialization is needed, as is the case for medical data. This paper presents a method of augmenting a sparsely annotated dataset of Icelandic CTNs with a machine-learned imputation in a semi-self-supervised manner. We train a neural network on a small set of annotated CTNs and use it to extract clinical features from a set of un-annotated CTNs. These clinical features consist of answers to about a thousand potential questions that a physician might find the answers to during a consultation of a patient. The features are then used to train a classifier for the diagnosis of certain types of diseases. We report the results of an evaluation of this data augmentation method over three tiers of data availability to the physician. Our data augmentation method shows a significant positive effect which is diminished when clinical features from the examination of the patient and diagnostics are made available. We recommend our method for augmenting scarce datasets for systems that take decisions based on clinical features that do not include examinations or tests.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 20 May 2022.

Builds on

10 of 26 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2020BERT-XML: Large Scale Automated ICD Coding Using BERT Pretrainingcited by 37
  6. 2021Towards BERT-based Automatic ICD Coding: Limitations and Opportunitiescited by 25
  7. 2020A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networkscited by 18
  8. 2022A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Modelscited by 13
  9. 2021A Systematic Literature Review of Automated ICD Coding and Classification Systems using Discharge Summariescited by 10
  10. 2019Measuring the Data Efficiency of Deep Learning Methodscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluating Hierarchical Clinical Document Classification Using Reasoning-Based LLMs
  2. 2026KREL: Automatic Medical Coding via Knowledge-Guided Reasoning over Clinical Evidence with LLMs
  3. 2026Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Coding
  4. 2026Training a Large Language Model for Medical Coding Using Privacy-Preserving Synthetic Clinical Data
  5. 2026ASCRIBE: Atomic and Significance-Based Reasoning for Thai Clinical SOAP Note Generation
  6. 2025Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLP
  7. 2024DiReCT: Diagnostic Reasoning for Clinical Notes via Large Language Models
  8. 2025Leaps Beyond the Seen: Reinforced Reasoning Augmented Generation for Clinical Notes