mlsanityData to 7 Oct 2026

Multitask Balanced and Recalibrated Network for Medical Code Prediction

arXiv 2109.02418 ↗First posted 6 Sep 2021cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Human coders assign standardized medical codes to clinical documents generated during patients' hospitalization, which is error-prone and labor-intensive. Automated medical coding approaches have been developed using machine learning methods such as deep neural networks. Nevertheless, automated medical coding is still challenging because of the imbalanced class problem, complex code association, and noise in lengthy documents. To solve these issues, we propose a novel neural network called Multitask Balanced and Recalibrated Neural Network. Significantly, the multitask learning scheme shares the relationship knowledge between different code branches to capture the code association. A recalibrated aggregation module is developed by cascading convolutional blocks to extract high-level semantic features that mitigate the impact of noise in documents. Also, the cascaded structure of the recalibrated module can benefit the learning from lengthy notes. To solve the class imbalanced problem, we deploy the focal loss to redistribute the attention of low and high-frequency medical codes. Experimental results show that our proposed model outperforms competitive baselines on a real-world clinical dataset MIMIC-III.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 6 Sep 2021.

Builds on

22 of 50 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Squeeze-and-Excitation Networkscited by 4,763
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2020Reformer: The Efficient Transformercited by 1,658
  7. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  8. 2014How transferable are features in deep neural networks?cited by 1,216
  9. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  10. 2017A Survey on Multi-Task Learningcited by 838
  11. 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
  12. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
10 more
  1. 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
  2. 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
  3. 2019ICD Coding from Clinical Text Using Multi-Filter Residual Convolutional Neural Networkcited by 73
  4. 2021Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Studycited by 39
  5. 2020Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisationcited by 38
  6. 2020Inferring Degrees from Incomplete Networks and Nonlinear Dynamicscited by 33
  7. 2020Dilated Convolutional Attention Network for Medical Code Assignment from Clinical Textcited by 21
  8. 2018A Neural Multi-Task Learning Framework to Jointly Model Medical Named Entity Recognition and Normalizationcited by 20
  9. 2020Medical Code Assignment with Gated Convolution and Note-Code Interactioncited by 9
  10. 2021Multitask Recalibrated Aggregation Network for Medical Code Predictioncited by 5

Built on by

Cited by year

Citing papers per year: 2022: 7; 2023: 2.

9 papers.