Multitask Balanced and Recalibrated Network for Medical Code Prediction
Not on the map. Why?
Abstract (arXiv)
Human coders assign standardized medical codes to clinical documents generated during patients' hospitalization, which is error-prone and labor-intensive. Automated medical coding approaches have been developed using machine learning methods such as deep neural networks. Nevertheless, automated medical coding is still challenging because of the imbalanced class problem, complex code association, and noise in lengthy documents. To solve these issues, we propose a novel neural network called Multitask Balanced and Recalibrated Neural Network. Significantly, the multitask learning scheme shares the relationship knowledge between different code branches to capture the code association. A recalibrated aggregation module is developed by cascading convolutional blocks to extract high-level semantic features that mitigate the impact of noise in documents. Also, the cascaded structure of the recalibrated module can benefit the learning from lengthy notes. To solve the class imbalanced problem, we deploy the focal loss to redistribute the attention of low and high-frequency medical codes. Experimental results show that our proposed model outperforms competitive baselines on a real-world clinical dataset MIMIC-III.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 6 Sep 2021.
Builds on
22 of 50 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Reformer: The Efficient Transformercited by 1,658
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2017A Survey on Multi-Task Learningcited by 838
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
- 2021FNet: Mixing Tokens with Fourier Transformscited by 343
10 more
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
- 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
- 2019ICD Coding from Clinical Text Using Multi-Filter Residual Convolutional Neural Networkcited by 73
- 2021Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Studycited by 39
- 2020Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisationcited by 38
- 2020Inferring Degrees from Incomplete Networks and Nonlinear Dynamicscited by 33
- 2020Dilated Convolutional Attention Network for Medical Code Assignment from Clinical Textcited by 21
- 2018A Neural Multi-Task Learning Framework to Jointly Model Medical Named Entity Recognition and Normalizationcited by 20
- 2020Medical Code Assignment with Gated Convolution and Note-Code Interactioncited by 9
- 2021Multitask Recalibrated Aggregation Network for Medical Code Predictioncited by 5
Built on by
Citing papers per year: 2022: 7; 2023: 2.
9 papers.
- 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Codingcited by 40
- 2022Automated Clinical Coding: What, Why, and Where We Are?cited by 33
- 2022A Unified Review of Deep Learning for Automated Medical Codingcited by 26
- 2022Multi-label Few-shot ICD Coding as Autoregressive Generation with Promptcited by 16
- 2022Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?cited by 7
- 2022An Automatic ICD Coding Network Using Partition-Based Label Attentioncited by 2
- 2022Medical Codes Prediction from Clinical Notes: From Human Coders to Machinescited by 1
- 2023Content Reduction, Surprisal and Information Density Estimation for Long Documentscited by 1
- 2023MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Codingcited by 1
- 2023MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding16 Sep 2023
- 2023Content Reduction, Surprisal and Information Density Estimation for Long Documents12 Sep 2023
- 2022Multi-label Few-shot ICD Coding as Autoregressive Generation with Prompt24 Nov 2022
- 2022An Automatic ICD Coding Network Using Partition-Based Label Attention15 Nov 2022
- 2022Medical Codes Prediction from Clinical Notes: From Human Coders to Machines30 Oct 2022
- 2022Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?28 Oct 2022
- 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding7 Oct 2022
- 2022Automated Clinical Coding: What, Why, and Where We Are?21 Mar 2022
- 2022A Unified Review of Deep Learning for Automated Medical Coding8 Jan 2022