An Unsupervised Approach to Achieve Supervised-Level Explainability in Healthcare Records
Not on the map. Why?
Abstract (arXiv)
Electronic healthcare records are vital for patient safety as they document conditions, plans, and procedures in both free text and medical codes. Language models have significantly enhanced the processing of such records, streamlining workflows and reducing manual data entry, thereby saving healthcare providers significant resources. However, the black-box nature of these models often leaves healthcare professionals hesitant to trust them. State-of-the-art explainability methods increase model transparency but rely on human-annotated evidence spans, which are costly. In this study, we propose an approach to produce plausible and faithful explanations without needing such annotations. We demonstrate on the automated medical coding task that adversarial robustness training improves explanation plausibility and introduce AttInGrad, a new explanation method superior to previous ones. By combining both contributions in a fully unsupervised setup, we produce explanations of comparable quality, or better, to that of a supervised approach. We release our code and model weights.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 30 of its 60 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
30 of 60 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
- 2019Attention is not Explanationcited by 929
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 599
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
- 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
18 more
- 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 130
- 2019On the Connection Between Adversarial Robustness and Saliency Map Interpretabilitycited by 80
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Incorporating Residual and Normalization Layers into Analysis of Masked Language Modelscited by 51
- 2023Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Studycited by 49
- 2022GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformerscited by 44
- 2020A case for new neural network smoothness constraintscited by 43
- 2018Multimodal Machine Learning for Automated ICD Codingcited by 41
- 2020Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisationcited by 38
- 2023DecompX: Explaining Transformers Decisions by Propagating Token Decompositioncited by 31
- 2023MDACE: MIMIC Documents Annotated with Code Evidencecited by 19
- 2021Description-based Label Attention Classifier for Explainable ICD-9 Classificationcited by 12
- 2023Ignorance is Bliss: Robust Control via Information Gatingcited by 10
- 2023Discriminative Feature Attributions: Bridging Post Hoc Explainability and Inherent Interpretabilitycited by 10
- 2022Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?cited by 7
- 2023Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Trainingcited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 4.
12 papers.
- 2025A General Knowledge Injection Framework for ICD Codingcited by 7
- 2025The Anatomy of Evidence: An Investigation Into Explainable ICD Codingcited by 3
- 2025MedDCR: Learning to Design Agentic Workflows for Medical Codingcited by 3
- 2024Similarity-Dissimilarity Loss for Multi-label Supervised Contrastive Learningcited by 2
- 2025Explainable ICD Coding via Entity Linkingcited by 1
- 2025Evaluation and LLM-Guided Learning of ICD Coding Rationalescited by 1
- 2025Complete Evidence Extraction with Model Ensembles: A Case Study on Medical Codingcited by 1
- 2026A medical coding language model trained on clinical narratives from a population-wide cohort of 1.8 million patientscited by 1
- 2026Symphony for Medical Coding: A Next-Generation Agentic System for Scalable and Explainable Medical Codingcited by 1
- 2024Don't Pay Attention, PLANT It: Pretraining Attention via Learning-to-Rankcited by 0
- 2026From Documents to Spans: Span-Centric Learning for LLM-based Explainable Medical Codingcited by 0
- 2026Bridging the Version Gap: Multi-version Training Improves ICD Code Prediction, Especially for Rare Codescited by 0
- 2026Bridging the Version Gap: Multi-version Training Improves ICD Code Prediction, Especially for Rare Codes18 May 2026
- 2026Symphony for Medical Coding: A Next-Generation Agentic System for Scalable and Explainable Medical Coding31 Mar 2026
- 2026From Documents to Spans: Span-Centric Learning for LLM-based Explainable Medical Coding16 Mar 2026
- 2026A medical coding language model trained on clinical narratives from a population-wide cohort of 1.8 million patients27 Feb 2026
- 2025MedDCR: Learning to Design Agentic Workflows for Medical Coding17 Nov 2025
- 2025Complete Evidence Extraction with Model Ensembles: A Case Study on Medical Coding10 Nov 2025
- 2025Evaluation and LLM-Guided Learning of ICD Coding Rationales22 Aug 2025
- 2025The Anatomy of Evidence: An Investigation Into Explainable ICD Coding2 Jul 2025
- 2025A General Knowledge Injection Framework for ICD Coding24 May 2025
- 2025Explainable ICD Coding via Entity Linking26 Mar 2025
- 2024Don't Pay Attention, PLANT It: Pretraining Attention via Learning-to-Rank30 Oct 2024
- 2024Similarity-Dissimilarity Loss for Multi-label Supervised Contrastive Learning17 Oct 2024