mlsanityData to 14 Oct 2026

DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications

arXiv 2307.02094 ↗First posted 5 Jul 2023cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to provide insight into the inference process of deep neural networks. However, most of these explainability methods have been shown to be brittle in the face of adversarial perturbations of their inputs in the image and generic textual domain. In this work we show that this phenomenon extends to specific and important high stakes domains like biomedical datasets. In particular, we observe that the robustness of explanations should be characterized in terms of the accuracy of the explanation in linking a model's inputs and its decisions - faithfulness - and its relevance from the perspective of domain experts - plausibility. This is crucial to prevent explanations that are inaccurate but still look convincing in the context of the domain at hand. To this end, we show how to adapt current attribution robustness estimation methods to a given domain, so as to take into account domain-specific plausibility. This results in our DomainAdaptiveAREstimator (DARE) attribution robustness estimator, allowing us to properly characterize the domain-specific robustness of faithful explanations. Next, we provide two methods, adversarial training and FAR training, to mitigate the brittleness characterized by DARE, allowing us to train networks that display robust attributions. Finally, we empirically validate our methods with extensive experiments on three established biomedical benchmarks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

41 of 52 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  8. 2020Longformer: The Long-Document Transformercited by 3,413
  9. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  10. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  11. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  12. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
29 more
  1. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  2. 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,318
  3. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  4. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  5. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  6. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 599
  7. 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
  8. 2018Universal Sentence Encodercited by 489
  9. 2017Interpretation of Neural Networks is Fragilecited by 444
  10. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
  11. 2019Explanations can be manipulated and geometry is to blamecited by 216
  12. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 211
  13. 2016Counter-fitting Word Vectors to Linguistic Constraintscited by 140
  14. 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 88
  15. 2016Yelp Dataset Challenge: Review Rating Predictioncited by 84
  16. 2020Aligning Faithful Interpretations with their Social Attributioncited by 79
  17. 2021Towards Improving Adversarial Training of NLP Modelscited by 79
  18. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 69
  19. 2019Robust Attribution Regularizationcited by 47
  20. 2018MedSTS: A Resource for Clinical Semantic Textual Similaritycited by 39
  21. 2021Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processingcited by 30
  22. 2020FAR: A General Framework for Attributional Robustnesscited by 13
  23. 2022Fooling Explanations in Text Classifierscited by 13
  24. 2018Respond-CAM: Analyzing Deep Models for 3D Imaging Data by Visualizationscited by 10
  25. 2018Patient Risk Assessment and Warning Symptom Detection Using Deep Attention-Based Neural Networkscited by 7
  26. 2022A Theoretical Framework for AI Models Explainability with Application in Biomedicinecited by 7
  27. 2019Attributional Robustness Training using Input-Gradient Spatial Alignmentcited by 4
  28. 2022Robustness of Explanation Methods for NLP Modelscited by 3
  29. 2022Estimating the Adversarial Robustness of Attributions in Text with Transformerscited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.