Multimodal Attention-Aware Fusion for Diagnosing Distal Myopathy: Evaluating Model Interpretability and Clinician Trust
Not on the map. Why?
Abstract (arXiv)
Distal myopathy represents a genetically heterogeneous group of skeletal muscle disorders with broad clinical manifestations, posing diagnostic challenges in radiology. To address this, we propose a novel multimodal attention-aware fusion architecture that combines features extracted from two distinct deep learning models, one capturing global contextual information and the other focusing on local details, representing complementary aspects of the input data. Uniquely, our approach integrates these features through an attention gate mechanism, enhancing both predictive performance and interpretability. Our method achieves a high classification accuracy on the BUSI benchmark and a proprietary distal myopathy dataset, while also generating clinically relevant saliency maps that support transparent decision-making in medical diagnosis. We rigorously evaluated interpretability through (1) functionally grounded metrics, coherence scoring against reference masks and incremental deletion analysis, and (2) application-grounded validation with seven expert radiologists. While our fusion strategy boosts predictive performance relative to single-stream and alternative fusion strategies, both quantitative and qualitative evaluations reveal persistent gaps in anatomical specificity and clinical usefulness of the interpretability. These findings highlight the need for richer, context-aware interpretability methods and human-in-the-loop feedback to meet clinicians' expectations in real-world diagnostic settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
30 of 58 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 272
18 more
- 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 126
- 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 57
- 2019How model accuracy and explanation fidelity influence user trustcited by 45
- 2024Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretationscited by 33
- 2022Global Concept-Based Interpretability for Graph Neural Networks via Neuron Analysiscited by 32
- 2023HEALNet: Multimodal Fusion for Heterogeneous Biomedical Datacited by 25
- 2022RadFormer: Transformers with Global-Local Attention for Interpretable and Accurate Gallbladder Cancer Detectioncited by 12
- 2025Prompt-CAM: Making Vision Transformers Interpretable for Fine-Grained Analysiscited by 12
- 2023Why is plausibility surprisingly problematic as an XAI criterion?cited by 9
- 2020Interpretable multimodal fusion networks reveal mechanisms of brain cognitioncited by 6
- 2025Class-Dependent Perturbation Effects in Evaluating Time Series Attributionscited by 5
- 2023Learning Transferable Conceptual Prototypes for Interpretable Unsupervised Domain Adaptationcited by 4
- 2025Information Bottleneck-Guided Heterogeneous Graph Learning for Interpretable Neurodevelopmental Disorder Diagnosiscited by 2
- 2023Measuring Perceived Trust in XAI-Assisted Decision-Making by Eliciting a Mental Modelcited by 1
Built on by
Not cited yet.