An explainable three dimension framework to uncover learning patterns: A unified look in variable sulci recognition
Not on the map. Why?
Abstract (arXiv)
The significant features identified in a representative subset of the dataset during the learning process of an artificial intelligence model are referred to as a 'global' explanation. 3D global explanations are crucial in neuroimaging, where a complex representational space demands more than basic 2D interpretations. However, current studies in the literature often lack the accuracy, comprehensibility, and 3D global explanations needed in neuroimaging and beyond. To address this gap, we developed an explainable artificial intelligence (XAI) 3D-Framework capable of providing accurate, low-complexity global explanations. We evaluated the framework using various 3D deep learning models trained on a well-annotated cohort of 596 structural MRIs. The binary classification task focused on detecting the presence or absence of the paracingulate sulcus, a highly variable brain structure associated with psychosis. Our framework integrates statistical features (Shape) and XAI methods (GradCam and SHAP) with dimensionality reduction, ensuring that explanations reflect both model learning and cohort-specific variability. By combining Shape, GradCam, and SHAP, our framework reduces inter-method variability, enhancing the faithfulness and reliability of global explanations. These robust explanations facilitated the identification of critical sub-regions, including the posterior temporal and internal parietal regions, as well as the cingulate region and thalamus, suggesting potential genetic or developmental influences. Our XAI 3D-Framework leverages global explanations to uncover the broader developmental context of specific cortical features. This approach advances the fields of deep learning and neuroscience by offering insights into normative brain development and atypical trajectories linked to mental illness, paving the way for more reliable and interpretable AI applications in neuroimaging.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 81 references that are in the map. First posted on arXiv 2 Sep 2023.
Builds on
14 of 81 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 310
- 2020Evaluating and Aggregating Feature-based Model Explanationscited by 188
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2020Explainable deep learning models in medical image analysiscited by 111
Built on by
Citing papers per year: 2024: 1.
1 paper.