ICAM-reg: Interpretable Classification and Regression with Feature Attribution for Mapping Neurological Phenotypes in Individual Scans
Not on the map. Why?
Abstract (arXiv)
An important goal of medical imaging is to be able to precisely detect patterns of disease specific to individual scans; however, this is challenged in brain imaging by the degree of heterogeneity of shape and appearance. Traditional methods, based on image registration to a global template, historically fail to detect variable features of disease, as they utilise population-based analyses, suited primarily to studying group-average effects. In this paper we therefore take advantage of recent developments in generative deep learning to develop a method for simultaneous classification, or regression, and feature attribution (FA). Specifically, we explore the use of a VAE-GAN translation network called ICAM, to explicitly disentangle class relevant features from background confounds for improved interpretability and regression of neurological phenotypes. We validate our method on the tasks of Mini-Mental State Examination (MMSE) cognitive test score prediction for the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort, as well as brain age prediction, for both neurodevelopment and neurodegeneration, using the developing Human Connectome Project (dHCP) and UK Biobank datasets. We show that the generated FA maps can be used to explain outlier predictions and demonstrate that the inclusion of a regression module improves the disentanglement of the latent space. Our code is freely available on Github https://github.com/CherBass/ICAM.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 30 of its 86 references that are in the map. First posted on arXiv 3 Mar 2021.
Builds on
30 of 86 references.
References · 30
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Layer Normalizationcited by 5,579
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
18 more
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2020No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problemscited by 208
- 2018Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Imagescited by 146
- 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 106
- 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 64
- 2017Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentationcited by 58
- 2018Disentangling Factors of Variation with Cycle-Consistent Variational Auto-Encoderscited by 49
- 2017Visual Feature Attribution using Wasserstein GANscited by 47
- 2021Using StyleGAN for Visual Interpretability of Deep Learning Models on Medical Imagescited by 35
- 2019Testing the robustness of attribution methods for convolutional neural networks in MRI-based Alzheimer's disease classificationcited by 25
- 2019Uncovering convolutional neural network decisions for diagnosing multiple sclerosis on conventional MRI using layer-wise relevance propagationcited by 21
- 2020ICAM: Interpretable Classification via Disentangled Representations and Feature Attribution Mappingcited by 20
- 2020Domain aware medical image classifier interpretation by counterfactual impact analysiscited by 17
- 2019A model of brain morphological changes related to aging and Alzheimer's disease from cross-sectional assessmentscited by 12
- 2015Deep Neural Networks for Anatomical Brain Segmentationcited by 11
- 2020Scientific Discovery by Generating Counterfactuals using Image Translationcited by 11
- 2018NeuroNet: Fast and Robust Reproduction of Multiple Brain Image Segmentation Pipelinescited by 2
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 4; 2024: 6; 2025: 3; 2026: 1.
18 papers.
Sort:
By area:
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesiscited by 8
- 2024Disentangling representations of retinal images with generative modelscited by 8
- 2024Accurate Explanation Model for Image Classifiers using Class Association Embeddingcited by 6
- 2024A Weakly Supervised and Globally Explainable Learning Framework for Brain Tumor Segmentationcited by 6
- 2021Voxel-level Importance Maps for Interpretable Brain Age Estimationcited by 5
- 2022Towards better Interpretable and Generalizable AD detection using Collective Artificial Intelligencecited by 5
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive reviewcited by 3
- 2024SurfGNN: A robust surface-based prediction model with interpretability for coactivation maps of spatial and cortical featurescited by 3
- 2023Looking deeper into interpretable deep learning in neuroimaging: a comprehensive surveycited by 2
- 2025Enhancing Interpretability for Vision Models via Shapley Value Optimizationcited by 2
- 2022A Deep Generative Model of Neonatal Cortical Surface Developmentcited by 1
6 more
- 2023NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infantscited by 1
- 2024Cortical Surface Diffusion Generative Modelscited by 1
- 2023Prototype Learning for Explainable Brain Age Predictioncited by 0
- 2025Controllable Surface Diffusion Generative Model for Neurodevelopmental Trajectoriescited by 0
- 2025MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Spacecited by 0
- 2026Longitudinal Bayesian Learning of Continuous Disease Position across the Alzheimer's Disease Continuumcited by 0
- 2026Longitudinal Bayesian Learning of Continuous Disease Position across the Alzheimer's Disease Continuum19 Aug 2026
- 2025Enhancing Interpretability for Vision Models via Shapley Value Optimization16 Dec 2025
- 2025MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Space26 Aug 2025
- 2025Controllable Surface Diffusion Generative Model for Neurodevelopmental Trajectories21 Jul 2025
- 2024SurfGNN: A robust surface-based prediction model with interpretability for coactivation maps of spatial and cortical features5 Nov 2024
- 2024A Weakly Supervised and Globally Explainable Learning Framework for Brain Tumor Segmentation2 Aug 2024
- 2024Accurate Explanation Model for Image Classifiers using Class Association Embedding12 Jun 2024
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive review30 May 2024
- 2024Disentangling representations of retinal images with generative models29 Feb 2024
- 2024Cortical Surface Diffusion Generative Models7 Feb 2024
- 2023Looking deeper into interpretable deep learning in neuroimaging: a comprehensive survey14 Jul 2023
- 2023Prototype Learning for Explainable Brain Age Prediction16 Jun 2023
6 more
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesis9 Jan 2023
- 2023NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants1 Jan 2023
- 2022A Deep Generative Model of Neonatal Cortical Surface Development15 Jun 2022
- 2022Towards better Interpretable and Generalizable AD detection using Collective Artificial Intelligence7 Jun 2022
- 2021Learning Disentangled Representations in the Imaging Domain26 Aug 2021
- 2021Voxel-level Importance Maps for Interpretable Brain Age Estimation11 Aug 2021
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesiscited by 8
- 2024Disentangling representations of retinal images with generative modelscited by 8
- 2024Accurate Explanation Model for Image Classifiers using Class Association Embeddingcited by 6
- 2024A Weakly Supervised and Globally Explainable Learning Framework for Brain Tumor Segmentationcited by 6
- 2021Voxel-level Importance Maps for Interpretable Brain Age Estimationcited by 5
- 2022Towards better Interpretable and Generalizable AD detection using Collective Artificial Intelligencecited by 5
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive reviewcited by 3
- 2024SurfGNN: A robust surface-based prediction model with interpretability for coactivation maps of spatial and cortical featurescited by 3
- 2023Looking deeper into interpretable deep learning in neuroimaging: a comprehensive surveycited by 2
- 2025Enhancing Interpretability for Vision Models via Shapley Value Optimizationcited by 2
- 2022A Deep Generative Model of Neonatal Cortical Surface Developmentcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Longitudinal Bayesian Learning of Continuous Disease Position across the Alzheimer's Disease Continuum19 Aug 2026
- 2025Enhancing Interpretability for Vision Models via Shapley Value Optimization16 Dec 2025
- 2025MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Space26 Aug 2025
- 2024SurfGNN: A robust surface-based prediction model with interpretability for coactivation maps of spatial and cortical features5 Nov 2024
- 2024A Weakly Supervised and Globally Explainable Learning Framework for Brain Tumor Segmentation2 Aug 2024
- 2024Accurate Explanation Model for Image Classifiers using Class Association Embedding12 Jun 2024
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive review30 May 2024
- 2024Disentangling representations of retinal images with generative models29 Feb 2024
- 2023Looking deeper into interpretable deep learning in neuroimaging: a comprehensive survey14 Jul 2023
- 2023Prototype Learning for Explainable Brain Age Prediction16 Jun 2023
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesis9 Jan 2023
- 2023NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants1 Jan 2023
12 newest of 16 All 16 (JSON)