mlsanityData to 14 Oct 2026

Deep multimodal saliency parcellation of cerebellar pathways: linking microstructure and individual function through explainable multitask learning

arXiv 2407.15132 ↗First posted 21 Jul 2024q-bio.NC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Parcellation of human cerebellar pathways is essential for advancing our understanding of the human brain. Existing diffusion MRI tractography parcellation methods have been successful in defining major cerebellar fibre tracts, while relying solely on fibre tract structure. However, each fibre tract may relay information related to multiple cognitive and motor functions of the cerebellum. Hence, it may be beneficial for parcellation to consider the potential importance of the fibre tracts for individual motor and cognitive functional performance measures. In this work, we propose a multimodal data-driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. Our method involves first training a multitask deep network to predict various cognitive and motor measures from a set of fibre tract structural features. The importance of each structural feature for predicting each functional measure is then computed, resulting in a set of structure-function saliency values that are clustered to parcellate cerebellar pathways. We refer to our method as Deep Multimodal Saliency Parcellation (DeepMSP), as it computes the saliency of structural measures for predicting cognitive and motor functional performance, with these saliencies being applied to the task of parcellation. Applying DeepMSP we found that it was feasible to identify multiple cerebellar pathway parcels with unique structure-function saliency patterns that were stable across training folds.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 131 references that are in the map. First posted on arXiv 21 Jul 2024.

Builds on

23 of 131 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  6. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  7. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  8. 2018Sanity Checks for Saliency Mapscited by 1,156
  9. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  10. 2020On Layer Normalization in the Transformer Architecturecited by 922
  11. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  12. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
11 more
  1. 2021A Survey of Transformerscited by 401
  2. 2017The (Un)reliability of saliency methodscited by 333
  3. 2022Transformers in Medical Imaging: A Surveycited by 245
  4. 2020On Interpretability of Artificial Neural Networks: A Surveycited by 88
  5. 2021Is it Time to Replace CNNs with Transformers for Medical Images?cited by 60
  6. 2022Model and predict age and sex in healthy subjects using brain white matter features: A deep learning approachcited by 17
  7. 2022Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellationcited by 14
  8. 2021An explainable Transformer-based deep learning model for the prediction of incident heart failurecited by 12
  9. 2021Sequential Diagnosis Prediction with Transformer and Ontological Representationcited by 12
  10. 2023TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performancecited by 11
  11. 2019High-fidelity, accelerated whole-brain submillimeter in-vivo diffusion MRI using gSlider-Spherical Ridgelets (gSlider-SR)cited by 5

Built on by

Not cited yet.