Brain Anatomy Prior Modeling to Forecast Clinical Progression of Cognitive Impairment with Structural MRI
Not on the map. Why?
Abstract (arXiv)
Brain structural MRI has been widely used to assess the future progression of cognitive impairment (CI). Previous learning-based studies usually suffer from the issue of small-sized labeled training data, while there exist a huge amount of structural MRIs in large-scale public databases. Intuitively, brain anatomical structures derived from these public MRIs (even without task-specific label information) can be used to boost CI progression trajectory prediction. However, previous studies seldom take advantage of such brain anatomy prior. To this end, this paper proposes a brain anatomy prior modeling (BAPM) framework to forecast the clinical progression of cognitive impairment with small-sized target MRIs by exploring anatomical brain structures. Specifically, the BAPM consists of a pretext model and a downstream model, with a shared brain anatomy-guided encoder to model brain anatomy prior explicitly. Besides the encoder, the pretext model also contains two decoders for two auxiliary tasks (i.e., MRI reconstruction and brain tissue segmentation), while the downstream model relies on a predictor for classification. The brain anatomy-guided encoder is pre-trained with the pretext model on 9,344 auxiliary MRIs without diagnostic labels for anatomy prior modeling. With this encoder frozen, the downstream model is then fine-tuned on limited target MRIs for prediction. We validate the BAPM on two CI-related studies with T1-weighted MRIs from 448 subjects. Experimental results suggest the effectiveness of BAPM in (1) four CI progression prediction tasks, (2) MR image reconstruction, and (3) brain tissue segmentation, compared with several state-of-the-art methods.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 67 references that are in the map. First posted on arXiv 20 Jun 2023.
Builds on
16 of 67 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
- 2016Unsupervised domain adaptation in brain lesion segmentation with adversarial networkscited by 125
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 78
- 2021Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contextscited by 60
- 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalitiescited by 56
4 more
- 2023Input Augmentation with SAM: Boosting Medical Image Segmentation with Segmentation Foundation Modelcited by 56
- 2020Cross-Cohort Generalizability of Deep and Conventional Machine Learning for MRI-based Diagnosis and Prediction of Alzheimer's Diseasecited by 12
- 2023Imbalanced Domain Generalization for Robust Single Cell Classification in Hematological Cytomorphologycited by 7
- 2022A multi-stream convolutional neural network for classification of progressive MCI in Alzheimer's disease using structural MRI imagescited by 6
Built on by
Citing papers per year: 2025: 2.
2 papers.