Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer's Disease
Not on the map. Why?
Abstract (arXiv)
We propose a novel framework for Alzheimer's disease (AD) detection using brain MRIs. The framework starts with a data augmentation method called Brain-Aware Replacements (BAR), which leverages a standard brain parcellation to replace medically-relevant 3D brain regions in an anchor MRI from a randomly picked MRI to create synthetic samples. Ground truth "hard" labels are also linearly mixed depending on the replacement ratio in order to create "soft" labels. BAR produces a great variety of realistic-looking synthetic MRIs with higher local variability compared to other mix-based methods, such as CutMix. On top of BAR, we propose using a soft-label-capable supervised contrastive loss, aiming to learn the relative similarity of representations that reflect how mixed are the synthetic MRIs using our soft labels. This way, we do not fully exhaust the entropic capacity of our hard labels, since we only use them to create soft labels and synthetic MRIs through BAR. We show that a model pre-trained using our framework can be further fine-tuned with a cross-entropy loss using the hard labels that were used to create the synthetic samples. We validated the performance of our framework in a binary AD detection task against both from-scratch supervised training and state-of-the-art self-supervised training plus fine-tuning approaches. Then we evaluated BAR's individual performance compared to another mix-based method CutMix by integrating it within our framework. We show that our framework yields superior results in both precision and recall for the AD detection task.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
19 of 26 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Layer Normalizationcited by 5,579
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Supervised Contrastive Learningcited by 2,803
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
7 more
- 2020Hard Negative Mixing for Contrastive Learningcited by 399
- 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
- 2020MixCo: Mix-up Contrastive Learning for Visual Representationcited by 62
- 2021Contrastive Learning with Continuous Proxy Meta-Data for 3D MRI Classificationcited by 49
- 2021CarveMix: A Simple Data Augmentation Method for Brain Lesion Segmentationcited by 30
- 2019On the design of convolutional neural networks for automatic detection of Alzheimer's diseasecited by 12
- 2019Alzheimer's Disease Brain MRI Classification: Challenges and Insightscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 1; 2026: 1.
6 papers.
- 2023TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performancecited by 10
- 2022TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractographycited by 9
- 2024Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformerscited by 3
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Imagescited by 2
- 2026Higher-Order Domain Generalization in Magnetic Resonance-Based Assessment of Alzheimer's Diseasecited by 1
- 2025scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosiscited by 0
- 2026Higher-Order Domain Generalization in Magnetic Resonance-Based Assessment of Alzheimer's Disease4 Jan 2026
- 2025scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosis4 Feb 2025
- 2024Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformers24 Mar 2024
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Images5 Sep 2023
- 2023TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance8 Jul 2023
- 2022TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography13 Oct 2022