mlsanityData to 7 Oct 2026

Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer's Disease

arXiv 2207.04574 ↗First posted 11 Jul 2022cs.CV cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

We propose a novel framework for Alzheimer's disease (AD) detection using brain MRIs. The framework starts with a data augmentation method called Brain-Aware Replacements (BAR), which leverages a standard brain parcellation to replace medically-relevant 3D brain regions in an anchor MRI from a randomly picked MRI to create synthetic samples. Ground truth "hard" labels are also linearly mixed depending on the replacement ratio in order to create "soft" labels. BAR produces a great variety of realistic-looking synthetic MRIs with higher local variability compared to other mix-based methods, such as CutMix. On top of BAR, we propose using a soft-label-capable supervised contrastive loss, aiming to learn the relative similarity of representations that reflect how mixed are the synthetic MRIs using our soft labels. This way, we do not fully exhaust the entropic capacity of our hard labels, since we only use them to create soft labels and synthetic MRIs through BAR. We show that a model pre-trained using our framework can be further fine-tuned with a cross-entropy loss using the hard labels that were used to create the synthetic samples. We validated the performance of our framework in a binary AD detection task against both from-scratch supervised training and state-of-the-art self-supervised training plus fine-tuning approaches. Then we evaluated BAR's individual performance compared to another mix-based method CutMix by integrating it within our framework. We show that our framework yields superior results in both precision and recall for the AD detection task.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 11 Jul 2022.

Builds on

19 of 26 references.

References · 19

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2016Layer Normalizationcited by 5,579
  8. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  9. 2020Supervised Contrastive Learningcited by 2,803
  10. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  11. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  12. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
7 more
  1. 2020Hard Negative Mixing for Contrastive Learningcited by 399
  2. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  3. 2020MixCo: Mix-up Contrastive Learning for Visual Representationcited by 62
  4. 2021Contrastive Learning with Continuous Proxy Meta-Data for 3D MRI Classificationcited by 49
  5. 2021CarveMix: A Simple Data Augmentation Method for Brain Lesion Segmentationcited by 30
  6. 2019On the design of convolutional neural networks for automatic detection of Alzheimer's diseasecited by 12
  7. 2019Alzheimer's Disease Brain MRI Classification: Challenges and Insightscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 1; 2026: 1.

6 papers.