mlsanityData to 7 Oct 2026

Introducing Vision Transformer for Alzheimer's Disease classification task with 3D input

arXiv 2210.01177 ↗First posted 3 Oct 2022eess.IV cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Many high-performance classification models utilize complex CNN-based architectures for Alzheimer's Disease classification. We aim to investigate two relevant questions regarding classification of Alzheimer's Disease using MRI: "Do Vision Transformer-based models perform better than CNN-based models?" and "Is it possible to use a shallow 3D CNN-based model to obtain satisfying results?" To achieve these goals, we propose two models that can take in and process 3D MRI scans: Convolutional Voxel Vision Transformer (CVVT) architecture, and ConvNet3D-4, a shallow 4-block 3D CNN-based model. Our results indicate that the shallow 3D CNN-based models are sufficient to achieve good classification results for Alzheimer's Disease using MRI scans.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 57 references that are in the map. First posted on arXiv 3 Oct 2022.

Builds on

22 of 57 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  7. 2020End-to-End Object Detection with Transformerscited by 7,384
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  9. 2014Going Deeper with Convolutionscited by 4,231
  10. 2017Non-local Neural Networkscited by 2,290
  11. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  12. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
10 more
  1. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  2. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
  3. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  4. 2017Dynamic Routing Between Capsulescited by 689
  5. 2021ImageNet-21K Pretraining for the Massescited by 607
  6. 2021Vision Transformer for Small-Size Datasetscited by 122
  7. 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 106
  8. 2021Is it Time to Replace CNNs with Transformers for Medical Images?cited by 60
  9. 2017Residual and Plain Convolutional Neural Networks for 3D Brain MRI Classificationcited by 47
  10. 2020Comparing Normalization Methods for Limited Batch Size Segmentation Neural Networkscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.