mlsanityData to 7 Oct 2026

an interpretable vision transformer framework for automated brain tumor classification

arXiv 2604.21311 ↗First posted 23 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain tumors represent one of the most critical neurological conditions, where early and accurate diagnosis is directly correlated with patient survival rates. Manual interpretation of Magnetic Resonance Imaging (MRI) scans is time-intensive, subject to inter-observer variability, and demands significant specialist expertise. This paper proposes a deep learning framework for automated four-class brain tumor classification distinguishing glioma, meningioma, pituitary tumor, and healthy brain tissue from a dataset of 7,023 MRI scans. The proposed system employs a Vision Transformer (ViT-B/16) pretrained on ImageNet-21k as the backbone, augmented with a clinically motivated preprocessing and training pipeline. Contrast Limited Adaptive Histogram Equalization (CLAHE) is applied to enhance local contrast and accentuate tumor boundaries invisible to standard normalization. A two-stage fine-tuning strategy is adopted: the classification head is warmed up with the backbone frozen, followed by full fine-tuning with discriminative learning rates. MixUp and CutMix augmentation is applied per batch to improve generalization. Exponential Moving Average (EMA) of weights and Test-Time Augmentation (TTA) further stabilize and boost performance. Attention Rollout visualization provides clinically interpretable heatmaps of the brain regions driving each prediction. The proposed model achieves a test accuracy of 99.29%, macro F1-score of 99.25%, and perfect recall on both healthy and meningioma classes, outperforming all CNN-based baselines

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

17 of 30 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  8. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  9. 2017Non-local Neural Networkscited by 2,290
  10. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  11. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  12. 2020Quantifying Attention Flow in Transformerscited by 759
5 more
  1. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  2. 2022Transformers in Medical Imaging: A Surveycited by 245
  3. 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 85
  4. 2025CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasetscited by 4
  5. 2025An Explorative Analysis of SVM Classifier and ResNet50 Architecture on African Food Classificationcited by 3

Built on by

Not cited yet.