HistoViT: Vision Transformer for Accurate and Scalable Histopathological Cancer Diagnosis
Not on the map. Why?
Abstract (arXiv)
Accurate and scalable cancer diagnosis remains a critical challenge in modern pathology, particularly for malignancies such as breast, prostate, bone, and cervical, which exhibit complex histological variability. In this study, we propose a transformer-based deep learning framework for multi-class tumor classification in histopathological images. Leveraging a fine-tuned Vision Transformer (ViT) architecture, our method addresses key limitations of conventional convolutional neural networks, offering improved performance, reduced preprocessing requirements, and enhanced scalability across tissue types. To adapt the model for histopathological cancer images, we implement a streamlined preprocessing pipeline that converts tiled whole-slide images into PyTorch tensors and standardizes them through data normalization. This ensures compatibility with the ViT architecture and enhances both convergence stability and overall classification performance. We evaluate our model on four benchmark datasets: ICIAR2018 (breast), SICAPv2 (prostate), UT-Osteosarcoma (bone), and SipakMed (cervical) dataset -- demonstrating consistent outperformance over existing deep learning methods. Our approach achieves classification accuracies of 99.32%, 96.92%, 95.28%, and 96.94% for breast, prostate, bone, and cervical cancers respectively, with area under the ROC curve (AUC) scores exceeding 99% across all datasets. These results confirm the robustness, generalizability, and clinical potential of transformer-based architectures in digital pathology. Our work represents a significant advancement toward reliable, automated, and interpretable cancer diagnosis systems that can alleviate diagnostic burdens and improve healthcare outcomes.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 14 of its 42 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
14 of 42 references.
References · 14
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2017Deep Learning for Medical Image Analysiscited by 401
- 2018BACH: Grand Challenge on Breast Cancer Histology Imagescited by 131
- 2017Machine learning methods for histopathological image analysiscited by 79
- 2021Going Deeper through the Gleason Scoring Scale: An Automatic end-to-end System for Histology Prostate Grading and Cribriform Pattern Detectioncited by 68
- 2025Topological Signatures vs. Gradient Histograms: A Comparative Study for Medical Image Classificationcited by 10
- 2025HOG-CNN: Integrating Histogram of Oriented Gradients with Convolutional Neural Networks for Retinal Image Classificationcited by 10
- 2025Transfer Learning with EfficientNet for Accurate Leukemia Cell Classificationcited by 8
- 2020A Deep Learning Study on Osteosarcoma Detection from Histological Imagescited by 7
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025RepViT-CXR: A Channel Replication Strategy for Vision Transformers in Chest X-ray Tuberculosis and Pneumonia Classificationcited by 7
- 2025Efficient Breast and Ovarian Cancer Classification via ViT-Based Preprocessing and Transfer Learningcited by 6
- 2025Colormap-Enhanced Vision Transformers for MRI-Based Multiclass (4-Class) Alzheimer's Disease Classificationcited by 6
- 2026Four-Stage Alzheimer's Disease Classification from MRI Using Topological Feature Extraction, Feature Selection, and Ensemble Learningcited by 5
- 2026Hybrid Topological and Deep Feature Fusion for Accurate MRI-Based Alzheimer's Disease Severity Classificationcited by 4
- 2026Brain Tumor Classification from 3D MRI Using Persistent Homology and Betti Features: A Topological Data Analysis Approach on BraTS2020cited by 2
- 2026Enhancing Brain Tumor Classification Using Vision Transformers with Colormap-Based Feature Representation on BRISC2025 Datasetcited by 0
- 2026Bridging Topology and Deep Representation Learning: A TDA-ViT Fusion Model for Four-Class Brain Tumor Classificationcited by 0
- 2026FedHisto-PAST: Parameter-Efficient Stain-Aware Federated Learning for Cross-Site Lung Histopathology Classificationcited by 0
- 2026FedHisto-PAST: Parameter-Efficient Stain-Aware Federated Learning for Cross-Site Lung Histopathology Classification25 Sep 2026
- 2026Bridging Topology and Deep Representation Learning: A TDA-ViT Fusion Model for Four-Class Brain Tumor Classification30 May 2026
- 2026Enhancing Brain Tumor Classification Using Vision Transformers with Colormap-Based Feature Representation on BRISC2025 Dataset22 Mar 2026
- 2026Brain Tumor Classification from 3D MRI Using Persistent Homology and Betti Features: A Topological Data Analysis Approach on BraTS202014 Mar 2026
- 2026Hybrid Topological and Deep Feature Fusion for Accurate MRI-Based Alzheimer's Disease Severity Classification1 Feb 2026
- 2026Four-Stage Alzheimer's Disease Classification from MRI Using Topological Feature Extraction, Feature Selection, and Ensemble Learning1 Jan 2026
- 2025Colormap-Enhanced Vision Transformers for MRI-Based Multiclass (4-Class) Alzheimer's Disease Classification18 Dec 2025
- 2025Efficient Breast and Ovarian Cancer Classification via ViT-Based Preprocessing and Transfer Learning23 Sep 2025
- 2025RepViT-CXR: A Channel Replication Strategy for Vision Transformers in Chest X-ray Tuberculosis and Pneumonia Classification10 Sep 2025