A Comprehensive Study of Vision Transformers in Image Classification Tasks
Not on the map. Why?
Abstract (arXiv)
Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image classification due to the emergence of deep learning. However, challenges still exist, such as modeling fine-grained visual information, high computation costs, the parallelism of the model, and inconsistent evaluation protocols across datasets. In this paper, we conduct a comprehensive survey of existing papers on Vision Transformers for image classification. We first introduce the popular image classification datasets that influenced the design of models. Then, we present Vision Transformers models in chronological order, starting with early attempts at adapting attention mechanism to vision tasks followed by the adoption of vision transformers, as they have demonstrated success in capturing intricate patterns and long-range dependencies within images. Finally, we discuss open problems and shed light on opportunities for image classification to facilitate new research ideas.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 46 of its 79 references that are in the map. First posted on arXiv 2 Dec 2023.
Builds on
46 of 79 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
34 more
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Going Deeper with Convolutionscited by 4,241
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2021Transformers in Vision: A Surveycited by 1,013
- 2021Going deeper with Image Transformerscited by 764
- 2020A Survey on Visual Transformercited by 654
- 2021ImageNet-21K Pretraining for the Massescited by 613
- 2019Stand-Alone Self-Attention in Vision Modelscited by 542
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 429
- 2014Understanding Deep Image Representations by Inverting Themcited by 403
- 2014Recurrent Models of Visual Attentioncited by 349
- 2017Adversarial Attacks on Neural Network Policiescited by 320
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2014cuDNN: Efficient Primitives for Deep Learningcited by 245
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2014Understanding image representations by measuring their equivariance and equivalencecited by 243
- 2015Bilinear CNNs for Fine-grained Visual Recognitioncited by 228
- 2013OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networkscited by 224
- 2017Improving Generalization Performance by Switching from Adam to SGDcited by 125
- 2019Deep Self-Learning From Noisy Labelscited by 122
- 2016Semi-Supervised Learning with Generative Adversarial Networkscited by 103
- 2018Leveraging Unlabeled Data for Crowd Counting by Learning to Rankcited by 57
- 2020The Unreasonable Effectiveness of Deep Learning in Artificial Intelligencecited by 57
- 2017Variational Attention for Sequence-to-Sequence Modelscited by 29
- 2022Deep transfer learning for image classification: a surveycited by 13
- 2022Transformers Meet Visual Learning Understanding: A Comprehensive Reviewcited by 5
- 2020Brief Announcement: On the Limits of Parallelizing Convolutional Neural Networks on GPUscited by 3
- 2018Bird Species Classification using Transfer Learning with Multistage Trainingcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.