mlsanityData to 7 Oct 2026

Vision Transformer-based Feature Extraction for Generalized Zero-Shot Learning

arXiv 2302.00875 ↗First posted 2 Feb 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Generalized zero-shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the image attribute. In this paper, we put forth a new GZSL approach exploiting Vision Transformer (ViT) to maximize the attribute-related information contained in the image feature. In ViT, the entire image region is processed without the degradation of the image resolution and the local image information is preserved in patch features. To fully enjoy these benefits of ViT, we exploit patch features as well as the CLS feature in extracting the attribute-related image feature. In particular, we propose a novel attention-based module, called attribute attention module (AAM), to aggregate the attribute-related information in patch features. In AAM, the correlation between each patch feature and the synthetic image attribute is used as the importance weight for each patch. From extensive experiments on benchmark datasets, we demonstrate that the proposed technique outperforms the state-of-the-art GZSL approaches by a large margin.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 30 of its 51 references that are in the map. First posted on arXiv 2 Feb 2023.

Builds on

30 of 51 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2020End-to-End Object Detection with Transformerscited by 7,384
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  10. 2014Conditional Generative Adversarial Netscited by 2,152
  11. 2018Self-Attention Generative Adversarial Networkscited by 809
  12. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
18 more
  1. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
  2. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  3. 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
  4. 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
  5. 2015Label-Embedding for Image Classificationcited by 164
  6. 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
  7. 2016An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wildcited by 146
  8. 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
  9. 2018Multi-modal Cycle-consistent Generalized Zero-Shot Learningcited by 87
  10. 2019Leveraging the Invariant Side of Generative Zero-Shot Learningcited by 83
  11. 2017A Generative Model For Zero Shot Learning Using Conditional Variational Autoencoderscited by 64
  12. 2019Transferable Contrastive Network for Generalized Zero-Shot Learningcited by 64
  13. 2020Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learningcited by 64
  14. 2020Learning the Redundancy-free Features for Generalized Zero-Shot Object Recognitioncited by 34
  15. 2019Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learningcited by 20
  16. 2022Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesiscited by 11
  17. 2022Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammogramscited by 11
  18. 2021Semantic Feature Extraction for Generalized Zero-shot Learningcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 5.

7 papers.

  1. 2025Towards Comprehensive Scene Understanding: Integrating First and Third-Person Views for LVLMscited by 6
  2. 2025AVERY: Intent-Driven Adaptive VLM Split Computing via Embodied Self-Awareness for Efficient Disaster Response Systemscited by 4
  3. 2024ViTaL: An Advanced Framework for Automated Plant Disease Identification in Leaf Images Using Vision Transformers and Linear Projection For Feature Reductioncited by 2
  4. 2024ACC-ViT : Atrous Convolution's Comeback in Vision Transformerscited by 2
  5. 2025MIAFEx: An Attention-based Feature Extraction Method for Medical Image Classificationcited by 2
  6. 2025Learning Primitive Relations for Compositional Zero-Shot Learningcited by 1
  7. 2025Examination of PCA Utilisation for Multilabel Classifier of Multispectral Imagescited by 0