Bridging the Projection Gap: Overcoming Projection Bias Through Parameterized Distance Learning
Not on the map. Why?
Abstract (arXiv)
Generalized zero-shot learning (GZSL) aims to recognize samples from both seen and unseen classes using only seen class samples for training. However, GZSL methods are prone to bias towards seen classes during inference due to the projection function being learned from seen classes. Most methods focus on learning an accurate projection, but bias in the projection is inevitable. We address this projection bias by proposing to learn a parameterized Mahalanobis distance metric for robust inference. Our key insight is that the distance computation during inference is critical, even with a biased projection. We make two main contributions - (1) We extend the VAEGAN (Variational Autoencoder & Generative Adversarial Networks) architecture with two branches to separately output the projection of samples from seen and unseen classes, enabling more robust distance learning. (2) We introduce a novel loss function to optimize the Mahalanobis distance representation and reduce projection bias. Extensive experiments on four datasets show that our approach outperforms state-of-the-art GZSL techniques with improvements of up to 3.5 % on the harmonic mean metric.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
29 of 50 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
- 2017Feature Generating Networks for Zero-Shot Learningcited by 257
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
- 2015Label-Embedding for Image Classificationcited by 165
- 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
17 more
- 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 162
- 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
- 2016Synthesized Classifiers for Zero-Shot Learningcited by 113
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2019Leveraging the Invariant Side of Generative Zero-Shot Learningcited by 83
- 2017Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Networkscited by 66
- 2020Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learningcited by 64
- 2021HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learningcited by 57
- 2015Transductive Multi-view Zero-Shot Learningcited by 53
- 2019Transductive Zero-Shot Learning for 3D Point Cloud Classificationcited by 39
- 2023Zero-shot Generative Model Adaptation via Image-specific Prompt Learningcited by 27
- 2020Zero-Shot Learning and its Applications from Autonomous Vehicles to COVID-19 Diagnosis: A Reviewcited by 20
- 2018Towards Effective Deep Embedding for Zero-Shot Learningcited by 19
- 2023Synthetic Sample Selection for Generalized Zero-Shot Learningcited by 14
- 2021Disentangling Semantic-to-visual Confusion for Zero-shot Learningcited by 11
- 2022Rebalanced Zero-shot Learningcited by 8
- 2017Zero-shot Learning via Shared-Reconstruction-Graph Pursuitcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.