Semantic-diversity transfer network for generalized zero-shot learning via inner disagreement based OOD detector
Not on the map. Why?
Abstract (arXiv)
Zero-shot learning (ZSL) aims to recognize objects from unseen classes, where the kernel problem is to transfer knowledge from seen classes to unseen classes by establishing appropriate mappings between visual and semantic features. The knowledge transfer in many existing works is limited mainly due to the facts that 1) the widely used visual features are global ones but not totally consistent with semantic attributes; 2) only one mapping is learned in existing works, which is not able to effectively model diverse visual-semantic relations; 3) the bias problem in the generalized ZSL (GZSL) could not be effectively handled. In this paper, we propose two techniques to alleviate these limitations. Firstly, we propose a Semantic-diversity transfer Network (SetNet) addressing the first two limitations, where 1) a multiple-attention architecture and a diversity regularizer are proposed to learn multiple local visual features that are more consistent with semantic attributes and 2) a projector ensemble that geometrically takes diverse local features as inputs is proposed to model visual-semantic relations from diverse local perspectives. Secondly, we propose an inner disagreement based domain detection module (ID3M) for GZSL to alleviate the third limitation, which picks out unseen-class data before class-level classification. Due to the absence of unseen-class data in training stage, ID3M employs a novel self-contained training scheme and detects out unseen-class data based on a designed inner disagreement criterion. Experimental results on three public datasets demonstrate that the proposed SetNet with the explored ID3M achieves a significant improvement against 30 state-of-the-art methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 65 references that are in the map. First posted on arXiv 17 Mar 2022.
Builds on
38 of 65 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2017Feature Generating Networks for Zero-Shot Learningcited by 257
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
- 2014Evaluation of Output Embeddings for Fine-Grained Image Classificationcited by 166
- 2015Label-Embedding for Image Classificationcited by 164
- 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
26 more
- 2020Attribute Prototype Network for Zero-Shot Learningcited by 160
- 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
- 2016An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wildcited by 146
- 2017Semantic Autoencoder for Zero-Shot Learningcited by 133
- 2016Latent Embeddings for Zero-shot Classificationcited by 129
- 2016Synthesized Classifiers for Zero-Shot Learningcited by 113
- 2017A Generative Adversarial Approach for Zero-Shot Learning from Noisy Textscited by 96
- 2019Leveraging the Invariant Side of Generative Zero-Shot Learningcited by 83
- 2015Zero-Shot Learning via Semantic Similarity Embeddingcited by 74
- 2020Domain-aware Visual Bias Eliminating for Generalized Zero-Shot Learningcited by 71
- 2017Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Networkscited by 66
- 2017A Generative Model For Zero Shot Learning Using Conditional Variational Autoencoderscited by 64
- 2019Transferable Contrastive Network for Generalized Zero-Shot Learningcited by 64
- 2020Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learningcited by 64
- 2020Generalized Zero-Shot Learning Via Over-Complete Distributioncited by 56
- 2019Out-of-Distribution Detection for Generalized Zero-Shot Action Recognitioncited by 54
- 2017Link the head to the "beak": Zero Shot Learning from Noisy Text Description at Part Precisioncited by 46
- 2018Transductive Unbiased Embedding for Zero-Shot Learningcited by 44
- 2019Learning Feature-to-Feature Translator by Alternating Back-Propagation for Generative Zero-Shot Learningcited by 38
- 2016Predicting Visual Exemplars of Unseen Classes for Zero-Shot Learningcited by 30
- 2020Attribute Propagation Network for Graph Zero-shot Learningcited by 29
- 2019Semantically Aligned Bias Reducing Zero Shot Learningcited by 20
- 2019Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learningcited by 20
- 2018Towards Effective Deep Embedding for Zero-Shot Learningcited by 19
- 2017Semantically Consistent Regularization for Zero-Shot Recognitioncited by 14
- 2017Transductive Zero-Shot Learning with Adaptive Structural Embeddingcited by 7
Built on by
Citing papers per year: 2024: 1.
1 paper.