Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Networks
Not on the map. Why?
Abstract (arXiv)
We propose a novel framework called Semantics-Preserving Adversarial Embedding Network (SP-AEN) for zero-shot visual recognition (ZSL), where test images and their classes are both unseen during training. SP-AEN aims to tackle the inherent problem --- semantic loss --- in the prevailing family of embedding-based ZSL, where some semantics would be discarded during training if they are non-discriminative for training classes, but could become critical for recognizing test classes. Specifically, SP-AEN prevents the semantic loss by introducing an independent visual-to-semantic space embedder which disentangles the semantic space into two subspaces for the two arguably conflicting objectives: classification and reconstruction. Through adversarial learning of the two subspaces, SP-AEN can transfer the semantics from the reconstructive subspace to the discriminative one, accomplishing the improved zero-shot recognition of unseen classes. Comparing with prior works, SP-AEN can not only improve classification but also generate photo-realistic images, demonstrating the effectiveness of semantic preservation. On four popular benchmarks: CUB, AWA, SUN and aPY, SP-AEN considerably outperforms other state-of-the-art methods by an absolute performance difference of 12.2%, 9.3%, 4.0%, and 3.6% in terms of harmonic mean values
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 33; 2022: 14; 2023: 12; 2024: 3; 2025: 3; 2026: 1.
66 papers.
Sort:
By area:
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2021Goal-Oriented Gaze Estimation for Zero-Shot Learningcited by 68
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2023Zero-shot Object Countingcited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021TransZero: Attribute-guided Transformer for Zero-Shot Learningcited by 53
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentationcited by 41
- 2021Transporting Causal Mechanisms for Unsupervised Domain Adaptationcited by 38
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
38 more
- 2021A Survey of Unsupervised Domain Adaptation for Visual Recognitioncited by 31
- 2021TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learningcited by 28
- 2021Dual Progressive Prototype Network for Generalized Zero-Shot Learningcited by 26
- 2022Domain Adaptation for Time-Series Classification to Mitigate Covariate Shiftcited by 24
- 2023Zero-Shot Learning by Harnessing Adversarial Samplescited by 24
- 2021Counterfactual Samples Synthesizing and Training for Robust Visual Question Answeringcited by 22
- 2021Emergent Discrete Communication in Semantic Spacescited by 20
- 2021Fine-Grained Zero-Shot Learning with DNA as Side Informationcited by 20
- 2022Hybrid Routing Transformer for Zero-Shot Learningcited by 20
- 2021Task Aligned Generative Meta-learning for Zero-shot Learningcited by 19
- 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognitioncited by 19
- 2021Learning Robust Visual-semantic Mapping for Zero-shot Learningcited by 16
- 2022Domain Adaptation Meets Zero-Shot Learning: An Annotation-Efficient Approach to Multi-Modality Medical Image Segmentationcited by 16
- 2021Rectification-based Knowledge Retention for Continual Learningcited by 15
- 2021Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learningcited by 12
- 2022Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesiscited by 11
- 2023Zero-Shot Object Counting with Language-Vision Modelscited by 9
- 2021Attribute-Modulated Generative Meta Learning for Zero-Shot Classificationcited by 8
- 2021Boosting Generative Zero-Shot Learning by Synthesizing Diverse Features with Attribute Augmentationcited by 7
- 2023Bi-directional Distribution Alignment for Transductive Zero-Shot Learningcited by 7
- 2024Seeing Beyond Classes: Zero-Shot Grounded Situation Recognition via Language Explainercited by 7
- 2022How Robust are Discriminatively Trained Zero-Shot Learning Models?cited by 6
- 2021Cross Knowledge-based Generative Zero-Shot Learning Approach with Taxonomy Regularizationcited by 5
- 2021Rethink, Revisit, Revise: A Spiral Reinforced Self-Revised Network for Zero-Shot Learningcited by 5
- 2021An Entropy-guided Reinforced Partial Convolutional Network for Zero-Shot Learningcited by 4
- 2021Learning Aligned Cross-Modal Representation for Generalized Zero-Shot Classificationcited by 4
- 2022Diversity-boosted Generalization-Specialization Balancing for Zero-shot Learningcited by 4
- 2021Task-Independent Knowledge Makes for Transferable Representations for Generalized Zero-Shot Learningcited by 3
- 2023Adapt and Align to Improve Zero-Shot Sketch-Based Image Retrievalcited by 3
- 2023Bridging the Projection Gap: Overcoming Projection Bias Through Parameterized Distance Learningcited by 3
- 2023Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learningcited by 3
- 2024Visual-Semantic Graph Matching Net for Zero-Shot Learningcited by 3
- 2022Three-Stream Joint Network for Zero-Shot Sketch-Based Image Retrievalcited by 2
- 2022LETS-GZSL: A Latent Embedding Model for Time Series Generalized Zero Shot Learningcited by 2
- 2023Retrieval-Augmented Meta Learning for Low-Resource Text Classificationcited by 2
- 2021Zero-shot Learning with Deep Neural Networks for Object Recognitioncited by 1
- 2021Translational Concept Embedding for Generalized Compositional Zero-shot Learningcited by 1
- 2022Semantics-driven Attentive Few-shot Learning over Clean and Noisy Samplescited by 1
50 most cited of 66 All 66 (JSON)
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2025Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces13 Nov 2025
- 2025Multi-Granularity Mutual Refinement Network for Zero-Shot Learning11 Nov 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2024Visual-Semantic Graph Matching Net for Zero-Shot Learning18 Nov 2024
- 2024Dual Relation Mining Network for Zero-Shot Learning6 May 2024
- 2024Seeing Beyond Classes: Zero-Shot Grounded Situation Recognition via Language Explainer24 Apr 2024
- 2023Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning2 Dec 2023
- 2023Attribute Localization and Revision Network for Zero-Shot Learning11 Oct 2023
- 2023Dual Feature Augmentation Network for Generalized Zero-shot Learning25 Sep 2023
- 2023Zero-Shot Object Counting with Language-Vision Models22 Sep 2023
- 2023Retrieval-Augmented Meta Learning for Low-Resource Text Classification10 Sep 2023
38 more
- 2023Bridging the Projection Gap: Overcoming Projection Bias Through Parameterized Distance Learning4 Sep 2023
- 2023Zero-Shot Learning by Harnessing Adversarial Samples1 Aug 2023
- 2023Fuzzy Logic Visual Network (FLVN): A neuro-symbolic approach for visual features matching29 Jul 2023
- 2023Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation14 Jun 2023
- 2023Adapt and Align to Improve Zero-Shot Sketch-Based Image Retrieval9 May 2023
- 2023Bi-directional Distribution Alignment for Transductive Zero-Shot Learning15 Mar 2023
- 2023Zero-shot Object Counting3 Mar 2023
- 2022On the Transferability of Visual Features in Generalized Zero-Shot Learning22 Nov 2022
- 2022LETS-GZSL: A Latent Embedding Model for Time Series Generalized Zero Shot Learning25 Jul 2022
- 2022Learning Compositional Representations for Effective Low-Shot Generalization17 Apr 2022
- 2022Three-Stream Joint Network for Zero-Shot Sketch-Based Image Retrieval12 Apr 2022
- 2022Domain Adaptation for Time-Series Classification to Mitigate Covariate Shift7 Apr 2022
- 2022Hybrid Routing Transformer for Zero-Shot Learning29 Mar 2022
- 2022Domain Adaptation Meets Zero-Shot Learning: An Annotation-Efficient Approach to Multi-Modality Medical Image Segmentation19 Mar 2022
- 2022Semantic-diversity transfer network for generalized zero-shot learning via inner disagreement based OOD detector17 Mar 2022
- 2022Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesis10 Mar 2022
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning7 Mar 2022
- 2022WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrieval11 Feb 2022
- 2022How Robust are Discriminatively Trained Zero-Shot Learning Models?26 Jan 2022
- 2022Semantics-driven Attentive Few-shot Learning over Clean and Noisy Samples9 Jan 2022
- 2022Diversity-boosted Generalization-Specialization Balancing for Zero-shot Learning6 Jan 2022
- 2021Learning Aligned Cross-Modal Representation for Generalized Zero-Shot Classification24 Dec 2021
- 2021Boosting Generative Zero-Shot Learning by Synthesizing Diverse Features with Attribute Augmentation23 Dec 2021
- 2021Translational Concept Embedding for Generalized Compositional Zero-shot Learning20 Dec 2021
- 2021TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning16 Dec 2021
- 2021A Survey of Unsupervised Domain Adaptation for Visual Recognition13 Dec 2021
- 2021TransZero: Attribute-guided Transformer for Zero-Shot Learning3 Dec 2021
- 2021Rethink, Revisit, Revise: A Spiral Reinforced Self-Revised Network for Zero-Shot Learning1 Dec 2021
- 2021Using Fictitious Class Representations to Boost Discriminative Zero-Shot Learners26 Nov 2021
- 2021An Entropy-guided Reinforced Partial Convolutional Network for Zero-Shot Learning3 Nov 2021
- 2021Dual Progressive Prototype Network for Generalized Zero-Shot Learning3 Nov 2021
- 2021Self-Supervised Learning Disentangled Group Representation as Feature28 Oct 2021
- 2021Counterfactual Samples Synthesizing and Training for Robust Visual Question Answering3 Oct 2021
- 2021Fine-Grained Zero-Shot Learning with DNA as Side Information29 Sep 2021
- 2021Partner-Assisted Learning for Few-Shot Image Classification15 Sep 2021
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentation27 Aug 2021
- 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognition10 Aug 2021
- 2021Emergent Discrete Communication in Semantic Spaces4 Aug 2021
50 newest of 66 All 66 (JSON)
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2021Goal-Oriented Gaze Estimation for Zero-Shot Learningcited by 68
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2023Zero-shot Object Countingcited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021TransZero: Attribute-guided Transformer for Zero-Shot Learningcited by 53
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentationcited by 41
- 2021Transporting Causal Mechanisms for Unsupervised Domain Adaptationcited by 38
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
12 most cited of 64 All 64 (JSON)
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2025Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces13 Nov 2025
- 2025Multi-Granularity Mutual Refinement Network for Zero-Shot Learning11 Nov 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2024Visual-Semantic Graph Matching Net for Zero-Shot Learning18 Nov 2024
- 2024Dual Relation Mining Network for Zero-Shot Learning6 May 2024
- 2023Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning2 Dec 2023
- 2023Attribute Localization and Revision Network for Zero-Shot Learning11 Oct 2023
- 2023Dual Feature Augmentation Network for Generalized Zero-shot Learning25 Sep 2023
- 2023Zero-Shot Object Counting with Language-Vision Models22 Sep 2023
- 2023Bridging the Projection Gap: Overcoming Projection Bias Through Parameterized Distance Learning4 Sep 2023
- 2023Zero-Shot Learning by Harnessing Adversarial Samples1 Aug 2023
12 newest of 64 All 64 (JSON)