Generating Visual Representations for Zero-Shot Classification
Not on the map. Why?
Abstract (arXiv)
This paper addresses the task of learning an image clas-sifier when some categories are defined by semantic descriptions only (e.g. visual attributes) while the others are defined by exemplar images as well. This task is often referred to as the Zero-Shot classification task (ZSC). Most of the previous methods rely on learning a common embedding space allowing to compare visual features of unknown categories with semantic descriptions. This paper argues that these approaches are limited as i) efficient discrimi-native classifiers can't be used ii) classification tasks with seen and unseen categories (Generalized Zero-Shot Classification or GZSC) can't be addressed efficiently. In contrast , this paper suggests to address ZSC and GZSC by i) learning a conditional generator using seen classes ii) generate artificial training examples for the categories without exemplars. ZSC is then turned into a standard supervised learning problem. Experiments with 4 generative models and 5 datasets experimentally validate the approach, giving state-of-the-art results on both ZSC and GZSC.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 12; 2023: 8; 2024: 4; 2025: 0; 2026: 1.
37 papers.
Sort:
By area:
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2022I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classificationcited by 54
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2023Introducing Language Guidance in Prompt-based Continual Learningcited by 49
- 2022VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learningcited by 27
- 2022I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classificationcited by 27
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Informationcited by 25
25 more
- 2023See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Datacited by 21
- 2021Cross-Trajectory Representation Learning for Zero-Shot Generalization in RLcited by 20
- 2023Zero-shot causal learningcited by 17
- 2022ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Timecited by 16
- 2021Learning from Multiple Noisy Partial Labelerscited by 14
- 2024Text-centric Alignment for Multi-Modality Learningcited by 12
- 2022Domain Disentangled Generative Adversarial Network for Zero-Shot Sketch-Based 3D Shape Retrievalcited by 10
- 2022HandsOff: Labeled Dataset Generation With No Additional Human Annotationscited by 9
- 2022How Robust are Discriminatively Trained Zero-Shot Learning Models?cited by 6
- 2023Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusioncited by 6
- 2023Telling Stories for Common Sense Zero-Shot Action Recognitioncited by 4
- 2024Visual-Semantic Decomposition and Partial Alignment for Document-based Zero-Shot Learningcited by 4
- 2023An Integral Projection-based Semantic Autoencoder for Zero-Shot Learningcited by 3
- 2022Learning Semantic Ambiguities for Zero-Shot Learningcited by 2
- 2021Compositional Fine-Grained Low-Shot Learningcited by 1
- 2021Caption Generation on Scenes with Seen and Unseen Object Categoriescited by 1
- 2022Aligned Weight Regularizers for Pruning Pretrained Neural Networkscited by 1
- 2021Semantic Borrowing for Generalized Zero-Shot Learningcited by 0
- 2021Recursive Training for Zero-Shot Semantic Segmentationcited by 0
- 2022WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrievalcited by 0
- 2022Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learningcited by 0
- 2022Targeted Attention for Generalized- and Zero-Shot Learningcited by 0
- 2023A Systematic Evaluation and Benchmark for Embedding-Aware Generative Models: Features, Models, and Any-shot Scenarioscited by 0
- 2024RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learningcited by 0
- 2026CAST: Closed-form Analytic Semantic Transfer for Zero-Shot Classifier Extensioncited by 0
- 2026CAST: Closed-form Analytic Semantic Transfer for Zero-Shot Classifier Extension13 Aug 2026
- 2024RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learning31 Aug 2024
- 2024Visual-Semantic Decomposition and Partial Alignment for Document-based Zero-Shot Learning22 Jul 2024
- 2024Text-centric Alignment for Multi-Modality Learning12 Feb 2024
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information16 Jan 2024
- 2023Telling Stories for Common Sense Zero-Shot Action Recognition29 Sep 2023
- 2023Introducing Language Guidance in Prompt-based Continual Learning30 Aug 2023
- 2023See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data20 Jul 2023
- 2023An Integral Projection-based Semantic Autoencoder for Zero-Shot Learning26 Jun 2023
- 2023A Systematic Evaluation and Benchmark for Embedding-Aware Generative Models: Features, Models, and Any-shot Scenarios8 Feb 2023
- 2023Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion31 Jan 2023
- 2023Zero-shot causal learning28 Jan 2023
25 more
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP12 Jan 2023
- 2022HandsOff: Labeled Dataset Generation With No Additional Human Annotations24 Dec 2022
- 2022I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification5 Dec 2022
- 2022Targeted Attention for Generalized- and Zero-Shot Learning17 Nov 2022
- 2022I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification21 Sep 2022
- 2022ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Time30 Jun 2022
- 2022Aligned Weight Regularizers for Pruning Pretrained Neural Networks4 Apr 2022
- 2022VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning20 Mar 2022
- 2022Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning5 Mar 2022
- 2022Domain Disentangled Generative Adversarial Network for Zero-Shot Sketch-Based 3D Shape Retrieval24 Feb 2022
- 2022WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrieval11 Feb 2022
- 2022How Robust are Discriminatively Trained Zero-Shot Learning Models?26 Jan 2022
- 2022Learning Semantic Ambiguities for Zero-Shot Learning5 Jan 2022
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentation14 Aug 2021
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Clouds13 Aug 2021
- 2021Caption Generation on Scenes with Seen and Unseen Object Categories13 Aug 2021
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learning29 Jul 2021
- 2021Learning from Multiple Noisy Partial Labelers8 Jun 2021
- 2021Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL4 Jun 2021
- 2021Compositional Fine-Grained Low-Shot Learning21 May 2021
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentation21 Apr 2021
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort13 Apr 2021
- 2021Contrastive Embedding for Generalized Zero-Shot Learning30 Mar 2021
- 2021Recursive Training for Zero-Shot Semantic Segmentation26 Feb 2021
- 2021Semantic Borrowing for Generalized Zero-Shot Learning30 Jan 2021
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2022I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classificationcited by 54
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2023Introducing Language Guidance in Prompt-based Continual Learningcited by 49
- 2022VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learningcited by 27
- 2022I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classificationcited by 27
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Informationcited by 25
12 most cited of 36 All 36 (JSON)
- 2026CAST: Closed-form Analytic Semantic Transfer for Zero-Shot Classifier Extension13 Aug 2026
- 2024Visual-Semantic Decomposition and Partial Alignment for Document-based Zero-Shot Learning22 Jul 2024
- 2024Text-centric Alignment for Multi-Modality Learning12 Feb 2024
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information16 Jan 2024
- 2023Telling Stories for Common Sense Zero-Shot Action Recognition29 Sep 2023
- 2023Introducing Language Guidance in Prompt-based Continual Learning30 Aug 2023
- 2023See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data20 Jul 2023
- 2023An Integral Projection-based Semantic Autoencoder for Zero-Shot Learning26 Jun 2023
- 2023A Systematic Evaluation and Benchmark for Embedding-Aware Generative Models: Features, Models, and Any-shot Scenarios8 Feb 2023
- 2023Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion31 Jan 2023
- 2023Zero-shot causal learning28 Jan 2023
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP12 Jan 2023
12 newest of 36 All 36 (JSON)