# A Generative Model For Zero Shot Learning Using Conditional Variational Autoencoders

arXiv: https://arxiv.org/abs/1709.00663 · HTML: https://mlsanity.com/paper/1709.00663/

## Key facts

- Cited by 64 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Sep 2017.

## Built on by (most cited first, 30 of 64)

- [CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP](https://mlsanity.com/paper/2301.04926/) (2023)
- [Contrastive Embedding for Generalized Zero-Shot Learning](https://mlsanity.com/paper/2103.16173/) (2021)
- [Domain Impression: A Source Data Free Domain Adaptation Method](https://mlsanity.com/paper/2102.09003/) (2021)
- [FREE: Feature Refinement for Generalized Zero-Shot Learning](https://mlsanity.com/paper/2107.13807/) (2021)
- [SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentation](https://mlsanity.com/paper/2108.12517/) (2021)
- [Zero-Shot Instance Segmentation](https://mlsanity.com/paper/2104.06601/) (2021)
- [Generating Representative Samples for Few-Shot Classification](https://mlsanity.com/paper/2205.02918/) (2022)
- [Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognition](https://mlsanity.com/paper/2101.11530/) (2021)
- [See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data](https://mlsanity.com/paper/2307.10782/) (2023)
- [Fine-Grained Zero-Shot Learning with DNA as Side Information](https://mlsanity.com/paper/2109.14133/) (2021)
- [Task Aligned Generative Meta-learning for Zero-shot Learning](https://mlsanity.com/paper/2103.02185/) (2021)
- [Counterfactual Generative Models for Time-Varying Treatments](https://mlsanity.com/paper/2305.15742/) (2023)
- [Learning Robust Visual-semantic Mapping for Zero-shot Learning](https://mlsanity.com/paper/2104.05668/) (2021)
- [Attribute-Modulated Generative Meta Learning for Zero-Shot Classification](https://mlsanity.com/paper/2104.10857/) (2021)
- [Generative Replay-based Continual Zero-Shot Learning](https://mlsanity.com/paper/2101.08894/) (2021)
- [Semantic Feature Extraction for Generalized Zero-shot Learning](https://mlsanity.com/paper/2112.14478/) (2021)
- [Unseen Classes at a Later Time? No Problem](https://mlsanity.com/paper/2203.16517/) (2022)
- [Vision Transformer-based Feature Extraction for Generalized Zero-Shot Learning](https://mlsanity.com/paper/2302.00875/) (2023)
- [A Gating Model for Bias Calibration in Generalized Zero-shot Learning](https://mlsanity.com/paper/2203.04195/) (2022)
- [AdvNF: Reducing Mode Collapse in Conditional Normalising Flows using Adversarial Learning](https://mlsanity.com/paper/2401.15948/) (2024)
- [Context-Conditional Adaptation for Recognizing Unseen Classes in Unseen Domains](https://mlsanity.com/paper/2107.07497/) (2021)
- [Structured Latent Embeddings for Recognizing Unseen Classes in Unseen Domains](https://mlsanity.com/paper/2107.05622/) (2021)
- [Learning Aligned Cross-Modal Representation for Generalized Zero-Shot Classification](https://mlsanity.com/paper/2112.12927/) (2021)
- [Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition](https://mlsanity.com/paper/2402.11424/) (2024)
- [An Iterative Co-Training Transductive Framework for Zero Shot Learning](https://mlsanity.com/paper/2203.16041/) (2022)
- [An Integral Projection-based Semantic Autoencoder for Zero-Shot Learning](https://mlsanity.com/paper/2306.14628/) (2023)
- [ZEST: Attention-based Zero-Shot Learning for Unseen IoT Device Classification](https://mlsanity.com/paper/2310.08036/) (2023)
- [Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning](https://mlsanity.com/paper/2312.01167/) (2023)
- [Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot Learning](https://mlsanity.com/paper/2102.11856/) (2021)
- [Multi-target prediction for dummies using two-branch neural networks](https://mlsanity.com/paper/2104.09967/) (2021)

## Abstract (arXiv)

Zero shot learning in Image Classification refers to the setting where images from some novel classes are absent in the training data but other information such as natural language descriptions or attribute vectors of the classes are available. This setting is important in the real world since one may not be able to obtain images of all the possible classes at training. While previous approaches have tried to model the relationship between the class attribute space and the image space via some kind of a transfer function in order to model the image space correspondingly to an unseen class, we take a different approach and try to generate the samples from the given attributes, using a conditional variational autoencoder, and use the generated samples for classification of the unseen classes. By extensive testing on four benchmark datasets, we show that our model outperforms the state of the art, particularly in the more realistic generalized setting, where the training classes can also appear at the test time along with the novel classes.
