mlsanityData to 14 Oct 2026

Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition

arXiv 2402.11424 ↗First posted 18 Feb 2024cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

In the realm of Zero-Shot Learning (ZSL), we address biases in Generalized Zero-Shot Learning (GZSL) models, which favor seen data. To counter this, we introduce an end-to-end generative GZSL framework called D3GZSL. This framework respects seen and synthesized unseen data as in-distribution and out-of-distribution data, respectively, for a more balanced model. D3GZSL comprises two core modules: in-distribution dual space distillation (ID2SD) and out-of-distribution batch distillation (O2DBD). ID2SD aligns teacher-student outcomes in embedding and label spaces, enhancing learning coherence. O2DBD introduces low-dimensional out-of-distribution representations per batch sample, capturing shared structures between seen and unseen categories. Our approach demonstrates its effectiveness across established GZSL benchmarks, seamlessly integrating into mainstream generative frameworks. Extensive experiments consistently showcase that D3GZSL elevates the performance of existing generative GZSL methods, underscoring its potential to refine zero-shot learning practices.The code is available at: https://github.com/PJBQ/D3GZSL.git

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 18 Feb 2024.

Builds on

35 of 49 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  4. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  6. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  7. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  8. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  9. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  10. 2018Deep Anomaly Detection with Outlier Exposurecited by 942
  11. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  12. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
23 more
  1. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
  2. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  3. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  4. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
  5. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  6. 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
  7. 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
  8. 2016An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wildcited by 146
  9. 2020Cross-Layer Distillation with Semantic Calibrationcited by 143
  10. 2017Generalized Zero-Shot Learning via Synthesized Examplescited by 114
  11. 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
  12. 2018Multi-modal Cycle-consistent Generalized Zero-Shot Learningcited by 87
  13. 2019Leveraging the Invariant Side of Generative Zero-Shot Learningcited by 83
  14. 2020Domain-aware Visual Bias Eliminating for Generalized Zero-Shot Learningcited by 71
  15. 2021Goal-Oriented Gaze Estimation for Zero-Shot Learningcited by 68
  16. 2017A Generative Model For Zero Shot Learning Using Conditional Variational Autoencoderscited by 64
  17. 2020Generalized Zero-Shot Learning Via Over-Complete Distributioncited by 56
  18. 2019Out-of-Distribution Detection for Generalized Zero-Shot Action Recognitioncited by 54
  19. 2020Invertible Zero-Shot Recognition Flowscited by 48
  20. 2020A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learningcited by 34
  21. 2022Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesiscited by 11
  22. 2019Multi-modal Ensemble Classification for Generalized Zero Shot Learningcited by 4
  23. 2019Transfer feature generating networks with semantic classes structure for zero-shot learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022On the Transferability of Visual Features in Generalized Zero-Shot Learning
  2. 2024Discriminative Image Generation with Diffusion Models for Zero-Shot Learning
  3. 2024Zero-Shot Distillation for Image Encoders: How to Make Effective Use of Synthetic Data
  4. 2026ZeroDiff++: Substantial Unseen Visual-semantic Correlation in Zero-shot Learning
  5. 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusion
  6. 2026DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representations
  7. 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learning
  8. 2024ZeroMamba: Exploring Visual State Space Model for Zero-Shot Learning