Zero-Shot Learning -- The Good, the Bad and the Ugly
Not on the map. Why?
Cited by 37 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Due to the importance of zero-shot learning, the number of proposed approaches has increased steadily recently. We argue that it is time to take a step back and to analyze the status quo of the area. The purpose of this paper is three-fold. First, given the fact that there is no agreed upon zero-shot learning benchmark, we first define a new benchmark by unifying both the evaluation protocols and data splits. This is an important contribution as published results are often not comparable and sometimes even flawed due to, e.g. pre-training on zero-shot test classes. Second, we compare and analyze a significant number of the state-of-the-art methods in depth, both in the classic zero-shot setting but also in the more realistic generalized zero-shot setting. Finally, we discuss limitations of the current status of the area which can be taken as a basis for advancing it.
Key facts. Cited by 254 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 60; 2022: 48; 2023: 52; 2024: 47; 2025: 30; 2026: 17.
254 papers.
Sort:
By area:
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2021Combined Scaling for Zero-shot Transfer Learningcited by 182
- 2021Open-World Semi-Supervised Learningcited by 165
- 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2022Unified Vision and Language Prompt Learningcited by 145
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
38 more
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
- 2021ML-Decoder: Scalable and Versatile Classification Headcited by 78
- 2023Consistency-guided Prompt Learning for Vision-Language Modelscited by 73
- 2021Goal-Oriented Gaze Estimation for Zero-Shot Learningcited by 68
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 66
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2022LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Modelscited by 58
- 2021HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learningcited by 57
- 2021TransZero: Attribute-guided Transformer for Zero-Shot Learningcited by 53
- 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 52
- 2023Better Zero-Shot Reasoning with Self-Adaptive Promptingcited by 52
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
- 2023Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Promptscited by 48
- 2022A survey of multimodal deep generative modelscited by 47
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentationcited by 41
- 2021Zero-Shot Instance Segmentationcited by 40
- 2022Novel Class Discovery without Forgettingcited by 39
- 2023StyLIP: Multi-Scale Style-Conditioned Prompt Learning for CLIP-based Domain Generalizationcited by 36
- 2022Learning Domain Invariant Prompt for Vision-Language Modelscited by 35
- 2023Large Language Models Are Zero-Shot Text Classifierscited by 35
- 2022StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesiscited by 33
- 2022Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfercited by 33
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 33
- 2021All Labels Are Not Created Equal: Enhancing Semi-supervision via Label Grouping and Co-trainingcited by 32
- 2023Enhancing CLIP with CLIP: Exploring Pseudolabeling for Limited-Label Prompt Tuningcited by 30
- 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationalescited by 29
- 2023Upcycling Models under Domain and Category Shiftcited by 29
- 2023Learning Attention as Disentangler for Compositional Zero-shot Learningcited by 29
- 2023LoGoPrompt: Synthetic Text Images Can Be Good Visual Prompts for Vision-Language Modelscited by 29
- 2021SSSE: Efficiently Erasing Samples from Trained Machine Learning Modelscited by 28
- 2021TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learningcited by 28
- 2022Open-vocabulary Attribute Detectioncited by 28
- 2023Artificial intelligence to advance Earth observation: : A review of models, recent trends, and pathways forwardcited by 28
- 2023A Systematic Review of Few-Shot Learning in Medical Imagingcited by 28
- 2024Prompt Learning via Meta-Regularizationcited by 26
- 2021Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Fillingcited by 25
- 2021Segmentation-grounded Scene Graph Generationcited by 25
50 most cited of 254 All 254 (JSON)
- 2026ZeroDiff: Zero-Shot Time Series Reconstruction via Informed-Prior Diffusion29 Sep 2026
- 2026STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence25 Sep 2026
- 2026ZOMP: Zeroth-Order Multi-Modal Prompt Tuning for Vision-Language Models8 Aug 2026
- 2026U-shaped Multi-granularity Learning for Vision-Language Models16 Jul 2026
- 2026A Graph Neural Network approach to zero-shot Digital Twins10 Jul 2026
- 2026SMETA-ZSL:Semantic Meta-Alignment for Zero-Shot Threat Classification10 Jul 2026
- 2026CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning1 Jul 2026
- 2026GKDT: General Keypoint Detection Transformer1 Jul 2026
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Parameter-Efficient Semantic Augmentation for Enhancing Open-Vocabulary Object Detection6 Apr 2026
- 2026Hidden Ads: Behavior Triggered Semantic Backdoors for Advertisement Injection in Vision Language Models29 Mar 2026
- 2026Beyond Language: Grounding Referring Expressions with Hand Pointing in Egocentric Vision27 Mar 2026
38 more
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb 2026
- 2026Talking with Verifiers: Automatic Specification Generation for Neural Network Verification13 Feb 2026
- 2026Mixture of Concept Bottleneck Experts2 Feb 2026
- 2026Open World Knowledge Aided Single-Cell Foundation Model with Robust Cross-Modal Cell-Language Pre-training9 Jan 2026
- 2025Fine-Grained Zero-Shot Learning with Attribute-Centric Representations13 Dec 2025
- 2025Vision-Language Models for Infrared Industrial Sensing in Additive Manufacturing Scene Description11 Dec 2025
- 2025NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion14 Nov 2025
- 2025A Retrospect to Multi-prompt Learning across Vision and Language31 Oct 2025
- 2025ELMF4EggQ: Ensemble Learning with Multimodal Feature Fusion for Non-Destructive Egg Quality Assessment3 Oct 2025
- 2025Nonparametric Identification of Latent Concepts30 Sep 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025COLA: Context-aware Language-driven Test-time Adaptation22 Sep 2025
- 2025Spotlighter: Revisiting Prompt Tuning from a Representative Mining View31 Aug 2025
- 2025Evaluating Compositional Generalisation in VLMs and Diffusion Models28 Aug 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2025Interpretable Zero-Shot Learning with Locally-Aligned Vision-Language Model30 Jun 2025
- 2025Generalizing vision-language models to novel domains: A comprehensive survey23 Jun 2025
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions17 Jun 2025
- 2025CoCoA-Mix: Confusion-and-Confidence-Aware Mixture Model for Context Optimization9 Jun 2025
- 2025There Was Never a Bottleneck in Concept Bottleneck Models5 Jun 2025
- 2025OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt Tuning8 May 2025
- 2025A Theoretical Framework for OOD Robustness in Transformers using Gevrey Classes17 Apr 2025
- 2025Logits DeConfusion with CLIP for Few-Shot Learning16 Apr 2025
- 2025Automated Business Process Analysis: An LLM-Based Approach to Value Assessment9 Apr 2025
- 2025Memory-Modular Classification: Learning to Generalize with Memory Replacement8 Apr 2025
- 2025Benchmarking Object Detectors under Real-World Distribution Shifts in Satellite Imagery24 Mar 2025
- 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprints24 Mar 2025
- 2025Dynamic Relation Inference via Verb Embeddings17 Mar 2025
- 2025SVIP: Semantically Contextualized Visual Patches for Zero-Shot Learning13 Mar 2025
- 2025Generalizable Prompt Learning of CLIP: A Brief Overview3 Mar 2025
- 2025InPK: Infusing Prior Knowledge into Prompt for Vision-Language Models27 Feb 2025
- 2025Efficient LLM Moderation with Multi-Layer Latent Prototypes22 Feb 2025
- 2025Zero-shot Meta-learning for Tabular Prediction Tasks with Adversarially Pre-trained Transformer6 Feb 2025
- 2025LR0.FM: Low-Res Benchmark and Improving Robustness for Zero-Shot Classification in Foundation Models6 Feb 2025
- 2024A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer15 Dec 2024
- 2024A Benchmark of Generative Methods for Zero-Shot Environmental Sound Classification4 Dec 2024
- 2024Adaptive Anomaly Detection for Identifying Attacks in Cyber-Physical Systems: A Systematic Literature Review21 Nov 2024
50 newest of 254 All 254 (JSON)
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2022Unified Vision and Language Prompt Learningcited by 145
- 2023Consistency-guided Prompt Learning for Vision-Language Modelscited by 73
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2023Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Promptscited by 48
- 2022Learning Domain Invariant Prompt for Vision-Language Modelscited by 35
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 33
- 2023Enhancing CLIP with CLIP: Exploring Pseudolabeling for Limited-Label Prompt Tuningcited by 30
- 2023LoGoPrompt: Synthetic Text Images Can Be Good Visual Prompts for Vision-Language Modelscited by 29
- 2022Open-vocabulary Attribute Detectioncited by 28
- 2024Prompt Learning via Meta-Regularizationcited by 26
- 2024Overcoming the Pitfalls of Vision-Language Model Finetuning for OOD Generalizationcited by 17
12 most cited of 36 All 36 (JSON)
- 2026ZOMP: Zeroth-Order Multi-Modal Prompt Tuning for Vision-Language Models8 Aug 2026
- 2026U-shaped Multi-granularity Learning for Vision-Language Models16 Jul 2026
- 2026Hidden Ads: Behavior Triggered Semantic Backdoors for Advertisement Injection in Vision Language Models29 Mar 2026
- 2025A Retrospect to Multi-prompt Learning across Vision and Language31 Oct 2025
- 2025Interpretable Zero-Shot Learning with Locally-Aligned Vision-Language Model30 Jun 2025
- 2025Generalizing vision-language models to novel domains: A comprehensive survey23 Jun 2025
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions17 Jun 2025
- 2025CoCoA-Mix: Confusion-and-Confidence-Aware Mixture Model for Context Optimization9 Jun 2025
- 2025OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt Tuning8 May 2025
- 2025Generalizable Prompt Learning of CLIP: A Brief Overview3 Mar 2025
- 2025InPK: Infusing Prior Knowledge into Prompt for Vision-Language Models27 Feb 2025
- 2024Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP31 Oct 2024
12 newest of 36 All 36 (JSON)
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
- 2025Evaluating Compositional Generalisation in VLMs and Diffusion Modelscited by 4
- 2024Map2Traj: Street Map Piloted Zero-shot Trajectory Generation with Diffusion Modelcited by 2
- 2024RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learningcited by 0
- 2024A Benchmark of Generative Methods for Zero-Shot Environmental Sound Classificationcited by 0
- 2025Evaluating Compositional Generalisation in VLMs and Diffusion Models28 Aug 2025
- 2024A Benchmark of Generative Methods for Zero-Shot Environmental Sound Classification4 Dec 2024
- 2024RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learning31 Aug 2024
- 2024Map2Traj: Street Map Piloted Zero-shot Trajectory Generation with Diffusion Model29 Jul 2024
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusion7 Feb 2023
- 2022Federated Zero-Shot Learning for Visual Recognitioncited by 4
- 2025Efficient LLM Moderation with Multi-Layer Latent Prototypescited by 4
- 2025Efficient LLM Moderation with Multi-Layer Latent Prototypes22 Feb 2025
- 2022Federated Zero-Shot Learning for Visual Recognition5 Sep 2022
- 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2021Combined Scaling for Zero-shot Transfer Learningcited by 182
- 2021Open-World Semi-Supervised Learningcited by 165
- 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2021ML-Decoder: Scalable and Versatile Classification Headcited by 78
- 2021Goal-Oriented Gaze Estimation for Zero-Shot Learningcited by 68
12 most cited of 207 All 207 (JSON)
- 2026ZeroDiff: Zero-Shot Time Series Reconstruction via Informed-Prior Diffusion29 Sep 2026
- 2026STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence25 Sep 2026
- 2026A Graph Neural Network approach to zero-shot Digital Twins10 Jul 2026
- 2026SMETA-ZSL:Semantic Meta-Alignment for Zero-Shot Threat Classification10 Jul 2026
- 2026CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning1 Jul 2026
- 2026GKDT: General Keypoint Detection Transformer1 Jul 2026
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Parameter-Efficient Semantic Augmentation for Enhancing Open-Vocabulary Object Detection6 Apr 2026
- 2026Beyond Language: Grounding Referring Expressions with Hand Pointing in Egocentric Vision27 Mar 2026
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2026Talking with Verifiers: Automatic Specification Generation for Neural Network Verification13 Feb 2026
- 2026Mixture of Concept Bottleneck Experts2 Feb 2026
12 newest of 207 All 207 (JSON)