Label-Embedding for Image Classification
Not on the map. Why?
Abstract (arXiv)
Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce. We propose to view attribute-based image classification as a label-embedding problem: each class is embedded in the space of attribute vectors. We introduce a function that measures the compatibility between an image and a label embedding. The parameters of this function are learned on a training set of labeled samples to ensure that, given an image, the correct classes rank higher than the incorrect ones. Results on the Animals With Attributes and Caltech-UCSD-Birds datasets show that the proposed framework outperforms the standard Direct Attribute Prediction baseline in a zero-shot learning scenario. Label embedding enjoys a built-in ability to leverage alternative sources of information instead of or in addition to attributes, such as e.g. class hierarchies or textual descriptions. Moreover, label embedding encompasses the whole range of learning settings from zero-shot learning to regular learning with a large number of labeled examples.
Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 56; 2022: 44; 2023: 24; 2024: 22; 2025: 10; 2026: 7.
164 papers.
Sort:
By area:
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 320
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2021Combined Scaling for Zero-shot Transfer Learningcited by 182
- 2022DualCoOp: Fast Adaptation to Multi-Label Recognition with Limited Annotationscited by 102
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Elaborative Rehearsal for Zero-shot Action Recognitioncited by 76
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2021HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learningcited by 57
- 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
38 more
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
- 2023Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Promptscited by 48
- 2021Zero-Shot Day-Night Domain Adaptation with a Physics Priorcited by 47
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentationcited by 41
- 2021Zero-Shot Learning on 3D Point Cloud Objects and Beyondcited by 38
- 2022DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learningcited by 33
- 2021TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learningcited by 28
- 2021Discriminative Region-based Multi-Label Zero-Shot Learningcited by 27
- 2022Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and Languagecited by 27
- 2022VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learningcited by 27
- 2022I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classificationcited by 27
- 2023Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIPcited by 27
- 2021Dual Progressive Prototype Network for Generalized Zero-Shot Learningcited by 26
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Informationcited by 25
- 2021Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognitioncited by 24
- 2021Semantic Diversity Learning for Zero-Shot Multi-label Classificationcited by 24
- 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Surveycited by 23
- 2023DualCoOp++: Fast and Effective Adaptation to Multi-Label Recognition with Limited Annotationscited by 22
- 2022Towards Unbiased Multi-label Zero-Shot Learning with Pyramid and Semantic Attentioncited by 21
- 2021Fine-Grained Zero-Shot Learning with DNA as Side Informationcited by 20
- 2021Human Attention in Fine-grained Classificationcited by 20
- 2022Hybrid Routing Transformer for Zero-Shot Learningcited by 20
- 2023Evolving Semantic Prototype Improves Generative Zero-Shot Learningcited by 20
- 2021Generative Multi-Label Zero-Shot Learningcited by 19
- 2022Attribute Prototype Network for Any-Shot Learningcited by 19
- 2022Temporal and cross-modal attention for audio-visual zero-shot learningcited by 19
- 2021Isometric Propagation Network for Generalized Zero-shot Learningcited by 18
- 2024Progressive Semantic-Guided Vision Transformer for Zero-Shot Learningcited by 17
- 2021Learning Robust Visual-semantic Mapping for Zero-shot Learningcited by 16
- 2023Image-free Classifier Injection for Zero-Shot Classificationcited by 15
- 2021Towards Novel Target Discovery Through Open-Set Domain Adaptationcited by 13
- 2021Domain-Smoothing Network for Zero-Shot Sketch-Based Image Retrievalcited by 13
- 2021Mitigating Generation Shifts for Generalized Zero-Shot Learningcited by 13
- 2024Low-Resource Vision Challenges for Foundation Modelscited by 13
- 2021Hardness Sampling for Self-Training Based Transductive Zero-Shot Learningcited by 12
- 2021Multi-Head Self-Attention via Vision Transformer for Zero-Shot Learningcited by 12
- 2022GSMFlow: Generation Shifts Mitigating Flow for Generalized Zero-Shot Learningcited by 12
- 2022RZCR: Zero-shot Character Recognition via Radical-based Reasoningcited by 12
50 most cited of 164 All 164 (JSON)
- 2026ZeroDiff: Zero-Shot Time Series Reconstruction via Informed-Prior Diffusion29 Sep 2026
- 2026CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning1 Jul 2026
- 2026TextTeacher: What Can Language Teach About Images?21 May 2026
- 2026Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation15 May 2026
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Explaining CLIP Zero-shot Predictions Through Concepts30 Mar 2026
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2025Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces13 Nov 2025
- 2025Distributed Zero-Shot Learning for Visual Recognition11 Nov 2025
- 2025OTTER: Open-Tagging via Text-Image Representation for Multi-modal Understanding1 Oct 2025
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
38 more
- 2025Interpretable Zero-Shot Learning with Locally-Aligned Vision-Language Model30 Jun 2025
- 2025Multi-Timescale Motion-Decoupled Spiking Transformer for Audio-Visual Zero-Shot Learning26 May 2025
- 2025Semantic-guided Representation Learning for Multi-Label Recognition4 Apr 2025
- 2025MedSpaformer: a Transferable Transformer with Multi-granularity Token Sparsification for Medical Time Series Classification19 Mar 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2024A Benchmark of Generative Methods for Zero-Shot Environmental Sound Classification4 Dec 2024
- 2024RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learning31 Aug 2024
- 2024Epsilon: Exploring Comprehensive Visual-Semantic Projection for Multi-Label Zero-Shot Learning22 Aug 2024
- 2024Leveraging Foundation Models for Zero-Shot IoT Sensing29 Jul 2024
- 2024Visual-Semantic Decomposition and Partial Alignment for Document-based Zero-Shot Learning22 Jul 2024
- 2024Spiking Tucker Fusion Transformer for Audio-Visual Zero-Shot Learning11 Jul 2024
- 2024ZeroDDI: A Zero-Shot Drug-Drug Interaction Event Prediction Method with Semantic Enhanced Learning and Dual-Modal Uniform Alignment1 Jul 2024
- 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning15 Apr 2024
- 2024Progressive Semantic-Guided Vision Transformer for Zero-Shot Learning11 Apr 2024
- 2024High-Discriminative Attribute Feature Learning for Generalized Zero-Shot Learning7 Apr 2024
- 2024Diverse and Tailored Image Generation for Zero-shot Multi-label Classification4 Apr 2024
- 2024Automatic Alignment of Discourse Relations of Different Discourse Annotation Frameworks29 Mar 2024
- 2024Enabling Generalized Zero-shot Learning Towards Unseen Domains by Intrinsic Learning from Redundant LLM Semantics21 Mar 2024
- 2024PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck8 Mar 2024
- 2024Neural Field Classifiers via Target Encoding and Classification Loss2 Mar 2024
- 2024Towards Automated Knowledge Integration From Human-Interpretable Representations25 Feb 2024
- 2024Text-centric Alignment for Multi-Modality Learning12 Feb 2024
- 2024Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification3 Feb 2024
- 2024Zero-shot Classification using Hyperdimensional Computing30 Jan 2024
- 2024ActionHub: A Large-scale Action Video Description Dataset for Zero-shot Action Recognition22 Jan 2024
- 2024Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information16 Jan 2024
- 2024Low-Resource Vision Challenges for Foundation Models9 Jan 2024
- 2023Boosting Audio-visual Zero-shot Learning with Large Language Models21 Nov 2023
- 2023Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIP30 Oct 2023
- 2023Dual Feature Augmentation Network for Generalized Zero-shot Learning25 Sep 2023
- 2023Exploring Meta Information for Audio-based Zero-shot Bird Classification15 Sep 2023
- 2023Instance Adaptive Prototypical Contrastive Embedding for Generalized Zero Shot Learning13 Sep 2023
- 2023Bridging the Projection Gap: Overcoming Projection Bias Through Parameterized Distance Learning4 Sep 2023
- 2023GBE-MLZSL: A Group Bi-Enhancement Framework for Multi-Label Zero-Shot Learning2 Sep 2023
- 2023Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignment24 Aug 2023
- 2023Continual Zero-Shot Learning through Semantically Guided Generative Random Walks23 Aug 2023
- 2023Image-free Classifier Injection for Zero-Shot Classification21 Aug 2023
- 2023EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learning19 Aug 2023
50 newest of 164 All 164 (JSON)
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2023Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Promptscited by 48
- 2023Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIPcited by 27
- 2023Video Action Recognition with Attentive Semantic Unitscited by 12
- 2022VL-Taboo: An Analysis of Attribute-based Zero-shot Capabilities of Vision-Language Modelscited by 6
- 2025Interpretable Zero-Shot Learning with Locally-Aligned Vision-Language Modelcited by 6
- 2023Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignmentcited by 4
- 2026Explaining CLIP Zero-shot Predictions Through Conceptscited by 2
- 2022Localized Latent Updates for Fine-Tuning Vision-Language Modelscited by 1
- 2026Explaining CLIP Zero-shot Predictions Through Concepts30 Mar 2026
- 2025Interpretable Zero-Shot Learning with Locally-Aligned Vision-Language Model30 Jun 2025
- 2023Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIP30 Oct 2023
- 2023Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignment24 Aug 2023
- 2023Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Prompts21 Jul 2023
- 2023Video Action Recognition with Attentive Semantic Units17 Mar 2023
- 2022Localized Latent Updates for Fine-Tuning Vision-Language Models13 Dec 2022
- 2022VL-Taboo: An Analysis of Attribute-based Zero-shot Capabilities of Vision-Language Models12 Sep 2022
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Model29 Dec 2021
- 2018Deep Mixture of Experts via Shallow Embeddingcited by 0
- 2018Deep Mixture of Experts via Shallow Embedding5 Jun 2018
- 2022Federated Zero-Shot Learning for Visual Recognitioncited by 4
- 2022Federated Zero-Shot Learning for Visual Recognition5 Sep 2022
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 320
- 2021Combined Scaling for Zero-shot Transfer Learningcited by 182
- 2022DualCoOp: Fast Adaptation to Multi-Label Recognition with Limited Annotationscited by 102
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Elaborative Rehearsal for Zero-shot Action Recognitioncited by 76
- 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2021HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learningcited by 57
- 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
12 most cited of 150 All 150 (JSON)
- 2026ZeroDiff: Zero-Shot Time Series Reconstruction via Informed-Prior Diffusion29 Sep 2026
- 2026CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning1 Jul 2026
- 2026TextTeacher: What Can Language Teach About Images?21 May 2026
- 2026Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation15 May 2026
- 2026A Transfer Learning Evaluation of Deep Neural Networks for Image Classification12 May 2026
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2025Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces13 Nov 2025
- 2025Distributed Zero-Shot Learning for Visual Recognition11 Nov 2025
- 2025OTTER: Open-Tagging via Text-Image Representation for Multi-modal Understanding1 Oct 2025
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2025Multi-Timescale Motion-Decoupled Spiking Transformer for Audio-Visual Zero-Shot Learning26 May 2025
12 newest of 150 All 150 (JSON)