Open World Compositional Zero-Shot Learning
Not on the map. Why?
Abstract (arXiv)
Compositional Zero-Shot learning (CZSL) requires to recognize state-object compositions unseen during training. In this work, instead of assuming prior knowledge about the unseen compositions, we operate in the open world setting, where the search space includes a large number of unseen compositions some of which might be unfeasible. In this setting, we start from the cosine similarity between visual features and compositional embeddings. After estimating the feasibility score of each composition, we use these scores to either directly mask the output space or as a margin for the cosine similarity between visual features and compositional embeddings during training. Our experiments on two standard CZSL benchmarks show that all the methods suffer severe performance degradation when applied in the open world setting. While our simple CZSL model achieves state-of-the-art performances in the closed world scenario, our feasibility scores boost the performance of our approach in the open world setting, clearly outperforming the previous state of the art.
Key facts. Cited by 101 papers in the map (data through 14 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 29 Jan 2021.
Builds on
19 of 38 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Layer Normalizationcited by 5,669
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2014Towards Open World Recognitioncited by 226
- 2018Compositional Attention Networks for Machine Reasoningcited by 183
- 2019Task-Driven Modular Networks for Zero-Shot Compositional Learningcited by 121
- 2020Symmetry and Group in Attribute-Object Compositionscited by 89
7 more
- 2019AdaCos: Adaptively Scaling Cosine Logits for Effectively Learning Deep Face Representationscited by 83
- 2016Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Imagescited by 45
- 2019Language Models with Transformerscited by 36
- 2019How to make a pizza: Learning a compositional layer-based GAN modelcited by 21
- 2018Attributes as Operators: Factorizing Unseen Attribute-Object Compositionscited by 20
- 2018Modular Generative Adversarial Networkscited by 16
- 2016Semi-supervised Vocabulary-informed Learningcited by 8
Built on by
Citing papers per year: 2021: 7; 2022: 25; 2023: 25; 2024: 21; 2025: 17; 2026: 6.
101 papers.
Sort:
By area:
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
- 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2022Does CLIP Bind Concepts? Probing Compositionality in Large Image Modelscited by 102
- 2021Everything at Once -- Multi-modal Fusion Transformer for Video Retrievalcited by 79
- 2022Learning to Compose Soft Prompts for Compositional Zero-Shot Learningcited by 67
- 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
- 2022Siamese Contrastive Embedding Network for Compositional Zero-Shot Learningcited by 55
- 2022I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classificationcited by 54
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learningcited by 41
38 more
- 2022Disentanglement of Correlated Factors via Hausdorff Factorized Supportcited by 37
- 2022Decomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learningcited by 37
- 2023Learning Object State Changes in Videos: An Open-World Perspectivecited by 36
- 2022Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?cited by 31
- 2022Revisiting Open World Object Detectioncited by 30
- 2022BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learningcited by 29
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2023Learning Attention as Disentangler for Compositional Zero-shot Learningcited by 29
- 2023Learning Conditional Attributes for Compositional Zero-Shot Learningcited by 28
- 2022I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classificationcited by 27
- 2023Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learningcited by 27
- 2022Learning Invariant Visual Representations for Compositional Zero-Shot Learningcited by 24
- 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learningcited by 24
- 2022Learning Attention Propagation for Compositional Zero-Shot Learningcited by 20
- 2024Context-based and Diversity-driven Specificity in Compositional Zero-Shot Learningcited by 20
- 2023DRPT: Disentangled and Recurrent Prompt Tuning for Compositional Zero-Shot Learningcited by 17
- 20213D Compositional Zero-shot Learning with DeCompositional Consensuscited by 16
- 2023Hierarchical Visual Primitive Experts for Compositional Zero-Shot Learningcited by 16
- 2023GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learningcited by 16
- 2024AAPL: Adding Attributes to Prompt Learning for Vision-Language Modelscited by 14
- 2025Learning Clustering-based Prototypes for Compositional Zero-shot Learningcited by 14
- 2022On Leveraging Variational Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 13
- 2023Preserving Modality Structure Improves Multi-Modal Learningcited by 13
- 2023Chop & Learn: Recognizing and Generating Object-State Compositionscited by 13
- 2022Prompting Large Pre-trained Vision-Language Models For Compositional Concept Learningcited by 12
- 2023Compositional Zero-shot Learning via Progressive Language-based Observationscited by 12
- 2023Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learningcited by 11
- 2023Learning Adversarial Semantic Embeddings for Zero-Shot Recognition in Open Worldscited by 11
- 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprintscited by 10
- 2022ProCC: Progressive Cross-primitive Compatibility for Open-World Compositional Zero-Shot Learningcited by 9
- 2024C2C: Component-to-Composition Learning for Zero-Shot Compositional Action Recognitioncited by 9
- 2024CusConcept: Customized Visual Concept Decomposition with Diffusion Modelscited by 9
- 2021Zero-Shot Action Recognition from Diverse Object-Scene Compositionscited by 8
- 2023Revealing the Proximate Long-Tail Distribution in Compositional Zero-Shot Learningcited by 8
- 2022Overcoming Shortcut Learning in a Target Domain by Generalizing Basic Visual Factors from a Source Domaincited by 7
- 2023CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learningcited by 7
- 2024TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learningcited by 6
- 2024Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attentioncited by 5
50 most cited of 101 All 101 (JSON)
- 2026From Sound to Sense: An Anatomy of Semantic Supervision for Speech-Driven Visual Grounding in Remote Sensing Imagery12 Oct 2026
- 2026Reachability Is Not Generalization: Understanding Verb--Noun Decomposition in Assembly Action Recognition4 Sep 2026
- 2026DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representations20 Aug 2026
- 2026FlowComposer: Composable Flows for Compositional Zero-Shot Learning17 Mar 2026
- 2026Structure-aware Prompt Adaptation from Seen to Unseen for Open-Vocabulary Compositional Zero-Shot Learning4 Mar 2026
- 2026Why Can't I Open My Drawer? Mitigating Object-Driven Shortcuts in Zero-Shot Compositional Action Recognition22 Jan 2026
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learning23 Dec 2025
- 2025Self-Attention with State-Object Weighted Combination for Compositional Zero Shot Learning22 Dec 2025
- 2025CAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement20 Nov 2025
- 2025Compositional Zero-Shot Learning: A Survey13 Oct 2025
- 2025Zero-shot Compositional Action Recognition with Neural Logic Constraints4 Aug 2025
- 2025A Conditional Probability Framework for Compositional Zero-shot Learning23 Jul 2025
38 more
- 2025EVA: Mixture-of-Experts Semantic Variant Alignment for Compositional Zero-Shot Learning26 Jun 2025
- 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation20 Jun 2025
- 2025Feasibility with Language Models for Open-World Compositional Zero-Shot Learning16 May 2025
- 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprints24 Mar 2025
- 2025SPOC: Spatially-Progressing Object State Change Segmentation in Video15 Mar 2025
- 2025Visual Adaptive Prompting for Compositional Zero-Shot Learning27 Feb 2025
- 2025Learning Clustering-based Prototypes for Compositional Zero-shot Learning10 Feb 2025
- 2025Learning Primitive Relations for Compositional Zero-Shot Learning24 Jan 2025
- 2025Learning Visual Proxy for Compositional Zero-Shot Learning23 Jan 2025
- 2025Separated Inter/Intra-Modal Fusion Prompts for Compositional Zero-Shot Learning22 Jan 2025
- 2025Semantically Guided Dynamic Visual Prototype Refinement for Compositional Zero-Shot Learning13 Jan 2025
- 2024Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive Training10 Dec 2024
- 2024Unified Framework for Open-World Compositional Zero-shot Learning5 Dec 2024
- 2024Leveraging MLLM Embeddings and Attribute Smoothing for Compositional Zero-Shot Learning18 Nov 2024
- 2024Not Just Object, But State: Compositional Incremental Learning without Forgetting4 Nov 2024
- 2024CusConcept: Customized Visual Concept Decomposition with Diffusion Models1 Oct 2024
- 2024Focus-Consistent Multi-Level Aggregation for Compositional Zero-Shot Learning30 Aug 2024
- 2024Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning19 Aug 2024
- 2024TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learning16 Aug 2024
- 2024On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Survey9 Aug 2024
- 2024Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention26 Jul 2024
- 2024Attention Based Simple Primitives for Open World Compositional Zero-Shot Learning18 Jul 2024
- 2024Anticipating Future Object Compositions without Forgetting15 Jul 2024
- 2024C2C: Component-to-Composition Learning for Zero-Shot Compositional Action Recognition8 Jul 2024
- 2024Contextual Interaction via Primitive-based Adversarial Training For Compositional Zero-shot Learning21 Jun 2024
- 2024Composite Concept Extraction through Backdooring19 Jun 2024
- 2024MAC: A Benchmark for Multiple Attributes Compositional Zero-Shot Learning18 Jun 2024
- 2024Coarse or Fine? Recognising Action End States without Labels13 May 2024
- 2024CICA: Content-Injected Contrastive Alignment for Zero-Shot Document Image Classification6 May 2024
- 2024AAPL: Adding Attributes to Prompt Learning for Vision-Language Models25 Apr 2024
- 2024CSCNET: Class-Specified Cascaded Network for Compositional Zero-Shot Learning9 Mar 2024
- 2024Context-based and Diversity-driven Specificity in Compositional Zero-Shot Learning27 Feb 2024
- 2023Revealing the Proximate Long-Tail Distribution in Compositional Zero-Shot Learning26 Dec 2023
- 2023Compositional Zero-Shot Learning for Attribute-Based Object Reference in Human-Robot Interaction21 Dec 2023
- 2023Learning Object State Changes in Videos: An Open-World Perspective19 Dec 2023
- 2023Vision-language Assisted Attribute Learning12 Dec 2023
- 2023Prompt Tuning for Zero-shot Compositional Learning2 Dec 2023
- 2023Compositional Zero-shot Learning via Progressive Language-based Observations23 Nov 2023
50 newest of 101 All 101 (JSON)
- 2022Learning to Compose Soft Prompts for Compositional Zero-Shot Learningcited by 67
- 2023Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learningcited by 27
- 2023GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learningcited by 16
- 2024AAPL: Adding Attributes to Prompt Learning for Vision-Language Modelscited by 14
- 2022Prompting Large Pre-trained Vision-Language Models For Compositional Concept Learningcited by 12
- 2025Visual Adaptive Prompting for Compositional Zero-Shot Learningcited by 2
- 2026DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representationscited by 0
- 2026DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representations20 Aug 2026
- 2025Visual Adaptive Prompting for Compositional Zero-Shot Learning27 Feb 2025
- 2024AAPL: Adding Attributes to Prompt Learning for Vision-Language Models25 Apr 2024
- 2023GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learning9 Nov 2023
- 2023Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning27 Mar 2023
- 2022Prompting Large Pre-trained Vision-Language Models For Compositional Concept Learning9 Nov 2022
- 2022Learning to Compose Soft Prompts for Compositional Zero-Shot Learning7 Apr 2022
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
- 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2022Does CLIP Bind Concepts? Probing Compositionality in Large Image Modelscited by 102
- 2021Everything at Once -- Multi-modal Fusion Transformer for Video Retrievalcited by 79
- 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
- 2022Siamese Contrastive Embedding Network for Compositional Zero-Shot Learningcited by 55
- 2022I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classificationcited by 54
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learningcited by 41
- 2022Disentanglement of Correlated Factors via Hausdorff Factorized Supportcited by 37
- 2022Decomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learningcited by 37
12 most cited of 88 All 88 (JSON)
- 2026From Sound to Sense: An Anatomy of Semantic Supervision for Speech-Driven Visual Grounding in Remote Sensing Imagery12 Oct 2026
- 2026Reachability Is Not Generalization: Understanding Verb--Noun Decomposition in Assembly Action Recognition4 Sep 2026
- 2026FlowComposer: Composable Flows for Compositional Zero-Shot Learning17 Mar 2026
- 2026Structure-aware Prompt Adaptation from Seen to Unseen for Open-Vocabulary Compositional Zero-Shot Learning4 Mar 2026
- 2026Why Can't I Open My Drawer? Mitigating Object-Driven Shortcuts in Zero-Shot Compositional Action Recognition22 Jan 2026
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learning23 Dec 2025
- 2025Self-Attention with State-Object Weighted Combination for Compositional Zero Shot Learning22 Dec 2025
- 2025CAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement20 Nov 2025
- 2025Compositional Zero-Shot Learning: A Survey13 Oct 2025
- 2025Zero-shot Compositional Action Recognition with Neural Logic Constraints4 Aug 2025
- 2025A Conditional Probability Framework for Compositional Zero-shot Learning23 Jul 2025
- 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation20 Jun 2025
12 newest of 88 All 88 (JSON)