Learning Compositional Representations for Few-Shot Recognition
Not on the map. Why?
Abstract (arXiv)
One of the key limitations of modern deep learning approaches lies in the amount of data required to train them. Humans, by contrast, can learn to recognize novel categories from just a few examples. Instrumental to this rapid learning ability is the compositional structure of concept representations in the human brain --- something that deep learning models are lacking. In this work, we make a step towards bridging this gap between human and machine learning by introducing a simple regularization technique that allows the learned representation to be decomposable into parts. Our method uses category-level attribute annotations to disentangle the feature space of a network into subspaces corresponding to the attributes. These attributes can be either purely visual, like object parts, or more abstract, like openness and symmetry. We demonstrate the value of compositional representations on three datasets: CUB-200-2011, SUN397, and ImageNet, and show that they require fewer examples to learn classifiers for novel categories.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 16; 2023: 11; 2024: 5; 2025: 1; 2026: 1.
50 papers.
Sort:
By area:
- 2022Disentangled Representation Learningcited by 111
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detectioncited by 80
- 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
- 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Languagecited by 42
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2022Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?cited by 31
- 2022BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learningcited by 29
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learningcited by 24
- 2021Learning Compositional Representation for 4D Captures with Neural ODEcited by 22
- 2023Use Your Head: Improving Long-Tail Video Recognitioncited by 22
38 more
- 2022Attribute Prototype Network for Any-Shot Learningcited by 19
- 2024When does compositional structure yield compositional generalization? A kernel theorycited by 19
- 2022Contributions of Shape, Texture, and Color in Visual Recognitioncited by 16
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representationcited by 15
- 2023Simple Semantic-Aided Few-Shot Learningcited by 15
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
- 2021Disentangled Feature Representation for Few-shot Image Classificationcited by 12
- 2021Learnable Expansion-and-Compression Network for Few-shot Class-Incremental Learningcited by 11
- 2022vMFNet: Compositionality Meets Domain-generalised Segmentationcited by 11
- 2021MFNet: Multi-class Few-shot Segmentation Network with Pixel-wise Metric Learningcited by 10
- 2022Hierarchical Compositional Representations for Few-shot Action Recognitioncited by 10
- 2021Meta Learning on a Sequence of Imbalanced Domains with Difficulty Awarenesscited by 8
- 2021Learning Single/Multi-Attribute of Object with Symmetry and Groupcited by 8
- 2021Prototype Completion for Few-Shot Learningcited by 7
- 2021Information Symmetry Matters: A Modal-Alternating Propagation Network for Few-Shot Learningcited by 6
- 2023Mitigating the Effect of Incidental Correlations on Part-based Learningcited by 6
- 2021Contextualizing Meta-Learning via Learning to Decomposecited by 5
- 2021Learning Compositional Representation for Few-shot Visual Question Answeringcited by 3
- 2021Generating Compositional Color Representations from Textcited by 3
- 2022Reference-Limited Compositional Zero-Shot Learningcited by 3
- 2021Shaping Visual Representations with Attributes for Few-Shot Recognitioncited by 2
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentationcited by 2
- 2023Compositionally Equivariant Representation Learningcited by 2
- 2021Image interpretation by iterative bottom-up top-down processingcited by 1
- 2021Compositional Fine-Grained Low-Shot Learningcited by 1
- 2022A Unified Framework with Meta-dropout for Few-shot Learningcited by 1
- 2023Compositional Prototypical Networks for Few-Shot Classificationcited by 1
- 2023Logarithm-transform aided Gaussian Sampling for Few-Shot Learningcited by 1
- 2025Data-Agnostic Cardinality Learning from Imperfect Workloadscited by 1
- 2022Fine-grained Few-shot Recognition by Deep Object Parsingcited by 0
- 2022Learning Primitive-aware Discriminative Representations for Few-shot Learningcited by 0
- 2022Interpretable Few-shot Learning with Online Attribute Selectioncited by 0
- 2023Concept Discovery for Fast Adapatationcited by 0
- 2023Compositional Representation Learning for Brain Tumour Segmentationcited by 0
- 2024Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generationcited by 0
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionalitycited by 0
- 2024A Feature Generator for Few-Shot Learningcited by 0
- 2026Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentationcited by 0
- 2026Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation15 May 2026
- 2025Data-Agnostic Cardinality Learning from Imperfect Workloads19 Jun 2025
- 2024A Feature Generator for Few-Shot Learning21 Sep 2024
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionality21 Aug 2024
- 2024Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation27 Jun 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
- 2024When does compositional structure yield compositional generalization? A kernel theory26 May 2024
- 2023Simple Semantic-Aided Few-Shot Learning30 Nov 2023
- 2023Compositional Representation Learning for Brain Tumour Segmentation10 Oct 2023
- 2023Mitigating the Effect of Incidental Correlations on Part-based Learning30 Sep 2023
- 2023Logarithm-transform aided Gaussian Sampling for Few-Shot Learning28 Sep 2023
- 2023Compositionally Equivariant Representation Learning13 Jun 2023
38 more
- 2023Compositional Prototypical Networks for Few-Shot Classification11 Jun 2023
- 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learning23 May 2023
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition12 May 2023
- 2023Use Your Head: Improving Long-Tail Video Recognition3 Apr 2023
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentation20 Feb 2023
- 2023Concept Discovery for Fast Adapatation19 Jan 2023
- 2022Disentangled Representation Learning21 Nov 2022
- 2022Interpretable Few-shot Learning with Online Attribute Selection16 Nov 2022
- 2022A Unified Framework with Meta-dropout for Few-shot Learning12 Oct 2022
- 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Language2 Oct 2022
- 2022Reference-Limited Compositional Zero-Shot Learning22 Aug 2022
- 2022Learning Primitive-aware Discriminative Representations for Few-shot Learning20 Aug 2022
- 2022Hierarchical Compositional Representations for Few-shot Action Recognition19 Aug 2022
- 2022Contributions of Shape, Texture, and Color in Visual Recognition19 Jul 2022
- 2022Fine-grained Few-shot Recognition by Deep Object Parsing14 Jul 2022
- 2022vMFNet: Compositionality Meets Domain-generalised Segmentation29 Jun 2022
- 2022Generating Representative Samples for Few-Shot Classification5 May 2022
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrieval12 Apr 2022
- 2022Attribute Prototype Network for Any-Shot Learning4 Apr 2022
- 2022Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?31 Mar 2022
- 2022BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning3 Mar 2022
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representation2 Mar 2022
- 2021Shaping Visual Representations with Attributes for Few-Shot Recognition13 Dec 2021
- 2021MFNet: Multi-class Few-shot Segmentation Network with Pixel-wise Metric Learning30 Oct 2021
- 2021Learning Single/Multi-Attribute of Object with Symmetry and Group9 Oct 2021
- 2021Meta Learning on a Sequence of Imbalanced Domains with Difficulty Awareness29 Sep 2021
- 2021Disentangled Feature Representation for Few-shot Image Classification26 Sep 2021
- 2021Generating Compositional Color Representations from Text22 Sep 2021
- 2021Information Symmetry Matters: A Modal-Alternating Propagation Network for Few-Shot Learning3 Sep 2021
- 2021Prototype Completion for Few-Shot Learning11 Aug 2021
- 2021Contextualizing Meta-Learning via Learning to Decompose15 Jun 2021
- 2021Compositional Fine-Grained Low-Shot Learning21 May 2021
- 2021Image interpretation by iterative bottom-up top-down processing12 May 2021
- 2021Learnable Expansion-and-Compression Network for Few-shot Class-Incremental Learning6 Apr 2021
- 2021Learning Compositional Representation for 4D Captures with Neural ODE15 Mar 2021
- 2021Detecting Human-Object Interaction via Fabricated Compositional Learning15 Mar 2021
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detection8 Mar 2021
- 2021Learning Compositional Representation for Few-shot Visual Question Answering21 Feb 2021
- 2022Disentangled Representation Learningcited by 111
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detectioncited by 80
- 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
- 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Languagecited by 42
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2022BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learningcited by 29
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learningcited by 24
- 2021Learning Compositional Representation for 4D Captures with Neural ODEcited by 22
- 2023Use Your Head: Improving Long-Tail Video Recognitioncited by 22
- 2022Attribute Prototype Network for Any-Shot Learningcited by 19
12 most cited of 49 All 49 (JSON)
- 2026Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation15 May 2026
- 2025Data-Agnostic Cardinality Learning from Imperfect Workloads19 Jun 2025
- 2024A Feature Generator for Few-Shot Learning21 Sep 2024
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionality21 Aug 2024
- 2024Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation27 Jun 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
- 2024When does compositional structure yield compositional generalization? A kernel theory26 May 2024
- 2023Simple Semantic-Aided Few-Shot Learning30 Nov 2023
- 2023Compositional Representation Learning for Brain Tumour Segmentation10 Oct 2023
- 2023Mitigating the Effect of Incidental Correlations on Part-based Learning30 Sep 2023
- 2023Logarithm-transform aided Gaussian Sampling for Few-Shot Learning28 Sep 2023
- 2023Compositionally Equivariant Representation Learning13 Jun 2023
12 newest of 49 All 49 (JSON)