Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
Machine learning especially deep neural networks have achieved great success but many of them often rely on a number of labeled samples for supervision. As sufficient labeled training data are not always ready due to e.g., continuously emerging prediction targets and costly sample annotation in real world applications, machine learning with sample shortage is now being widely investigated. Among all these studies, many prefer to utilize auxiliary information including those in the form of Knowledge Graph (KG) to reduce the reliance on labeled samples. In this survey, we have comprehensively reviewed over 90 papers about KG-aware research for two major sample shortage settings -- zero-shot learning (ZSL) where some classes to be predicted have no labeled samples, and few-shot learning (FSL) where some classes to be predicted have only a small number of labeled samples that are available. We first introduce KGs used in ZSL and FSL as well as their construction methods, and then systematically categorize and summarize KG-aware ZSL and FSL methods, dividing them into different paradigms such as the mapping-based, the data augmentation, the propagation-based and the optimization-based. We next present different applications, including not only KG augmented prediction tasks such as image classification, question answering, text classification and knowledge extraction, but also KG completion tasks, and some typical evaluation resources for each task. We eventually discuss some challenges and open problems from different perspectives.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 106 of its 201 references that are in the map. First posted on arXiv 18 Dec 2021.
Builds on
106 of 201 references.
References · 106
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
38 more
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020Knowledge Graphscited by 621
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 463
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2016FastText.zip: Compressing text classification modelscited by 335
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2019Abductive Commonsense Reasoningcited by 301
- 2021An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQAcited by 301
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
- 2017Feature Generating Networks for Zero-Shot Learningcited by 257
- 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 252
- 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2016Learning Deep Representations of Fine-grained Visual Descriptionscited by 182
- 2016FVQA: Fact-based Visual Question Answeringcited by 181
- 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
- 2015Label-Embedding for Image Classificationcited by 165
- 2018Zero-shot Recognition via Semantic Embeddings and Knowledge Graphscited by 155
- 2013Zero-Shot Learning by Convex Combination of Semantic Embeddingscited by 135
- 2017Semantic Autoencoder for Zero-Shot Learningcited by 133
- 2020KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQAcited by 125
- 2019Zero-Shot Entity Linking by Reading Entity Descriptionscited by 124
- 2016Synthesized Classifiers for Zero-Shot Learningcited by 113
- 2017Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approachcited by 102
- 2017A Generative Adversarial Approach for Zero-Shot Learning from Noisy Textscited by 96
- 2018Rethinking Knowledge Graph Propagation for Zero-Shot Learningcited by 87
- 2021Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challengecited by 80
- 2020Message Passing for Hyper-Relational Knowledge Graphscited by 79
- 2018One-Shot Relational Learning for Knowledge Graphscited by 78
- 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
- 2017Multi-Label Zero-Shot Learning with Structured Knowledge Graphscited by 72
- 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
- 2017Open-World Knowledge Graph Completioncited by 64
- 2019Few-Shot Knowledge Graph Completioncited by 63
50 most cited of 106 All 106 (JSON)
Built on by
Citing papers per year: 2023: 8; 2024: 8; 2025: 5; 2026: 2.
23 papers.
Sort:
By area:
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 21
- 2023Ziya2: Data-centric Learning is All LLMs Needcited by 15
- 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learningcited by 12
- 2024Ontology Embedding: A Survey of Methods, Applications and Resourcescited by 12
- 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunitiescited by 10
- 2023Sample-Efficient Learning of Novel Visual Conceptscited by 8
- 2023Knowledge-augmented Few-shot Visual Relation Detectioncited by 5
- 2023Geometry-Aware Adaptation for Pretrained Modelscited by 5
11 more
- 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
- 2024LLM Online Spatial-temporal Signal Reconstruction Under Noisecited by 3
- 2023Beyond Transduction: A Survey on Inductive, Few Shot, and Zero Shot Link Prediction in Knowledge Graphscited by 2
- 2026Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encodingcited by 2
- 2025Pseudo-Knowledge Graph: Meta-Path Guided Retrieval and In-Graph Text for RAG-Equipped LLMcited by 1
- 2025Maps for Autonomous Driving: Full-process Survey and Frontierscited by 1
- 2025A systematic review of relation extraction task since the emergence of Transformerscited by 1
- 2024Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learningcited by 0
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learningcited by 0
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Expertscited by 0
- 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applicationscited by 0
- 2026Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encoding13 Feb 2026
- 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications29 Jan 2026
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025Maps for Autonomous Driving: Full-process Survey and Frontiers16 Sep 2025
- 2025A Survey of Link Prediction in N-ary Knowledge Graphs10 Jun 2025
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Experts1 Apr 2025
- 2025Pseudo-Knowledge Graph: Meta-Path Guided Retrieval and In-Graph Text for RAG-Equipped LLM1 Mar 2025
- 2024LLM Online Spatial-temporal Signal Reconstruction Under Noise24 Nov 2024
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learning13 Sep 2024
- 2024Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning19 Aug 2024
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2024Ontology Embedding: A Survey of Methods, Applications and Resources16 Jun 2024
11 more
- 2024Towards Graph Contrastive Learning: A Survey and Beyond20 May 2024
- 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning15 Apr 2024
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applications2 Mar 2024
- 2023Beyond Transduction: A Survey on Inductive, Few Shot, and Zero Shot Link Prediction in Knowledge Graphs8 Dec 2023
- 2023Ziya2: Data-centric Learning is All LLMs Need6 Nov 2023
- 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunities29 Sep 2023
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignment30 Jul 2023
- 2023Geometry-Aware Adaptation for Pretrained Models23 Jul 2023
- 2023Sample-Efficient Learning of Novel Visual Concepts15 Jun 2023
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations6 May 2023
- 2023Knowledge-augmented Few-shot Visual Relation Detection9 Mar 2023
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 21
- 2023Ziya2: Data-centric Learning is All LLMs Needcited by 15
- 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learningcited by 12
- 2024Ontology Embedding: A Survey of Methods, Applications and Resourcescited by 12
- 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunitiescited by 10
- 2023Sample-Efficient Learning of Novel Visual Conceptscited by 8
- 2023Knowledge-augmented Few-shot Visual Relation Detectioncited by 5
- 2023Geometry-Aware Adaptation for Pretrained Modelscited by 5
- 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
- 2024LLM Online Spatial-temporal Signal Reconstruction Under Noisecited by 3
12 most cited of 20 All 20 (JSON)
- 2026Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encoding13 Feb 2026
- 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications29 Jan 2026
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025A Survey of Link Prediction in N-ary Knowledge Graphs10 Jun 2025
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Experts1 Apr 2025
- 2025Pseudo-Knowledge Graph: Meta-Path Guided Retrieval and In-Graph Text for RAG-Equipped LLM1 Mar 2025
- 2024LLM Online Spatial-temporal Signal Reconstruction Under Noise24 Nov 2024
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learning13 Sep 2024
- 2024Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning19 Aug 2024
- 2024Ontology Embedding: A Survey of Methods, Applications and Resources16 Jun 2024
- 2024Towards Graph Contrastive Learning: A Survey and Beyond20 May 2024
- 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning15 Apr 2024
12 newest of 20 All 20 (JSON)