mlsanityData to 14 Oct 2026

Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey

arXiv 2112.10006 ↗First posted 18 Dec 2021cs.LG cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

Machine learning especially deep neural networks have achieved great success but many of them often rely on a number of labeled samples for supervision. As sufficient labeled training data are not always ready due to e.g., continuously emerging prediction targets and costly sample annotation in real world applications, machine learning with sample shortage is now being widely investigated. Among all these studies, many prefer to utilize auxiliary information including those in the form of Knowledge Graph (KG) to reduce the reliance on labeled samples. In this survey, we have comprehensively reviewed over 90 papers about KG-aware research for two major sample shortage settings -- zero-shot learning (ZSL) where some classes to be predicted have no labeled samples, and few-shot learning (FSL) where some classes to be predicted have only a small number of labeled samples that are available. We first introduce KGs used in ZSL and FSL as well as their construction methods, and then systematically categorize and summarize KG-aware ZSL and FSL methods, dividing them into different paradigms such as the mapping-based, the data augmentation, the propagation-based and the optimization-based. We next present different applications, including not only KG augmented prediction tasks such as image classification, question answering, text classification and knowledge extraction, but also KG completion tasks, and some typical evaluation resources for each task. We eventually discuss some challenges and open problems from different perspectives.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 106 of its 201 references that are in the map. First posted on arXiv 18 Dec 2021.

Builds on

106 of 201 references.

References · 106

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2013Auto-Encoding Variational Bayescited by 4,053
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  6. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  7. 2016Matching Networks for One Shot Learningcited by 2,255
  8. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  9. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  10. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  11. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
  12. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
38 more
  1. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  2. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  3. 2020Knowledge Graphscited by 621
  4. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
  5. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 463
  6. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  7. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  8. 2016FastText.zip: Compressing text classification modelscited by 335
  9. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  10. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
  11. 2019Abductive Commonsense Reasoningcited by 301
  12. 2021An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQAcited by 301
  13. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
  14. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  15. 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 252
  16. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
  17. 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
  18. 2016Learning Deep Representations of Fine-grained Visual Descriptionscited by 182
  19. 2016FVQA: Fact-based Visual Question Answeringcited by 181
  20. 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
  21. 2015Label-Embedding for Image Classificationcited by 165
  22. 2018Zero-shot Recognition via Semantic Embeddings and Knowledge Graphscited by 155
  23. 2013Zero-Shot Learning by Convex Combination of Semantic Embeddingscited by 135
  24. 2017Semantic Autoencoder for Zero-Shot Learningcited by 133
  25. 2020KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQAcited by 125
  26. 2019Zero-Shot Entity Linking by Reading Entity Descriptionscited by 124
  27. 2016Synthesized Classifiers for Zero-Shot Learningcited by 113
  28. 2017Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approachcited by 102
  29. 2017A Generative Adversarial Approach for Zero-Shot Learning from Noisy Textscited by 96
  30. 2018Rethinking Knowledge Graph Propagation for Zero-Shot Learningcited by 87
  31. 2021Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challengecited by 80
  32. 2020Message Passing for Hyper-Relational Knowledge Graphscited by 79
  33. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  34. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  35. 2017Multi-Label Zero-Shot Learning with Structured Knowledge Graphscited by 72
  36. 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
  37. 2017Open-World Knowledge Graph Completioncited by 64
  38. 2019Few-Shot Knowledge Graph Completioncited by 63

50 most cited of 106 All 106 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 8; 2024: 8; 2025: 5; 2026: 2.

23 papers.

Sort:

By area:

  1. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  2. 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
  3. 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
  4. 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
  5. 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 21
  6. 2023Ziya2: Data-centric Learning is All LLMs Needcited by 15
  7. 2024CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learningcited by 12
  8. 2024Ontology Embedding: A Survey of Methods, Applications and Resourcescited by 12
  9. 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunitiescited by 10
  10. 2023Sample-Efficient Learning of Novel Visual Conceptscited by 8
  11. 2023Knowledge-augmented Few-shot Visual Relation Detectioncited by 5
  12. 2023Geometry-Aware Adaptation for Pretrained Modelscited by 5
11 more
  1. 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
  2. 2024LLM Online Spatial-temporal Signal Reconstruction Under Noisecited by 3
  3. 2023Beyond Transduction: A Survey on Inductive, Few Shot, and Zero Shot Link Prediction in Knowledge Graphscited by 2
  4. 2026Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encodingcited by 2
  5. 2025Pseudo-Knowledge Graph: Meta-Path Guided Retrieval and In-Graph Text for RAG-Equipped LLMcited by 1
  6. 2025Maps for Autonomous Driving: Full-process Survey and Frontierscited by 1
  7. 2025A systematic review of relation extraction task since the emergence of Transformerscited by 1
  8. 2024Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learningcited by 0
  9. 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learningcited by 0
  10. 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Expertscited by 0
  11. 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applicationscited by 0