mlsanityData to 14 Oct 2026

Few-shot In-context Learning for Knowledge Base Question Answering

arXiv 2305.01750 ↗First posted 2 May 2023cs.CL cs.AIcited by 74

Not on the map. Why?

Cited by 26 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Question answering over knowledge bases is considered a difficult problem due to the challenge of generalizing to a wide variety of possible natural language questions. Additionally, the heterogeneity of knowledge base schema items between different knowledge bases often necessitates specialized training for different knowledge base question-answering (KBQA) datasets. To handle questions over diverse KBQA datasets with a unified training-free framework, we propose KB-BINDER, which for the first time enables few-shot in-context learning over KBQA tasks. Firstly, KB-BINDER leverages large language models like Codex to generate logical forms as the draft for a specific question by imitating a few demonstrations. Secondly, KB-BINDER grounds on the knowledge base to bind the generated draft to an executable one with BM25 score matching. The experimental results on four public heterogeneous KBQA datasets show that KB-BINDER can achieve a strong performance with only a few in-context demonstrations. Especially on GraphQA and 3-hop MetaQA, KB-BINDER can even outperform the state-of-the-art trained models. On GrailQA and WebQSP, our model is also on par with other fully-trained models. We believe KB-BINDER can serve as an important baseline for future research. Our code is available at https://github.com/ltl3A87/KB-BINDER.

Key facts. Cited by 74 papers in the map (data through 14 Oct 2026). Builds on 39 of its 59 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

39 of 59 references.

References · 39

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  7. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  8. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  9. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
  10. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  11. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  12. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
27 more
  1. 2022In-context Learning and Induction Headscited by 964
  2. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
  3. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  4. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  5. 2022PAL: Program-aided Language Modelscited by 652
  6. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  7. 2022Can language models learn from explanations in context?cited by 249
  8. 2022Binding Language Models in Symbolic Languagescited by 228
  9. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  10. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  11. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
  12. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  13. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  14. 2016Language to Logical Form with Neural Attentioncited by 158
  15. 2022Teaching Algorithmic Reasoning via In-context Learningcited by 112
  16. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  17. 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
  18. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
  19. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
  20. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  21. 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
  22. 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
  23. 2022ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question Answeringcited by 48
  24. 2020SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Basescited by 47
  25. 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
  26. 2017Universal Semantic Parsingcited by 21
  27. 2020Few-Shot Complex Knowledge Base Question Answering via Meta Reinforcement Learningcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 13; 2024: 31; 2025: 20; 2026: 10.

74 papers.

Sort:

By area:

  1. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
  2. 2024Visual In-Context Learning for Large Vision-Language Modelscited by 128
  3. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  4. 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 78
  5. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 60
  6. 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
  7. 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
  8. 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environmentscited by 39
  9. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  10. 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Searchcited by 22
  11. 2023Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generationcited by 21
  12. 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLMcited by 16
38 more
  1. 2024CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Eracited by 16
  2. 2024SportQA: A Benchmark for Sports Understanding in Large Language Modelscited by 15
  3. 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
  4. 2023Code-Style In-Context Learning for Knowledge-Based Question Answeringcited by 13
  5. 2024EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systemscited by 13
  6. 2024TrustUQA: A Trustful Framework for Unified Structured Data Question Answeringcited by 12
  7. 2024Video Diffusion Transformers are In-Context Learnerscited by 12
  8. 2023Knowledge Crosswords: Geometric Knowledge Reasoning with Large Language Modelscited by 11
  9. 2023Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQAcited by 11
  10. 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answeringcited by 11
  11. 2024SPAGHETTI: Open-Domain Question Answering from Heterogeneous Data Sources with Retrieval and Semantic Parsingcited by 11
  12. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answeringcited by 10
  13. 2024Reasoning on Efficient Knowledge Paths:Knowledge Graph Guides Large Language Model for Domain Question Answeringcited by 9
  14. 2024Temporal Knowledge Graph Question Answering: A Surveycited by 9
  15. 2023Make a Choice! Knowledge Base Question Answering with In-Context Learningcited by 8
  16. 2024CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail Knowledgecited by 8
  17. 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphscited by 8
  18. 2024LEGO-GraphRAG: Modularizing Graph-based Retrieval-Augmented Generation for Design Space Explorationcited by 7
  19. 2025Reason-Align-Respond: Aligning LLM Reasoning with Knowledge Graphs for KGQAcited by 7
  20. 2023Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context Learningcited by 6
  21. 2024QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanismcited by 6
  22. 2026GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculumcited by 6
  23. 2024Self-Improvement Programming for Temporal Knowledge Graph Question Answeringcited by 5
  24. 2024SPARKLE: Enhancing SPARQL Generation with Direct KG Integration in Decodingcited by 5
  25. 2024TARGA: Targeted Synthetic Data Generation for Practical Reasoning over Structured Datacited by 5
  26. 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
  27. 2024One size doesn't fit all: Predicting the Number of Examples for In-Context Learningcited by 4
  28. 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answeringcited by 4
  29. 2024Few-shot Prompting for Pairwise Ranking: An Effective Non-Parametric Retrieval Modelcited by 4
  30. 2025Self-Reflective Planning with Knowledge Graphs: Enhancing LLM Reasoning Reliability for Question Answeringcited by 4
  31. 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Basescited by 3
  32. 2024CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graphcited by 3
  33. 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
  34. 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answeringcited by 3
  35. 2026CoG: Controllable Graph Reasoning via Relational Blueprints and Failure-Aware Refinement over Knowledge Graphscited by 3
  36. 2026S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answeringcited by 3
  37. 2026Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphscited by 3
  38. 2024BERTologyNavigator: Advanced Question Answering with BERT-based Semanticscited by 2

50 most cited of 74 All 74 (JSON)