mlsanityData to 7 Oct 2026

Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals

arXiv 2101.03737 ↗First posted 11 Jan 2021cs.CL cs.AIcited by 100

Not on the map. Why?

Cited by 34 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Multi-hop Knowledge Base Question Answering (KBQA) aims to find the answer entities that are multiple hops away in the Knowledge Base (KB) from the entities in the question. A major challenge is the lack of supervision signals at intermediate steps. Therefore, multi-hop KBQA algorithms can only receive the feedback from the final answer, which makes the learning unstable or ineffective. To address this challenge, we propose a novel teacher-student approach for the multi-hop KBQA task. In our approach, the student network aims to find the correct answer to the query, while the teacher network tries to learn intermediate supervision signals for improving the reasoning capacity of the student network. The major novelty lies in the design of the teacher network, where we utilize both forward and backward reasoning to enhance the learning of intermediate entity distributions. By considering bidirectional reasoning, the teacher network can produce more reliable intermediate supervision signals, which can alleviate the issue of spurious reasoning. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our approach on the KBQA task. The code to reproduce our analysis is available at https://github.com/RichardHGL/WSDM2021_NSM.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 11 Jan 2021.

Builds on

24 of 40 references.

References · 24

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2017Graph Attention Networkscited by 8,854
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  6. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  7. 2017Deep Mutual Learningcited by 621
  8. 2018Born Again Neural Networkscited by 539
  9. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
  10. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  11. 2018Compositional Attention Networks for Machine Reasoningcited by 183
  12. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
12 more
  1. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  2. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 167
  3. 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
  4. 2019Multi-hop Reading Comprehension through Question Decomposition and Rescoringcited by 119
  5. 2019Learning by Abstraction: The Neural State Machinecited by 113
  6. 2018Multi-Hop Knowledge Graph Reasoning with Reward Shapingcited by 102
  7. 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 101
  8. 2019Language-Conditioned Graph Networks for Relational Reasoningcited by 55
  9. 2019Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering Systemcited by 43
  10. 2016Question Answering on Freebase via Relation Extraction and Textual Evidencecited by 39
  11. 2019Compact Trilinear Interaction for Visual Question Answeringcited by 24
  12. 2018Attention-Guided Answer Distillation for Machine Reading Comprehensioncited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 11; 2023: 21; 2024: 16; 2025: 19; 2026: 21.

100 papers.

Sort:

By area:

  1. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  2. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  3. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  4. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
  5. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  6. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
  7. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
  8. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  9. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 90
  10. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 83
  11. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  12. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 77
38 more
  1. 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
  2. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  3. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  4. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  5. 2023ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Modelscited by 44
  6. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
  7. 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
  8. 2023KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Modelscited by 32
  9. 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
  10. 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
  11. 2024Knowledge Graph-Enhanced Large Language Models via Path Selectioncited by 28
  12. 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
  13. 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graphcited by 23
  14. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graphcited by 22
  15. 2023FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answeringcited by 21
  16. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  17. 2021UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Textcited by 17
  18. 2023Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQAcited by 17
  19. 2021Outlining and Filling: Hierarchical Query Graph Generation for Answering Complex Questions over Knowledge Graphscited by 16
  20. 2022ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphscited by 16
  21. 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLMcited by 16
  22. 2024Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrievalcited by 16
  23. 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaborationcited by 16
  24. 2025Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answeringcited by 15
  25. 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
  26. 2024TrustUQA: A Trustful Framework for Unified Structured Data Question Answeringcited by 12
  27. 2021Beyond NED: Fast and Effective Search Space Reduction for Complex Question Answering over Knowledge Basescited by 11
  28. 2023Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQAcited by 11
  29. 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 11
  30. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answeringcited by 10
  31. 2021Towards Transparent Interactive Semantic Parsing via Step-by-Step Correctioncited by 9
  32. 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphscited by 9
  33. 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphscited by 8
  34. 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generationcited by 8
  35. 2021Improving Embedded Knowledge Graph Multi-hop Question Answering by introducing Relational Chain Reasoningcited by 7
  36. 2021Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graphcited by 7
  37. 2023Pay More Attention to Relation Exploration for Knowledge Base Question Answeringcited by 7
  38. 2023NuTrea: Neural Tree Search for Context-guided Multi-hop KGQAcited by 7

50 most cited of 100 All 100 (JSON)