mlsanityData to 7 Oct 2026

Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering

arXiv 2410.01401 ↗First posted 2 Oct 2024cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Knowledge graph question answering (KGQA) involves answering natural language questions by leveraging structured information stored in a knowledge graph. Typically, KGQA initially retrieve a targeted subgraph from a large-scale knowledge graph, which serves as the basis for reasoning models to address queries. However, the retrieved subgraph inevitably brings distraction information for knowledge utilization, impeding the model's ability to perform accurate reasoning. To address this issue, we propose a Question-guided Knowledge Graph Re-scoring method (Q-KGR) to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. Moreover, we introduce Knowformer, a parameter-efficient method for injecting the re-scored knowledge graph into large language models to enhance their ability to perform factual reasoning. Extensive experiments on multiple KGQA benchmarks demonstrate the superiority of our method over existing systems.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

39 of 57 references.

References · 39

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2017Graph Attention Networkscited by 8,854
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  7. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  8. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  9. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  10. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  11. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  12. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
27 more
  1. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  2. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  3. 2022Mass-Editing Memory in a Transformercited by 976
  4. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  5. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  6. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  7. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  8. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  9. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  10. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  11. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
  12. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  13. 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
  14. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
  15. 2023WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferencescited by 100
  16. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  17. 2017Efficient Algorithms for t-distributed Stochastic Neighborhood Embeddingcited by 75
  18. 2021RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledgecited by 60
  19. 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
  20. 2024Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modelingcited by 44
  21. 2022Kformer: Knowledge Injection in Transformer Feed-Forward Layerscited by 37
  22. 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
  23. 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
  24. 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 21
  25. 2024DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanismscited by 16
  26. 2024Towards Graph Foundation Models for Personalizationcited by 12
  27. 2024Large Language Models for Classical Chinese Poetry Translation: Benchmarking, Evaluating, and Improvingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 5.

13 papers.

Sort:

By area:

  1. 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedbackcited by 86
  2. 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
  3. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 30
  4. 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 16
  5. 2025MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulationcited by 12
  6. 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
  7. 2025DioR: Adaptive Cognitive Detection and Contextual Retrieval Optimization for Dynamic Retrieval-Augmented Generationcited by 7
  8. 2025VersionRAG: Version-Aware Retrieval-Augmented Generation for Evolving Documentscited by 6
  9. 2026Decentralized Attention Fails Centralized Signals: Rethinking Transformers for Medical Time Seriescited by 5
  10. 2024BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognitioncited by 3
  11. 2026Generating Graph-Like Logical Rules for Knowledge Graph Reasoning via Diffusion Modelscited by 0
  12. 2026The Graph Language: How Knowledge Graphs Speak to Large Language Modelscited by 0
1 more
  1. 2026Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answering
  2. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph
  3. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
  4. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models
  5. 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphs
  6. 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains
  7. 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
  8. 2024CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering