mlsanityData to 14 Oct 2026

DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTS

arXiv 2508.00719 ↗First posted 1 Aug 2025cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Knowledge Graph Question Answering (KGQA) aims to interpret natural language queries and perform structured reasoning over knowledge graphs by leveraging their relational and semantic structures to retrieve accurate answers. Existing methods primarily follow either the retrieve-then-reason paradigm, which relies on Graph Neural Networks or heuristic rules to extract static candidate paths, or dynamic path generation strategies that employ LLMs with prompting to jointly perform retrieval and reasoning. However, the former lacks adaptability due to static path extraction and the absence of contextual refinement, while the latter suffers from high computational costs and limited evaluation accuracy because of their dependence on fixed scoring functions and repeated LLM calls. To address these issues, this paper proposes Dynamically Adaptive MCTS-based Reasoning (DAMR), a novel framework that integrates LLM-guided Monte Carlo Tree Search (MCTS) with adaptive path evaluation to enable efficient and context-aware KGQA. DAMR leverages MCTS as a backbone, where an LLM-based planner selects the top-k semantically relevant relations at each expansion step to effectively reduce the search space. To enhance evaluation accuracy, we introduce a lightweight Transformer-based scorer that performs context-aware plausibility estimation by jointly encoding the question and relation sequence through cross-attention, thereby capturing fine-grained semantic shifts during multi-hop reasoning. Furthermore, to mitigate the scarcity of high-quality supervision, DAMR incorporates a dynamic pseudo-path refinement mechanism that periodically generates training signals from partial paths explored during search, enabling the scorer to continually adapt to the evolving distribution of reasoning trajectories. Extensive experiments on multiple KGQA benchmarks show that DAMR significantly outperforms SOTA methods.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 50 of its 67 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

50 of 67 references.

References · 50

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2024Qwen2 Technical Reportcited by 2,120
  7. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  8. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  9. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  10. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  11. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  12. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
38 more
  1. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  2. 2022Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labelscited by 218
  3. 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
  4. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  5. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  6. 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
  7. 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learningcited by 158
  8. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  9. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 103
  10. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  11. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
  12. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  13. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
  14. 2024Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solvingcited by 84
  15. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  16. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  17. 2024Factuality of Large Language Models: A Surveycited by 66
  18. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
  19. 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
  20. 2023Learning to Generate Better Than Your LLMcited by 49
  21. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 39
  22. 2025MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusioncited by 30
  23. 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graphcited by 23
  24. 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Searchcited by 22
  25. 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answeringcited by 19
  26. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
  27. 2025MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentationcited by 16
  28. 2025Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoningcited by 10
  29. 2023NuTrea: Neural Tree Search for Context-guided Multi-hop KGQAcited by 7
  30. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7
  31. 2025EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answeringcited by 7
  32. 2025Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphscited by 6
  33. 2023DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Textcited by 5
  34. 2024LLM-based Discriminative Reasoning for Knowledge Graph Question Answeringcited by 5
  35. 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
  36. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  37. 2024Zero-Shot Multi-Hop Question Answering via Monte-Carlo Tree Search with Large Language Modelscited by 3
  38. 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
  2. 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
  3. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answering
  4. 2025Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs
  5. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph
  6. 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering
  7. 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
  8. 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering