DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTS
Not on the map. Why?
Abstract (arXiv)
Knowledge Graph Question Answering (KGQA) aims to interpret natural language queries and perform structured reasoning over knowledge graphs by leveraging their relational and semantic structures to retrieve accurate answers. Existing methods primarily follow either the retrieve-then-reason paradigm, which relies on Graph Neural Networks or heuristic rules to extract static candidate paths, or dynamic path generation strategies that employ LLMs with prompting to jointly perform retrieval and reasoning. However, the former lacks adaptability due to static path extraction and the absence of contextual refinement, while the latter suffers from high computational costs and limited evaluation accuracy because of their dependence on fixed scoring functions and repeated LLM calls. To address these issues, this paper proposes Dynamically Adaptive MCTS-based Reasoning (DAMR), a novel framework that integrates LLM-guided Monte Carlo Tree Search (MCTS) with adaptive path evaluation to enable efficient and context-aware KGQA. DAMR leverages MCTS as a backbone, where an LLM-based planner selects the top-k semantically relevant relations at each expansion step to effectively reduce the search space. To enhance evaluation accuracy, we introduce a lightweight Transformer-based scorer that performs context-aware plausibility estimation by jointly encoding the question and relation sequence through cross-attention, thereby capturing fine-grained semantic shifts during multi-hop reasoning. Furthermore, to mitigate the scarcity of high-quality supervision, DAMR incorporates a dynamic pseudo-path refinement mechanism that periodically generates training signals from partial paths explored during search, enabling the scorer to continually adapt to the evolving distribution of reasoning trajectories. Extensive experiments on multiple KGQA benchmarks show that DAMR significantly outperforms SOTA methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 50 of its 67 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
50 of 67 references.
References · 50
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2024Qwen2 Technical Reportcited by 2,120
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
38 more
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2022Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labelscited by 218
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
- 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
- 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
- 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learningcited by 158
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 103
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
- 2024Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solvingcited by 84
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
- 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
- 2024Factuality of Large Language Models: A Surveycited by 66
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2023Learning to Generate Better Than Your LLMcited by 49
- 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 39
- 2025MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusioncited by 30
- 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graphcited by 23
- 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Searchcited by 22
- 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answeringcited by 19
- 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
- 2025MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentationcited by 16
- 2025Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoningcited by 10
- 2023NuTrea: Neural Tree Search for Context-guided Multi-hop KGQAcited by 7
- 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7
- 2025EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answeringcited by 7
- 2025Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphscited by 6
- 2023DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Textcited by 5
- 2024LLM-based Discriminative Reasoning for Knowledge Graph Question Answeringcited by 5
- 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
- 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
- 2024Zero-Shot Multi-Hop Question Answering via Monte-Carlo Tree Search with Large Language Modelscited by 3
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agentscited by 23
- 2026When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidancecited by 11
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skillscited by 3
- 2026PIME: Prototype-based Interpretable MCTS-Enhanced Brain Network Analysis for Disorder Diagnosiscited by 2
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answeringcited by 0
- 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answeringcited by 0
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills4 Aug 2026
- 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answering11 May 2026
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering13 Apr 2026
- 2026PIME: Prototype-based Interpretable MCTS-Enhanced Brain Network Analysis for Disorder Diagnosis24 Feb 2026
- 2026When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance24 Feb 2026
- 2026Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agents29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
- 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answering
- 2025Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs
- 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering
- 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering