Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Large language models (LLMs) have demonstrated strong capabilities in question answering, yet they still frequently suffer from hallucinations on knowledge-intensive tasks. Knowledge graphs (KGs) provide LLMs with structured, interpretable, and updatable factual grounding, making them a promising external knowledge source for reliable reasoning. However, existing LLM-guided graph reasoning methods typically rely on hop-wise greedy or beam-style pruning during evidence retrieval. Such local decision processes are inherently myopic: evidence that appears weak near the source may become crucial only after deeper graph context is explored, causing answer-critical branches to be discarded prematurely and making the reasoning chain difficult to recover. To address this limitation, we propose Foresight-over-Graph (FoG), a foresight-aware evidence retrieval framework for knowledge base question answering (KBQA). FoG iteratively constructs a question-relevant evidence subgraph and uses far-to-near feedback to guide path exploration, and maintains a compact memory subgraph to support continued exploration. Extensive experiments on widely used KBQA benchmarks demonstrate that FoG achieves state-of-the-art performance, with a particularly large improvement of 16.58% in Hit on CWQ, while also reducing LLM calls and token usage. Our code is available at https://github.com/yhong7/FoG .
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 42 references that are in the map. First posted on arXiv 6 Oct 2026.
Builds on
5 of 42 references.
Closest ancestors · 2
Same direction, newest first
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation28 Oct
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec
Other references · 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
- 2025ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge Graphs
- 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
- 2025EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answering
- 2025The Role of Exploration Modules in Small Language Models for Knowledge Graph Question Answering
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
- 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph