mlsanityData to 14 Oct 2026

Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering

arXiv 2610.08388 ↗First posted 6 Oct 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large language models (LLMs) have demonstrated strong capabilities in question answering, yet they still frequently suffer from hallucinations on knowledge-intensive tasks. Knowledge graphs (KGs) provide LLMs with structured, interpretable, and updatable factual grounding, making them a promising external knowledge source for reliable reasoning. However, existing LLM-guided graph reasoning methods typically rely on hop-wise greedy or beam-style pruning during evidence retrieval. Such local decision processes are inherently myopic: evidence that appears weak near the source may become crucial only after deeper graph context is explored, causing answer-critical branches to be discarded prematurely and making the reasoning chain difficult to recover. To address this limitation, we propose Foresight-over-Graph (FoG), a foresight-aware evidence retrieval framework for knowledge base question answering (KBQA). FoG iteratively constructs a question-relevant evidence subgraph and uses far-to-near feedback to guide path exploration, and maintains a compact memory subgraph to support continued exploration. Extensive experiments on widely used KBQA benchmarks demonstrate that FoG achieves state-of-the-art performance, with a particularly large improvement of 16.58% in Hit on CWQ, while also reducing LLM calls and token usage. Our code is available at https://github.com/yhong7/FoG .

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 42 references that are in the map. First posted on arXiv 6 Oct 2026.

Builds on

5 of 42 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation28 Oct
  2. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec

Other references · 3

  1. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  2. 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodescited by 26
  3. 2024Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answeringcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
  2. 2025ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge Graphs
  3. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models
  4. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
  5. 2025EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answering
  6. 2025The Role of Exploration Modules in Small Language Models for Knowledge Graph Question Answering
  7. 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
  8. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph