A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Large Language Models (LLMs) have achieved strong performance across a wide range of natural language processing tasks in recent years, including machine translation, text generation, and question answering. As their applications extend to increasingly complex scenarios, however, LLMs continue to face challenges in tasks that require deep reasoning and logical inference. In particular, models trained on large scale textual corpora may incorporate noisy or irrelevant information during generation, which can lead to incorrect predictions or outputs that are inconsistent with factual knowledge. To address this limitation, we propose a stepwise reasoning enhancement framework for LLMs based on external subgraph generation, termed SGR. The proposed framework dynamically constructs query relevant subgraphs from external knowledge bases and leverages their semantic structure to guide the reasoning process. By performing reasoning in a step by step manner over structured subgraphs, SGR reduces the influence of noisy information and improves reasoning accuracy. Specifically, the framework first generates an external subgraph tailored to the input query, then guides the model to conduct multi step reasoning grounded in the subgraph, and finally integrates multiple reasoning paths to produce the final answer. Experimental results on multiple benchmark datasets demonstrate that SGR consistently outperforms strong baselines, indicating its effectiveness in enhancing the reasoning capabilities of LLMs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 6 of its 26 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
6 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2020Open Question Answering over Tables and Textcited by 163
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
- 2019Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answeringcited by 48
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation
- 2025KnowPath: Knowledge-enhanced Reasoning via LLM-generated Inference Paths over Knowledge Graphs
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
- 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Models
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
- 2023Graph Elicitation for Guiding Multi-Step Reasoning in Large Language Models
- 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph