From Query to Logic: Ontology-Driven Multi-Hop Reasoning in LLMs
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Large Language Models (LLMs), despite their success in question answering, exhibit limitations in complex multi-hop question answering (MQA) tasks that necessitate non-linear, structured reasoning. This limitation stems from their inability to adequately capture deep conceptual relationships between entities. To overcome this challenge, we present **ORACLE** (**O**ntology-driven **R**easoning **A**nd **C**hain for **L**ogical **E**ucidation), a training-free framework that combines LLMs' generative capabilities with the structural benefits of knowledge graphs. Our approach operates through three stages: (1) dynamic construction of question-specific knowledge ontologies using LLMs, (2) transformation of these ontologies into First-Order Logic reasoning chains, and (3) systematic decomposition of the original query into logically coherent sub-questions. Experimental results on several standard MQA benchmarks show that our framework achieves highly competitive performance, rivaling current state-of-the-art models like DeepSeek-R1. Detailed analyses further confirm the effectiveness of each component, while demonstrating that our method generates more logical and interpretable reasoning chains than existing approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 4 of its 31 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
4 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Credible Plan-Driven RAG Method for Multi-Hop Question Answeringcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
- 2024MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge
- 2025Knowledge Editing for Multi-Hop Question Answering Using Semantic Analysis
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis
- 2025Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
- 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environments
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering