Encoder-Free Knowledge-Graph Reasoning with LLMs via Hyperdimensional Path Retrieval
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Recent progress in large language models (LLMs) has made knowledge-grounded reasoning increasingly practical, yet KG-based QA systems often pay a steep price in efficiency and transparency. In typical pipelines, symbolic paths are scored by neural encoders or repeatedly re-ranked by multiple LLM calls, which inflates latency and GPU cost and makes the decision process hard to audit. We introduce PathHD, an encoder-free framework for knowledge-graph reasoning that couples hyperdimensional computing (HDC) with a single LLM call per query. Given a query, PathHD represents relation paths as block-diagonal GHRR hypervectors, retrieves candidate paths using a calibrated blockwise cosine similarity with Top-K pruning, and then performs a one-shot LLM adjudication that outputs the final answer together with supporting, citeable paths. The design is enabled by three technical components: (i) an order-sensitive, non-commutative binding operator for composing multi-hop paths, (ii) a robust similarity calibration that stabilizes hypervector retrieval, and (iii) an adjudication stage that preserves interpretability while avoiding per-path LLM scoring. Across WebQSP, CWQ, and GrailQA, PathHD matches or improves Hits@1 compared to strong neural baselines while using only one LLM call per query, reduces end-to-end latency by 40-60%, and lowers GPU memory by 3-5× due to encoder-free retrieval. Overall, the results suggest that carefully engineered HDC path representations can serve as an effective substrate for efficient and faithful KG-LLM reasoning, achieving a strong accuracy-efficiency-interpretability trade-off.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 52 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
18 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering22 May
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph17 Feb
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning2 Oct
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph15 Jul
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec
Other references · 13
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2024Large Language Models: A Surveycited by 525
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 60
1 more
- 2024Generalized Holographic Reduced Representationscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
- 2025PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language Models
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs
- 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models
- 2025Reasoning of Large Language Models over Knowledge Graphs with Super-Relations
- 2025CHAINSFORMER: Numerical Reasoning on Knowledge Graphs from a Chain Perspective
- 2025KnowPath: Knowledge-enhanced Reasoning via LLM-generated Inference Paths over Knowledge Graphs
- 2025Multi-Hop Reasoning for Question Answering with Hyperbolic Representations