RSF-GLLM: Bridging the Semantic Gap in Multi-Hop Knowledge Graph QA via Recurrent Soft-Flow and Decoupled LLM Generation
Not on the map. Why?
Abstract (arXiv)
Multi-hop Question Answering over Knowledge Graphs faces a critical challenge: traditional retrieve-then-read pipelines break differentiability, preventing the retriever from learning to bridge the semantic gap where intermediate nodes lack lexical overlap with the query. To address this, we propose RSF-GLLM, a framework decoupling differentiable graph reasoning from answer generation. Our Recurrent Soft-Flow (RSF) module employs a GRU-guided query updater to propagate continuous relevance scores, utilizing a dynamic gating mechanism to traverse semantically dissimilar bridge nodes via structural cues. We introduce flow sparsity regularization to theoretically guarantee convergence from soft probabilities to discrete reasoning paths. These paths are extracted and textualized to fine-tune a Large Language Model (LLM), ensuring generation is grounded in factual topology. Experiments on WebQSP and CWQ demonstrate that RSF-GLLM achieves competitive performance with superior inference efficiency compared to LLM based computationally expensive approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
28 of 38 references.
References · 28
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2020Knowledge Graphscited by 621
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
16 more
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
- 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
- 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 122
- 2019Learning by Abstraction: The Neural State Machinecited by 113
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 103
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
- 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Modelscited by 43
- 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering
- 2025Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search
- 2026Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting
- 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
- 2025Inference Scaled GraphRAG: Improving Multi Hop Question Answering on Knowledge Graphs
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering