Resource-Friendly Dynamic Enhancement Chain for Multi-Hop Question Answering
Not on the map. Why?
Abstract (arXiv)
Knowledge-intensive multi-hop question answering (QA) tasks, which require integrating evidence from multiple sources to address complex queries, often necessitate multiple rounds of retrieval and iterative generation by large language models (LLMs). However, incorporating many documents and extended contexts poses challenges -such as hallucinations and semantic drift-for lightweight LLMs with fewer parameters. This work proposes a novel framework called DEC (Dynamic Enhancement Chain). DEC first decomposes complex questions into logically coherent subquestions to form a hallucination-free reasoning chain. It then iteratively refines these subquestions through context-aware rewriting to generate effective query formulations. For retrieval, we introduce a lightweight discriminative keyword extraction module that leverages extracted keywords to achieve targeted, precise document recall with relatively low computational overhead. Extensive experiments on three multi-hop QA datasets demonstrate that DEC performs on par with or surpasses state-of-the-art benchmarks while significantly reducing token consumption. Notably, our approach attains state-of-the-art results on models with 8B parameters, showcasing its effectiveness in various scenarios, particularly in resource-constrained environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 21 Jun 2025.
Builds on
25 of 33 references.
References · 25
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
13 more
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
- 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 166
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
- 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generationcited by 75
- 2023Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Taskscited by 73
- 2024Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answeringcited by 51
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answeringcited by 35
- 2024Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMscited by 34
- 2024EfficientRAG: Efficient Retriever for Multi-Hop Question Answeringcited by 24
- 2023Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoningcited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering
- 2024Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
- 2025Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering
- 2024Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptability
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering
- 2024Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering
- 2025Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering
- 2026BridgeRAG: Training-Free Bridge-Conditioned Retrieval for Multi-Hop Question Answering