mlsanityData to 14 Oct 2026

Enhancing Document-Level Question Answering via Multi-Hop Retrieval-Augmented Generation with LLaMA 3

arXiv 2506.16037 ↗First posted 19 Jun 2025cs.CL cs.LGcited by 1

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

This paper presents a novel Retrieval-Augmented Generation (RAG) framework tailored for complex question answering tasks, addressing challenges in multi-hop reasoning and contextual understanding across lengthy documents. Built upon LLaMA 3, the framework integrates a dense retrieval module with advanced context fusion and multi-hop reasoning mechanisms, enabling more accurate and coherent response generation. A joint optimization strategy combining retrieval likelihood and generation cross-entropy improves the model's robustness and adaptability. Experimental results show that the proposed system outperforms existing retrieval-augmented and generative baselines, confirming its effectiveness in delivering precise, contextually grounded answers.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 4 of its 13 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

4 of 13 references.

References · 4

  1. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
  2. 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
  3. 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generationcited by 17
  4. 2025Optimizing Retrieval Strategies for Financial Question Answering Documents in Retrieval-Augmented Generation Systemscited by 9

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Transforming Questions and Documents for Semantically Aligned Retrieval-Augmented Generation
  2. 2024Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering
  3. 2025Optimizing Multi-Hop Document Retrieval Through Intermediate Representations
  4. 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach
  5. 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answering
  6. 2026CIRAG: Construction-Integration Retrieval and Adaptive Generation for Multi-hop Question Answering
  7. 2025A Comprehensive Evaluation of Transformer-Based Question Answering Models and RAG-Enhanced Design
  8. 2025Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering