mlsanityData to 14 Oct 2026

After Retrieval, Before Generation: Enhancing the Trustworthiness of Large Language Models in Retrieval-Augmented Generation

arXiv 2505.17118 ↗First posted 21 May 2025cs.CLcited by 4

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-augmented generation (RAG) is a promising paradigm, yet its trustworthiness remains a critical concern. A major vulnerability arises prior to generation: models often fail to balance parametric (internal) and retrieved (external) knowledge, particularly when the two sources conflict or are unreliable. To analyze these scenarios comprehensively, we construct the Trustworthiness Response Dataset (TRD) with 36,266 questions spanning four RAG settings. We reveal that existing approaches address isolated scenarios-prioritizing one knowledge source, naively merging both, or refusing answers-but lack a unified framework to handle different real-world conditions simultaneously. Therefore, we propose the BRIDGE framework, which dynamically determines a comprehensive response strategy of large language models (LLMs). BRIDGE leverages an adaptive weighting mechanism named soft bias to guide knowledge collection, followed by a Maximum Soft-bias Decision Tree to evaluate knowledge and select optimal response strategies (trust internal/external knowledge, or refuse). Experiments show BRIDGE outperforms baselines by 5-15% in accuracy while maintaining balanced performance across all scenarios. Our work provides an effective solution for LLMs' trustworthy responses in real-world RAG applications.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 31 of its 44 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

31 of 44 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales19 Jun
  2. 2024Tug-of-War Between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models22 Feb
  3. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct
  4. 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise2 May

Other references · 27

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  7. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  8. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  9. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  10. 2021Ethical and social risks of harm from Language Modelscited by 966
  11. 2023Large Language Modelscited by 780
  12. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
15 more
  1. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
  2. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 235
  3. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
  4. 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
  5. 2022Large Language Models with Controllable Working Memorycited by 169
  6. 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 159
  7. 2024Certifiably Robust RAG against Retrieval Corruptioncited by 151
  8. 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 125
  9. 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
  10. 2023TrueTeacher: Learning Factual Consistency Evaluation with Large Language Modelscited by 83
  11. 2024Speculative RAG: Enhancing Retrieval Augmented Generation through Draftingcited by 77
  12. 2024ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLMcited by 73
  13. 2024Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refusecited by 34
  14. 2023Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanismcited by 33
  15. 2024PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-designcited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Survey
  2. 2026Trust or Abstain? A Self-Aware RAG Approach
  3. 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  4. 2025Response Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factuality
  5. 2025Investigating the Robustness of Retrieval-Augmented Generation at the Query Level
  6. 2025Evaluating the Retrieval Robustness of Large Language Models
  7. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
  8. 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning