After Retrieval, Before Generation: Enhancing the Trustworthiness of Large Language Models in Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Retrieval-augmented generation (RAG) is a promising paradigm, yet its trustworthiness remains a critical concern. A major vulnerability arises prior to generation: models often fail to balance parametric (internal) and retrieved (external) knowledge, particularly when the two sources conflict or are unreliable. To analyze these scenarios comprehensively, we construct the Trustworthiness Response Dataset (TRD) with 36,266 questions spanning four RAG settings. We reveal that existing approaches address isolated scenarios-prioritizing one knowledge source, naively merging both, or refusing answers-but lack a unified framework to handle different real-world conditions simultaneously. Therefore, we propose the BRIDGE framework, which dynamically determines a comprehensive response strategy of large language models (LLMs). BRIDGE leverages an adaptive weighting mechanism named soft bias to guide knowledge collection, followed by a Maximum Soft-bias Decision Tree to evaluate knowledge and select optimal response strategies (trust internal/external knowledge, or refuse). Experiments show BRIDGE outperforms baselines by 5-15% in accuracy while maintaining balanced performance across all scenarios. Our work provides an effective solution for LLMs' trustworthy responses in real-world RAG applications.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 31 of its 44 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
31 of 44 references.
Closest ancestors · 4
Same direction, newest first
- 2024InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales19 Jun
- 2024Tug-of-War Between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models22 Feb
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct
- 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise2 May
Other references · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2023Large Language Modelscited by 780
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
15 more
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
- 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 235
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
- 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
- 2022Large Language Models with Controllable Working Memorycited by 169
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 159
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 151
- 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 125
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2023TrueTeacher: Learning Factual Consistency Evaluation with Large Language Modelscited by 83
- 2024Speculative RAG: Enhancing Retrieval Augmented Generation through Draftingcited by 77
- 2024ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLMcited by 73
- 2024Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refusecited by 34
- 2023Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanismcited by 33
- 2024PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-designcited by 28
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Prompt Control-Flow Integrity: A Priority-Aware Runtime Defense Against Prompt Injection in LLM Systemscited by 1
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generationcited by 1
- 2026Can LLMs Take Retrieved Information with a Grain of Salt?cited by 0
- 2026MIRAGE: Defending Long-Form RAG Against Misinformation Pollutioncited by 0
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation25 Aug 2026
- 2026MIRAGE: Defending Long-Form RAG Against Misinformation Pollution6 Jul 2026
- 2026Can LLMs Take Retrieved Information with a Grain of Salt?7 May 2026
- 2026Prompt Control-Flow Integrity: A Priority-Aware Runtime Defense Against Prompt Injection in LLM Systems19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Survey
- 2026Trust or Abstain? A Self-Aware RAG Approach
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
- 2025Response Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factuality
- 2025Investigating the Robustness of Retrieval-Augmented Generation at the Query Level
- 2025Evaluating the Retrieval Robustness of Large Language Models
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning