ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has emerged as a powerful architecture for Question Answering (QA) by integrating external information into Large Language Models (LLMs). However, false, inaccurate, and misleading information in news and social media poses a serious challenge to real-world RAG systems, especially in multi-hop QA, where complex multi-step reasoning can be misled by even a single deceptive misinformation segment in the retrieved documents. Existing approaches mainly rely on implicit alignment or explicit regulation, but their limited ability to assess fine-grained information reliability makes them vulnerable to deceptive misinformation that is semantically relevant to the question yet factually incorrect, leading to erroneous answers. To address this limitation, we propose ReliableRAG, which, to the best of our knowledge, is the first reliability-driven framework that mitigates deceptive misinformation in multi-hop QA through fine-grained evaluation of individual triples. ReliableRAG first extracts information segments from source documents and represents them as structured triples. It then quantifies triple reliability by combining query-triple semantic relevance with triple credibility, retaining only the top-K reliable and non-redundant triples. Based on these refined triples, ReliableRAG autoregressively constructs robust reasoning chains to consolidate trustworthy evidence and filter deceptive misinformation, producing accurate answers faithful to reliable information. Experiments on three multi-hop QA datasets show that ReliableRAG outperforms existing methods, substantially improving the factual reliability and robustness of RAG systems under deceptive misinformation injection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 48 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
9 of 48 references.
References · 9
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Surveycited by 83
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 28
- 2024Towards More Robust Retrieval-Augmented Generation: Evaluating RAG Under Adversarial Poisoning Attackscited by 14
- 2024Evaluating the Retrieval Component in LLM-Based Question Answering Systemscited by 11
- 2025LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searcherscited by 11
- 2025Resisting Contextual Interference in RAG via Parametric-Knowledge Reinforcementcited by 11
- 2025ALoFTRAG: Automatic Local Fine Tuning for Retrieval Augmented Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ERA: Evidence-based Reliability Alignment for Honest Retrieval-Augmented Generation
- 2026RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generation
- 2026CQC-RAG: Robust Retrieval-Augmented Generation via Cross-Query Consistency
- 2026Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval
- 2026Beyond Factual Accuracy: Evaluating Global Reasoning Integrity in RAG Systems with LogicScore
- 2026S2G-RAG: Structured Sufficiency and Gap Judging for Iterative Retrieval-Augmented QA
- 2024Retrieval-Augmented Generation with Estimation of Source Reliability
- 2026Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning