FVA-RAG: Falsification-Verification Alignment for Mitigating Sycophantic Hallucinations
On the map: Retrieval-augmented generation → Hallucination detection in RAG
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) reduces hallucinations by grounding answers in retrieved evidence, yet standard retrievers often exhibit retrieval sycophancy: they preferentially surface evidence that supports a user's premise, even when the premise is false. We propose FVA-RAG (Falsification-Verification Alignment RAG), a pipeline that inverts the standard RAG workflow by treating the initial response as a draft hypothesis and explicitly retrieving anti-context to stress-test it. We evaluate on the full TruthfulQA-Generation benchmark (N=817) under a fully frozen protocol with 0 live web calls and identical retrieval budgets across methods. Using gpt-4o for generation and deterministic judging, FVA-RAG achieves 79.80-80.05% accuracy across two independently built frozen corpora , significantly outperforming prompted variants of Self-RAG (71.11-72.22%) and CRAG (71.36-73.93%) with p < 10^-6 according to McNemar's test. FVA-RAG triggers falsification on 24.5-29.3% of queries, demonstrating that targeted counter-evidence retrieval is decisive for mitigating premise-confirming hallucinations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Hallucination detection in RAG, one of 15 directions in Retrieval-augmented generation. Builds on 5 of its 11 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
5 of 11 references.
References · 5
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2025Causal-Counterfactual RAG: The Integration of Causal-Counterfactual Reasoning into RAGcited by 2
- 2025Enhancing Retrieval Augmentation via Adversarial Collaborationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models
- 2026Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented Generation
- 2026Retromorphic Testing with Hierarchical Verification for Hallucination Detection in RAG
- 2025Osiris: A Lightweight Open-Source Hallucination Detection System
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems
- 2024100% Elimination of Hallucinations on RAGTruth for GPT-4 and GPT-3.5 Turbo
- 2025The Semantic Illusion: Certified Limits of Embedding-Based Hallucination Detection in RAG Systems
- 2026RAGognizer: Hallucination-Aware Fine-Tuning via Detection Head Integration