CQC-RAG: Robust Retrieval-Augmented Generation via Cross-Query Consistency
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has become a common approach for improving the factuality of Large Language Models (LLMs), yet its reliability remains highly sensitive to how external evidence is retrieved and used. Semantically equivalent queries with different syntactic forms may lead to different retrieval results, while irrelevant or misleading documents can further induce hallucinated answers. Existing multi-path reasoning methods improve robustness by sampling multiple candidate answers and applying voting- or confidence-based selection, but they still face two limitations: diversity is often injected through uncontrollable decoding randomness, and answer evaluation is usually confined to a single query-induced evidence view. To address these limitations, we propose a Cross-Query Consistency Hypothesis: correct answers tend to maintain high confidence across semantically equivalent but syntactically diverse queries, whereas noise-induced hallucinations exhibit unstable confidence under such query variations. Based on this hypothesis, we introduce CQC-RAG, a framework that co-designs query-level diversity injection with cross-query consistency evaluation. CQC-RAG rewrites the original question into diverse but meaning-preserving queries, reranks a shared document pool to construct query-conditioned reasoning contexts, applies an evidence-grounded protocol to extract answer-evidence pairs and selects answers according to their confidence stability across these contexts. This design enables self-evaluation without external supervision and does not rely on expanded retrieval coverage. Experiments on four open-domain question answering benchmarks show that CQC-RAG outperforms the strongest previous multi-query baseline by +4.76 pp EM on TriviaQA and +9.12 pp EM on MuSiQue, validating the effectiveness of cross-query consistency for filtering noise-induced hallucinations.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 31 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
16 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025Out of Style: RAG's Fragility to Linguistic Variation11 Apr
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity21 Mar
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct
Other references · 13
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 187
- 2025Confidence Improves Self-Consistency in LLMscited by 113
- 2024Speculative RAG: Enhancing Retrieval Augmented Generation through Draftingcited by 77
- 2024How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?cited by 44
- 2024RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Modelscited by 25
- 2024SiReRAG: Indexing Similar and Related Information for Multihop Reasoningcited by 23
- 2026Lost in the Noise: How Reasoning Models Fail with Contextual Distractorscited by 8
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Investigating the Robustness of Retrieval-Augmented Generation at the Query Level
- 2025FAIR-RAG: Faithful Adaptive Iterative Refinement for Retrieval-Augmented Generation
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation
- 2026SURE-RAG: Sufficiency and Uncertainty-Aware Evidence Verification for Selective Retrieval-Augmented Generation
- 2026AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
- 2024Semantic Tokens in Retrieval Augmented Generation