mlsanityData to 7 Oct 2026

Masking or Mitigating? Deconstructing the Impact of Query Rewriting on Retriever Biases in RAG

arXiv 2604.06097 ↗First posted 7 Apr 2026cs.IRcited by 0

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Dense retrievers in retrieval-augmented generation (RAG) systems exhibit systematic biases -- including brevity, position, literal matching, and repetition biases -- that can compromise retrieval quality. Query rewriting techniques are now standard in RAG pipelines, yet their impact on these biases remains unexplored. We present the first systematic study of how query enhancement techniques affect dense retrieval biases, evaluating five methods across six retrievers. Our findings reveal that simple LLM-based rewriting achieves the strongest aggregate bias reduction (54%), yet fails under adversarial conditions where multiple biases combine. Mechanistic analysis uncovers two distinct mechanisms: simple rewriting reduces bias through increased score variance, while pseudo-document generation methods achieve reduction through genuine decorrelation from bias-inducing features. However, no technique uniformly addresses all biases, and effects vary substantially across retrievers. Our results provide practical guidance for selecting query enhancement strategies based on specific bias vulnerabilities. More broadly, we establish a taxonomy distinguishing query-document interaction biases from document encoding biases, clarifying the limits of query-side interventions for debiasing RAG systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 41 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

28 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence6 Mar

Other references · 27

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  3. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  4. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  5. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  6. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  7. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  8. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 258
  9. 2022RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encodercited by 118
  10. 2022ReACC: A Retrieval-Augmented Code Completion Frameworkcited by 117
  11. 2023How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrievalcited by 116
  12. 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
15 more
  1. 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
  2. 2024RaFe: Ranking Feedback Improves Query Rewriting for RAGcited by 47
  3. 2022Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Modelcited by 32
  4. 2022What Are You Token About? Dense Retrieval as Distributions Over the Vocabularycited by 28
  5. 2024SLM-Mod: Small Language Models Surpass LLMs at Content Moderationcited by 27
  6. 2024Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrievalcited by 13
  7. 2025MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governancecited by 13
  8. 2025EnronQA: Towards Personalized RAG over Private Documentscited by 8
  9. 2025GuRE:Generative Query REwriter for Legal Passage Retrievalcited by 6
  10. 2025PIR-RAG: A System for Private Information Retrieval in Retrieval-Augmented Generationcited by 4
  11. 2026The Hidden Toll of Social Media News: Causal Effects on Psychosocial Wellbeingcited by 4
  12. 2025Detecting Early and Implicit Suicidal Ideation via Longitudinal and Information Environment Signals on Social Mediacited by 3
  13. 2026VASTU: Language Models Struggle to Recognize Online Community Valuescited by 3
  14. 2026Answer Bubbles: Information Exposure in AI-Mediated Searchcited by 3
  15. 2026Does Reasoning Make Search More Fair? Comparing Fairness in Reasoning and Non-Reasoning Rerankerscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Better Together: Complementary Query Rewriting Under a Strong RAG Baseline
  2. 2024DMQR-RAG: Diverse Multi-Query Rewriting for RAG
  3. 2025Mitigating Bias in RAG: Controlling the Embedder
  4. 2026How You Ask Matters! Adaptive RAG Robustness to Query Variations
  5. 2026Fairness-Aware Retrieval Optimization for Retrieval-Augmented Generation
  6. 2025Do RAG Systems Really Suffer From Positional Bias?
  7. 2025QE-RAG: A Robust Retrieval-Augmented Generation Benchmark for Query Entry Errors
  8. 2024RAGGED: Towards Informed Design of Scalable and Stable RAG Systems