mlsanityData to 14 Oct 2026

The Vocabulary Gap Is an Equity Gap: Register Mismatch in Retrieval Systems for Public-Benefits Access

arXiv 2609.01645 ↗First posted 28 Aug 2026cs.IRcited by 0

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-augmented question answering is increasingly used to help people navigate public-benefits eligibility, yet the documents these systems retrieve from are written in agency register while intended users often ask questions in plain, informal, or non-native English. We show that this register mismatch can turn a high-performing retrieval system into an inequitable one. We construct a controlled benchmark of 51 publicly documented federal benefit-eligibility rules and 25 information needs, each phrased in both agency register and plain user register while keeping the gold passage fixed. Across BM25, TF-IDF, and a term-graph retriever, formal-register evaluation is nearly perfect (Recall@5 96-100%), but plain-register retrieval collapses (Recall@5 36-44%). For BM25, Recall@1 falls from 84% to 16% and Recall@5 from 100% to 44%, a 56-point equity gap on identical information needs. We trace the mechanism to a measurable vocabulary gap: formal queries share 0.63 of their content terms with the gold passage, while plain queries share only 0.11, a 5.9x reduction. A deliberately simple, auditable plain-to-formal lexicon bridge recovers much of the failure, lifting plain-query BM25 Recall@5 from 44% to 80%. The contribution is not a new retriever; it is an evaluation protocol, benchmark, mechanistic diagnosis, and transparent mitigation for a high-stakes social-impact failure mode that standard retrieval evaluation hides.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 3 of its 7 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

3 of 7 references.

References · 3

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  3. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Retrieval Challenges in Low-Resource Public Service Information: A Case Study on Food Pantry Access
  2. 2025LLM-Specific Utility for Retrieval-Augmented Generation
  3. 2026Retrieval Sensitivity to Identity Signals in Queries
  4. 2026RAGAL: A Frugal, Fully Local Retrieval-Augmented Assistant for Technical Support at a Government Agency
  5. 2026RAC: Retrieval-Augmented Clarification for Faithful Conversational Search
  6. 2025Redefining Retrieval Evaluation in the Era of LLMs
  7. 2026Why RAGs Hallucinate: Penalty-Aware Evaluation of Retrieval-Augmented Generation Systems with Knowledge-Gap Canaries
  8. 2025Out of Style: RAG's Fragility to Linguistic Variation