The Attribution Blind Spot: Detecting When Language Models Rely on Memory Rather Than Retrieved Context
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Retrieval-augmented generation promises to ground language model outputs in external evidence, yet the field has no reliable way to verify whether retrieved context actually governs generation -- a prerequisite for any high-stakes deployment. The standard assumption, that context-consistent output implies context-governed output, breaks when the retrieved document overlaps with the model's pretraining data: the model can produce faithful-looking text entirely from parametric memory, and both pathways yield indistinguishable output. We name this failure the attribution blind spot and introduce Computational Reality Monitoring (CRM) to address it. CRM operationalizes a principle adapted from cognitive science's reality monitoring framework: comparing internal representations with and without context reveals membership-conditioned representational divergence that output-level monitors systematically miss. CRM does not certify which source an individual generation used; it detects whether pretraining exposure leaves a measurable internal trajectory signature, establishing a necessary substrate for source attribution. Across nine model variants spanning three families, this divergence concentrates in architecture-specific layer patterns, receives converging support from block-level noise intervention, and generalizes across tasks and datasets while collapsing on domain-confounded benchmarks. The attribution blind spot is measurable and partially addressable: internal representations carry a diagnostic signal invisible at the output level, establishing a foundation for systems whose internal awareness of evidence provenance governs their external behavior.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 34 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
19 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
6 more
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2023Evaluating Verifiability in Generative Search Enginescited by 303
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 283
- 2018Analysis Methods in Neural Language Processing: A Surveycited by 277
- 2023Membership Inference Attacks against Language Models via Neighbourhood Comparisoncited by 258
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Attribution Blind Spot: Layerwise Trajectory Diagnostics for Source Reliance in Retrieval-Augmented Language Models
- 2026Probing for Knowledge Attribution in Large Language Models
- 2026Grounding Without Corrective Control: Truth-Tracking Profiles for Large Language Models
- 2026From Architecture to Output: Structural Origins of Hallucination in Large Language Models and the Amplifying Role of Data
- 2024Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models
- 2023Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models
- 2024Investigating Context-Faithfulness in Large Language Models: The Roles of Memory Strength and Evidence Style
- 2025Tracing Facts or just Copies? A critical investigation of the Competitions of Mechanisms in Large Language Models