mlsanityData to 14 Oct 2026

RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored

arXiv 2608.22118 ↗First posted 22 Aug 2026cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

LLM responses are based on the internet (via training or RAG), and AI is now used to generate a significant amount of content online (Paredes et al., 2026), creating the potential for a self-reinforcing feedback loop. Prior work has shown that when LLMs are recursively trained on their own output, they experience model collapse (Shumailov et al., 2024): responses become less diverse, and eventually no longer resemble the original training data. In this paper, we show that a similar collapse occurs if LLM-based AI systems retrieve references they authored using a search tool. We call this RAG collapse. We conduct extensive experiments with three types of simulations of AI systems retrieving references they generated, using three model families, and 1,019 information-seeking prompts, totaling 1,528 simulations and over one million LLM API calls, and find that 79.6% (1,216/1,528) of simulations end in collapse. Surprisingly, even a single self-authored reference can trigger collapse because the LLM disproportionately cites its own content. This self-bias persists even after controlling for reference quality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

9 of 15 references.

References · 9

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  4. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
  5. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  6. 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
  7. 2024AI and the Problem of Knowledge Collapsecited by 34
  8. 2024Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Modelscited by 10
  9. 2025LLM Web Dynamics: Tracing Model Collapse in a Network of LLMscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Tale of Trust and Accuracy: Base vs. Instruct LLMs in RAG Systems
  2. 2025Post-training an LLM for RAG? Train on Self-Generated Demonstrations
  3. 2026Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAG
  4. 2024Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG
  5. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
  6. 2025Do RAG Systems Really Suffer From Positional Bias?
  7. 2024Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs
  8. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models