RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored
Not on the map. Why?
Abstract (arXiv)
LLM responses are based on the internet (via training or RAG), and AI is now used to generate a significant amount of content online (Paredes et al., 2026), creating the potential for a self-reinforcing feedback loop. Prior work has shown that when LLMs are recursively trained on their own output, they experience model collapse (Shumailov et al., 2024): responses become less diverse, and eventually no longer resemble the original training data. In this paper, we show that a similar collapse occurs if LLM-based AI systems retrieve references they authored using a search tool. We call this RAG collapse. We conduct extensive experiments with three types of simulations of AI systems retrieving references they generated, using three model families, and 1,019 information-seeking prompts, totaling 1,528 simulations and over one million LLM API calls, and find that 79.6% (1,216/1,528) of simulations end in collapse. Surprisingly, even a single self-authored reference can trigger collapse because the LLM disproportionately cites its own content. This self-bias persists even after controlling for reference quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
9 of 15 references.
References · 9
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
- 2024AI and the Problem of Knowledge Collapsecited by 34
- 2024Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Modelscited by 10
- 2025LLM Web Dynamics: Tracing Model Collapse in a Network of LLMscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024A Tale of Trust and Accuracy: Base vs. Instruct LLMs in RAG Systems
- 2025Post-training an LLM for RAG? Train on Self-Generated Demonstrations
- 2026Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAG
- 2024Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
- 2025Do RAG Systems Really Suffer From Positional Bias?
- 2024Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models