Retrieval Collapses When AI Pollutes the Web
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
The rapid proliferation of AI-generated content on the Web presents a structural risk to information retrieval, as search engines and Retrieval-Augmented Generation (RAG) systems increasingly consume evidence produced by the Large Language Models (LLMs). We characterize this ecosystem-level failure mode as Retrieval Collapse, a two-stage process where (1) AI-generated content dominates search results, eroding source diversity, and (2) low-quality or adversarial content infiltrates the retrieval pipeline. We analyzed this dynamic through controlled experiments involving both high-quality SEO-style content and adversarially crafted content. In the SEO scenario, a 67% pool contamination led to over 80% exposure contamination, creating a homogenized yet deceptively healthy state where answer accuracy remains stable despite the reliance on synthetic sources. Conversely, under adversarial contamination, baselines like BM25 exposed ~19% of harmful content, whereas LLM-based rankers demonstrated stronger suppression capabilities. These findings highlight the risk of retrieval pipelines quietly shifting toward synthetic evidence and the need for retrieval-aware strategies to prevent a self-reinforcing cycle of quality decline in Web-grounded systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 15 of its 20 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
15 of 20 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2018Datasheets for Datasetscited by 1,371
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
- 2023Self-Consuming Generative Models Go MADcited by 239
- 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 155
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 63
- 2023Neural Retrievers are Biased Towards LLM-Generated Contentcited by 37
- 2023Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Imagescited by 13
- 2025Delving into: the quantification of Ai-generated content on the internet (synthetic data)cited by 8
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Pangram 4 Technical Reportcited by 3
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systemscited by 0
- 2026You Can Tell Who's Asking: What the Web's Questions Are Made Of, and Where They Come Fromcited by 0
- 2026You Can Tell Who's Asking: What the Web's Questions Are Made Of, and Where They Come From21 Sep 2026
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026Pangram 4 Technical Report29 Jul 2026
- 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems21 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Safety Degradation in AI Agents
- 2026Relevance as a Vulnerability: How Web Retrieval Degrades Safety Alignment in LLM Agents
- 2026The Synthetic Web: Adversarially-Curated Mini-Internets for Diagnosing Epistemic Weaknesses of Language Agents
- 2025Information Retrieval in the Age of Generative AI: The RGB Model
- 2024Evaluating Robustness of Generative Search Engine on Adversarial Factual Questions
- 2026Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation
- 2024Learning by Surprise: Adaptive Mitigation of Model Collapse in Large Language Models
- 2026When Poison Fails After Retrieval: Revisiting Corpus Poisoning under Chunking and Reranking Pipelines