mlsanityData to 7 Oct 2026

Delving into: the quantification of Ai-generated content on the internet (synthetic data)

arXiv 2504.08755 ↗First posted 29 Mar 2025cs.IR cs.AI cs.HCcited by 8

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

While it is increasingly evident that the internet is becoming saturated with content created by generated Ai large language models, accurately measuring the scale of this phenomenon has proven challenging. By analyzing the frequency of specific keywords commonly used by ChatGPT, this paper demonstrates that such linguistic markers can effectively be used to esti-mate the presence of generative AI content online. The findings suggest that at least 30% of text on active web pages originates from AI-generated sources, with the actual proportion likely ap-proaching 40%. Given the implications of autophagous loops, this is a sobering realization.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 5 of its 22 references that are in the map. First posted on arXiv 29 Mar 2025.

Builds on

5 of 22 references.

References · 5

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023Self-Consuming Generative Models Go MADcited by 239
  4. 2024Self-Improving Diffusion Models with Synthetic Datacited by 34
  5. 2024MONAL: Model Autophagy Analysis for Modeling Human-AI Interactionscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

  1. 2026The Impact of AI-Generated Text on the Internetcited by 6
  2. 2026Retrieval Collapses When AI Pollutes the Webcited by 4
  3. 2025A New Digital Divide? Coder Worldviews, the Slop Economy, and Democracy in the Age of AIcited by 2
  4. 2026Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communitiescited by 1
  5. 2026When Does Model Collapse Occur in Structured Interactive Learning?cited by 1
  6. 2026Steganography Without Modification: Hidden Communication via LLM Seedscited by 1
  7. 2025Future of AI Models: A Computational perspective on Model collapsecited by 0
  8. 2026How unique are hallucinated citations offered by generative Artificial Intelligence models?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Towards Understanding the Interplay of Generative Artificial Intelligence and the Internet
  2. 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities
  3. 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?
  4. 2025Information Retrieval in the Age of Generative AI: The RGB Model
  5. 2026NodeSynth: Socially Aligned Synthetic Data for AI Evaluation
  6. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?
  7. 2024Exploring AI Text Generation, Retrieval-Augmented Generation, and Detection Technologies: a Comprehensive Overview
  8. 2024How to Synthesize Text Data without Model Collapse?