Model Collapse: On Recursion, Noise, and Uncharted Machine Visions
On the map: Synthetic data and self-improvement for LLMs → Model collapse from synthetic data
Abstract (arXiv)
Since 2023, computer scientists have warned against model collapse -- the contamination of training sets with AI-generated outputs that progressively degrade model performance. Exemplifying a positive-feedback-driven failure, it produces effects such as word repetition or pixel noise, ultimately leading to a loss of meaning and coherence -- at least from an engineering standpoint. From a creative one, however, collapse is not merely a breakdown: it also functions as a recursive mirror that recalls early analog video feedback experiments, raising once again the question of what happens when a system turns inward and sees itself. In such cases, so-called machine vision no longer transmits the world (as in tele-vision) but increasingly generates worlds from within. Drawing on media archaeology through case studies of both historical video synthesis techniques and contemporary artistic uses of machine learning, this paper examines what recursive training reveals about the dependent nature of AI-generated data. It argues that the potential effects of collapse challenge transhumanist ideals while inviting an aesthetic perspective, positioning noise and recursion as key concepts for understanding both artmaking and the AI ecosystem. Distributing agency across scales and networks, the latter currently remains reliant on new human-produced content, particularly within foundation models trained on massive datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Model collapse from synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 1 of its 1 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
1 of 1 references.
References · 1
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Antagonising explanation and revealing bias directly through sequencing and multimodal inference
- 2025Position: Model Collapse Does Not Mean What You Think
- 2026Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities
- 2026The Market in the Model: Latent Diffusion as Neural Economy
- 2025The Evolving Nature of Latent Spaces: From GANs to Diffusion
- 2026A Markovian View of Iterative-Feedback Loops in Image Generative Models: Neural Resonance and Model Collapse
- 2026Model Collapse as Cultural Evolution
- 2026ReTracing: An Archaeological Approach Through Body, Machine, and Generative Systems