# Model Collapse: On Recursion, Noise, and Uncharted Machine Visions

arXiv: https://arxiv.org/abs/2607.09705 · HTML: https://mlsanity.com/paper/2607.09705/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Model collapse from synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs.
- Builds on 1 of its 1 references that are in the map.
- First posted on arXiv 22 Jun 2026.

## Placed in

- Synthetic data and self-improvement for LLMs / [Model collapse from synthetic data](https://mlsanity.com/synth/model-collapse-from-synthetic-data/)

## Builds on (most cited first, 1 of 1)

- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)

## Abstract (arXiv)

Since 2023, computer scientists have warned against model collapse -- the contamination of training sets with AI-generated outputs that progressively degrade model performance. Exemplifying a positive-feedback-driven failure, it produces effects such as word repetition or pixel noise, ultimately leading to a loss of meaning and coherence -- at least from an engineering standpoint. From a creative one, however, collapse is not merely a breakdown: it also functions as a recursive mirror that recalls early analog video feedback experiments, raising once again the question of what happens when a system turns inward and sees itself. In such cases, so-called machine vision no longer transmits the world (as in tele-vision) but increasingly generates worlds from within. Drawing on media archaeology through case studies of both historical video synthesis techniques and contemporary artistic uses of machine learning, this paper examines what recursive training reveals about the dependent nature of AI-generated data. It argues that the potential effects of collapse challenge transhumanist ideals while inviting an aesthetic perspective, positioning noise and recursion as key concepts for understanding both artmaking and the AI ecosystem. Distributing agency across scales and networks, the latter currently remains reliant on new human-produced content, particularly within foundation models trained on massive datasets.