The Anti-Ouroboros Effect: Emergent Resilience in Large Language Models from Recursive Selective Feedback
Not on the map. Why?
Abstract (arXiv)
The stability of recursively trained large language models (LLMs) is a foundational problem for AI safety. Prevailing theory predicts model collapse, a progressive degradation when models are trained on their own output. We challenge this narrative by introducing a selective feedback mechanism. Contrary to expectation, instead of merely slowing decay, our experiments provide strong evidence that this pressure reverses it, inducing a statistically significant performance improvement in a Gemma 2B model on a complex summarization task. We name this phenomenon the Anti-Ouroboros Effect. We contrast this with a foundational experiment using a simple classifier, where the theoretical degenerative loop was validated, highlighting the unique dynamics of high-dimensional models. Our findings establish that systemic resilience can be an emergent property of LLMs under simple selection pressure, suggesting a powerful and scalable principle for developing safer and more robust AI systems. Across five generations, a quality-filtered condition improved by 6.6% in ROUGE-L F1 score, whereas an unfiltered control degraded by 3.5% and a random-filter control degraded by 4.2%
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
22 of 31 references.
References · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
- 2023The False Promise of Imitating Proprietary LLMscited by 263
- 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
- 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
- 2025Reward Shaping to Mitigate Reward Hacking in RLHFcited by 88
- 2024How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapsecited by 79
- 2025Scaling Laws of Synthetic Data for Language Modelscited by 46
- 2024Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verificationcited by 45
10 more
- 2025Position: Model Collapse Does Not Mean What You Thinkcited by 33
- 2024Cross-Entropy Is All You Need To Invert the Data Generating Processcited by 31
- 2024Rate of Model Collapse in Recursive Trainingcited by 25
- 2025BiMark: Unbiased Multilayer Watermarking for Large Language Modelscited by 21
- 2025The Energy Loss Phenomenon in RLHF: A New Perspective on Mitigating Reward Hackingcited by 18
- 2025Improving the Scaling Laws of Synthetic Data with Deliberate Practicecited by 17
- 2025Protecting Human Cognition in the Age of AIcited by 12
- 2025LLM Web Dynamics: Tracing Model Collapse in a Network of LLMscited by 6
- 2022An Entropy-Based Model for Hierarchical Learningcited by 2
- 2025Recursive Training Loops in LLMs: How training data properties modulate distribution shift in generated data?cited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025'Neural howlround' in large language models: a self-reinforcing bias phenomenon, and a dynamic attenuation solution
- 2026Preventing Model Collapse: A Fisher-Rao Perspective on the Dynamics of Training with Synthetic Data
- 2026A Theory of LLM Information Susceptibility
- 2025Do Large Language Models Know What They Are Capable Of?
- 2025Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models
- 2026Human-AI Co-Evolution and Epistemic Collapse: A Dynamical Systems Perspective
- 2026Robust Policy Optimization to Prevent Catastrophic Forgetting
- 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs