mlsanityData to 14 Oct 2026

The Anti-Ouroboros Effect: Emergent Resilience in Large Language Models from Recursive Selective Feedback

arXiv 2509.10509 ↗First posted 2 Sep 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The stability of recursively trained large language models (LLMs) is a foundational problem for AI safety. Prevailing theory predicts model collapse, a progressive degradation when models are trained on their own output. We challenge this narrative by introducing a selective feedback mechanism. Contrary to expectation, instead of merely slowing decay, our experiments provide strong evidence that this pressure reverses it, inducing a statistically significant performance improvement in a Gemma 2B model on a complex summarization task. We name this phenomenon the Anti-Ouroboros Effect. We contrast this with a foundational experiment using a simple classifier, where the theoretical degenerative loop was validated, highlighting the unique dynamics of high-dimensional models. Our findings establish that systemic resilience can be an emergent property of LLMs under simple selection pressure, suggesting a powerful and scalable principle for developing safer and more robust AI systems. Across five generations, a quality-filtered condition improved by 6.6% in ROUGE-L F1 score, whereas an unfiltered control degraded by 3.5% and a random-filter control degraded by 4.2%

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

22 of 31 references.

References · 22

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  5. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
  6. 2023The False Promise of Imitating Proprietary LLMscited by 263
  7. 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
  8. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
  9. 2025Reward Shaping to Mitigate Reward Hacking in RLHFcited by 88
  10. 2024How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapsecited by 79
  11. 2025Scaling Laws of Synthetic Data for Language Modelscited by 46
  12. 2024Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verificationcited by 45
10 more
  1. 2025Position: Model Collapse Does Not Mean What You Thinkcited by 33
  2. 2024Cross-Entropy Is All You Need To Invert the Data Generating Processcited by 31
  3. 2024Rate of Model Collapse in Recursive Trainingcited by 25
  4. 2025BiMark: Unbiased Multilayer Watermarking for Large Language Modelscited by 21
  5. 2025The Energy Loss Phenomenon in RLHF: A New Perspective on Mitigating Reward Hackingcited by 18
  6. 2025Improving the Scaling Laws of Synthetic Data with Deliberate Practicecited by 17
  7. 2025Protecting Human Cognition in the Age of AIcited by 12
  8. 2025LLM Web Dynamics: Tracing Model Collapse in a Network of LLMscited by 6
  9. 2022An Entropy-Based Model for Hierarchical Learningcited by 2
  10. 2025Recursive Training Loops in LLMs: How training data properties modulate distribution shift in generated data?cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025'Neural howlround' in large language models: a self-reinforcing bias phenomenon, and a dynamic attenuation solution
  2. 2026Preventing Model Collapse: A Fisher-Rao Perspective on the Dynamics of Training with Synthetic Data
  3. 2026A Theory of LLM Information Susceptibility
  4. 2025Do Large Language Models Know What They Are Capable Of?
  5. 2025Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models
  6. 2026Human-AI Co-Evolution and Epistemic Collapse: A Dynamical Systems Perspective
  7. 2026Robust Policy Optimization to Prevent Catastrophic Forgetting
  8. 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs