mlsanityData to 14 Oct 2026

Self-Generated Feedback Destabilizes Test-Time Training: A Causal Decomposition of Long-Horizon Adaptation

arXiv 2610.05076 ↗First posted 4 Oct 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Test-time training (TTT) lets a model store information in its weights during inference. When the model learns from its own output, however, each update also changes the model that generates the next training example. Across 128K-token streams, retaining generated-text updates worsens prediction on independent human-written text with three TTT-E2E model configurations (labeled 125M, 760M, and 3B). The same failure occurs when Adam updates Qwen3-4B's existing weights. The same update mechanisms can improve on real text, so writing itself is not the failure. Three matched comparisons trace the causal pathway. Fixed Generation removes over 98% of the damage at 125M and 760M by using a frozen model to generate training chunks. Recorded Replay separates the loss caused by reading degraded text from the additional loss stored by updating on it. A paired one-update comparison then shows the local conflict: an update predicts its source better but new real text worse. This cost grows after Closed Loop adaptation, with a few trajectories accounting for most large failures. Finally, Settlement evaluates the candidate state on independent real text before commitment. It leaves mean endpoint gaps of 0.07 and -0.02 nats at 125M and 760M while retaining real-text adaptation. These results motivate checking prediction on independent evidence before retaining an update.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

35 of 42 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  6. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  7. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  8. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  9. 2018Efficient Lifelong Learning with A-GEMcited by 1,058
  10. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  11. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 726
  12. 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
23 more
  1. 2022Large Language Models Can Self-Improvecited by 664
  2. 2022Continual Test-Time Domain Adaptationcited by 525
  3. 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
  4. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  5. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
  6. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
  7. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 398
  8. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  9. 2024Titans: Learning to Memorize at Test Timecited by 328
  10. 2020Performative Predictioncited by 327
  11. 2023Self-Consuming Generative Models Go MADcited by 250
  12. 2016Using Fast Weights to Attend to the Recent Pastcited by 170
  13. 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
  14. 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 94
  15. 2023Test-Time Training on Nearest Neighbors for Large Language Modelscited by 88
  16. 2023Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loopcited by 79
  17. 2025End-to-End Test-Time Training for Long Contextcited by 62
  18. 2017Dynamic Evaluation of Neural Sequence Modelscited by 55
  19. 2023RDumb: A simple approach that questions our progress in continual test-time adaptationcited by 53
  20. 2024Heat Death of Generative Models in Closed-Loop Learningcited by 22
  21. 2026In-Place Test-Time Trainingcited by 20
  22. 2026No Time Like the Present: Agentic Test-Time Training for LLM Agentscited by 4
  23. 2026VANE: Reliable Test-Time Training for Vision-Language-Action Models via Future Visual Representation Predictioncited by 2

Built on by

Not cited yet.