mlsanityData to 14 Oct 2026

Learning Dynamics of Continual Learning: A Unified View of Data Attribution, Forgetting, and Plasticity Loss

arXiv 2609.33620 ↗First posted 27 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern language models are likely to be updated throughout their lifetime rather than trained once and frozen. Each update therefore participates in a recurring cycle: decide which experience to learn from, understand what that update changes, and remain capable of learning from what comes next. We show that these challenges are governed by the same evolving update--behavior interaction. We derive a token- and layer-wise decomposition of how learning from one token changes another prediction. By separating the softmax force, shared readout geometry, and residual connections, it exposes two interaction channels and yields a forward-computable approximation. Following this interaction through time reveals a unified picture of continual adaptation. Positive interaction identifies useful experience; negative interaction produces either concentrated collision or accumulated erosion; over longer horizons, updates reshape the shared geometry mediating future learning signals, reducing their transmission. These predictions lead to effective data selection, mechanism-specific controls for interference, and a readout-based diagnostic of future learnability whose degradation predicts the benefit of restoring the readout. Across models and training regimes, the same local interaction thus explains both what an update changes now and how learning today changes what can be learned tomorrow. This view connects data attribution, forgetting, and plasticity loss as distinct regimes of the same evolving learning dynamics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 55 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

48 of 55 references.

References · 48

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2019When Does Label Smoothing Help?cited by 988
  6. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  7. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  8. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  9. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
  10. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  11. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  12. 2023Studying Large Language Model Generalization with Influence Functionscited by 326
36 more
  1. 2026Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipecited by 299
  2. 2018Characterizing Implicit Bias in Terms of Optimization Geometrycited by 266
  3. 2019Representation Degeneration Problem in Training Natural Language Generation Modelscited by 255
  4. 2022The Primacy Bias in Deep Reinforcement Learningcited by 247
  5. 2023Understanding plasticity in neural networkscited by 174
  6. 2020Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semanticscited by 161
  7. 2022Fine-tuned Language Models are Continual Learnerscited by 156
  8. 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 146
  9. 2023DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Modelscited by 123
  10. 2022A Kernel-Based View of Language Model Fine-Tuningcited by 121
  11. 2022On the SDEs and Scaling Rules for Adaptive Gradient Algorithmscited by 104
  12. 2020A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrixcited by 103
  13. 2024Revisiting Catastrophic Forgetting in Large Language Model Tuningcited by 99
  14. 2024Learning Dynamics of LLM Finetuningcited by 95
  15. 2024Hyper-Connectionscited by 84
  16. 2025Nested Learning: The Illusion of Deep Learning Architecturescited by 72
  17. 2025Overtrained Language Models Are Harder to Fine-Tunecited by 58
  18. 2023Improving Language Plasticity via Pretraining with Active Forgettingcited by 43
  19. 2026On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stabilitycited by 35
  20. 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimizationcited by 31
  21. 2025Beyond the Sampled Token: Preserving Candidate Support in RLVRcited by 18
  22. 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
  23. 2025LLM Unlearning with LLM Beliefscited by 17
  24. 2026Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgettingcited by 16
  25. 2025On Group Relative Policy Optimization Collapse in Agent Search: The Lazy Likelihood-Displacementcited by 15
  26. 2025GRAIT: Gradient-Driven Refusal-Aware Instruction Tuning for Effective Hallucination Mitigationcited by 11
  27. 2025Token Hidden Reward: Steering Exploration-Exploitation in Group Relative Deep Reinforcement Learningcited by 10
  28. 2023Learn, Unlearn and Relearn: An Online Learning Paradigm for Deep Neural Networkscited by 7
  29. 2024HyperINF: Unleashing the HyperPower of the Schulz's Method for Data Influence Estimationcited by 7
  30. 2026Rethinking Data Curation in LLM Training: Online Reweighting Offers Better Generalization than Offline Methodscited by 3
  31. 2025When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuningcited by 2
  32. 2026A Theory of Generalization in Deep Learningcited by 2
  33. 2026Alignment Dynamics in LLM Fine-Tuningcited by 2
  34. 2025For-Value: Efficient Forward-Only Data Valuation for finetuning LLMs and VLMscited by 1
  35. 2025Learning Dynamics of Deep Learning -- Force Analysis of Deep Neural Networkscited by 1
  36. 2026Can Scale Save Us From Plasticity Loss in Large Language Models?cited by 1

Built on by

Not cited yet.