mlsanityData to 14 Oct 2026

Experience Scaling: Post-Deployment Evolution For Large Language Models

arXiv 2509.18771 ↗First posted 23 Sep 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Scaling model size, training data, and compute power have driven advances in large language models (LLMs), but these approaches are reaching saturation as human-generated text is exhausted and further gains diminish. We propose experience scaling, a framework for continuous post-deployment evolution for LLMs through autonomous interaction with the environment and collaborative sharing of accumulated experience. The framework captures raw interactions, distills them into compact, reusable knowledge, and periodically refines stored content to preserve relevance and efficiency. We validate the framework in simulated real-world scenarios involving generalization to previously unseen but related tasks, repetitive queries, and over-saturated knowledge stores. Across all settings, experience scaling improves accuracy, sustains performance over time, and maintains gains when applied to novel situations. These results demonstrate that structured post-deployment learning can extend LLM capabilities beyond the limits of static human-generated data, offering a scalable path for continued intelligence progress.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

29 of 46 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  8. 2020Scaling Laws for Neural Language Modelscited by 6,586
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  10. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  11. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  12. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
17 more
  1. 2023Challenges and Applications of Large Language Modelscited by 254
  2. 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 203
  3. 2024Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durationscited by 170
  4. 2024VLP: Vision Language Planning for Autonomous Drivingcited by 126
  5. 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 90
  6. 2024Resolving Discrepancies in Compute-Optimal Scaling of Language Modelscited by 88
  7. 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 84
  8. 2025Overcoming catastrophic forgetting in neural networkscited by 55
  9. 2023Learning from models beyond fine-tuningcited by 48
  10. 2024Thermometer: Towards Universal Calibration for Large Language Modelscited by 38
  11. 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
  12. 2023Summarizing Stream Data for Memory-Constrained Online Continual Learningcited by 19
  13. 2025Shifting from Ranking to Set Selection for Retrieval Augmented Generationcited by 15
  14. 2019From Server-Based to Client-Based Machine Learning: A Comprehensive Surveycited by 7
  15. 2024Quantifying artificial intelligence through algorithmic generalizationcited by 5
  16. 2021Sequential memory improves sample and memory efficiency in Episodic Controlcited by 3
  17. 2024A Coupled Neural Field Model for the Standard Consolidation Theorycited by 1

Built on by

Not cited yet.