mlsanityData to 7 Oct 2026

Position: Agentic Evolution is the Path to Evolving LLMs

arXiv 2602.00359 ↗First posted 30 Jan 2026cs.AIcited by 13

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time and inference-time compute improves static capability but does not close this train-deploy gap. We argue that addressing this limitation requires a new scaling axis-evolution. Existing deployment-time adaptation methods, whether parametric fine-tuning or heuristic memory accumulation, lack the strategic agency needed to diagnose failures and produce durable improvements. Our position is that agentic evolution represents the inevitable future of LLM adaptation, elevating evolution itself from a fixed pipeline to an autonomous evolver agent. We instantiate this vision in a general framework, A-Evolve, which treats deployment-time improvement as a deliberate, goal-directed optimization process over persistent system state. We further propose the evolution-scaling hypothesis: the capacity for adaptation scales with the compute allocated to evolution, positioning agentic evolution as a scalable path toward sustained, open-ended adaptation in the real world. Our code is publicly available at https://github.com/A-EVO-Lab/a-evolve.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 53 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

41 of 53 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan
  2. 2025Youtu-Agent: Scaling Agent Productivity with Automated Generation and Hybrid Policy Optimization31 Dec
  3. 2025SCOPE: Prompt Evolution for Enhancing Agent Effectiveness17 Dec
  4. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning20 Nov
  5. 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
  6. 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation4 Nov
  7. 2025Scaling Agents via Continual Pre-training16 Sep

Other references · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  7. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  10. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
  11. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  12. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
22 more
  1. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
  2. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  3. 2024Agent Workflow Memorycited by 342
  4. 2024Titans: Learning to Memorize at Test Timecited by 303
  5. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  6. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  7. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  8. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  9. 2022GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Modelscited by 127
  10. 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 89
  11. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65
  12. 2025It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimizationcited by 60
  13. 2024LoFiT: Localized Fine-tuning on LLM Representationscited by 56
  14. 2025Training-Free Group Relative Policy Optimizationcited by 53
  15. 2025Test-Time Learning for Large Language Modelscited by 46
  16. 2023SelfEvolve: A Code Evolution Framework via Large Language Modelscited by 43
  17. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 43
  18. 2025How Do Large Language Monkeys Get Their Power (Laws)?cited by 40
  19. 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
  20. 2024Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotationcited by 21
  21. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
  22. 2025SPACE: Noise Contrastive Estimation Stabilizes Self-Play Fine-Tuning for Large Language Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024A Survey on Self-Evolution of Large Language Models
  2. 2026EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
  3. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
  4. 2026PACE: Two-Timescale Self-Evolution for Small Language Model Agents
  5. 2025Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
  6. 2026When Is Enough Enough in Self-Evolving LLM Systems?
  7. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
  8. 2026AdaptEvolve: Improving Efficiency of Evolutionary AI Agents through Adaptive Model Selection