mlsanityData to 7 Oct 2026

Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skills

arXiv 2512.16301 ↗First posted 18 Dec 2025cs.AI cs.CLcited by 19

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool use, and OpenClaw highlights a newer direction in which agents accumulate persistent memory and reusable skills. Yet the research landscape remains fragmented across post-training, retrieval, memory, and skill systems. This survey studies these developments under a single notion of adaptation: improving an agent, its tools, or their interaction after pretraining. We organize the field with a four-paradigm framework spanning agent adaptation and tool adaptation. On the agent side, A1 (tool-execution-signaled) and A2 (agent-output-signaled) improve the agent itself through supervised fine-tuning, preference optimization, and reinforcement learning with verifiable rewards. On the tool side, T1 (agent-agnostic) provides reusable pre-trained modules any agent can call, while T2 (agent-supervised) uses the agent's outputs to train memory systems, skill libraries, or lightweight subagents. Using this framework, we review post-training methods, adaptive memory architectures, and agent skills; compare their trade-offs in cost, flexibility, and generalization; and summarize evaluation practices across deep research, software development, computer use, and drug discovery. We conclude by outlining open problems in agent-tool co-adaptation, continual learning, safety, and efficient deployment.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 176 of its 409 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

176 of 409 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution29 Oct
  2. 2025Training LLM Agents to Empower Humans15 Oct
  3. 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation13 Oct
  4. 2025Self-Improving LLM Agents at Test-Time9 Oct
  5. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  6. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
  7. 2025Small Language Models are the Future of Agentic AI2 Jun
  8. 2025Self-Challenging Language Model Agents2 Jun
  9. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
  10. 2025Agentic Large Language Models, a survey29 Mar
  11. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
  12. 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training20 Jan
6 more
  1. 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning2 Oct
  2. 2024Automated Design of Agentic Systems15 Aug
  3. 2024Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models9 Jul
  4. 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solving20 Feb
  5. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models5 Jan
  6. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents3 Feb

Other references · 158

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  6. 2021Program Synthesis with Large Language Modelscited by 3,509
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  8. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  9. 2016Concrete Problems in AI Safetycited by 1,582
  10. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  11. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  12. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
38 more
  1. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  2. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  3. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  4. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  5. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  6. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  7. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  8. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  9. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  10. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  11. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
  12. 2025Humanity's Last Examcited by 467
  13. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 463
  14. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  15. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  16. 2020Generative Language Modeling for Automated Theorem Provingcited by 379
  17. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  18. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  19. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  20. 2024Agent Workflow Memorycited by 342
  21. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  22. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
  23. 2024Titans: Learning to Memorize at Test Timecited by 303
  24. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  25. 2025Memory in the Age of AI Agentscited by 285
  26. 2019Challenges of Real-World Reinforcement Learningcited by 282
  27. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
  28. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  29. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  30. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
  31. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  32. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  33. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  34. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
  35. 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 203
  36. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
  37. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
  38. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182

50 most cited of 158 All 158 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 17.

19 papers.

Sort:

By area:

  1. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  2. 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolutioncited by 33
  3. 2026Uncertainty Quantification in LLM Agents: Foundations, Emerging Challenges, and Opportunitiescited by 15
  4. 2025An Information Theoretic Perspective on Agentic System Designcited by 8
  5. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  6. 2026Lifting Traces to Logic: Programmatic Skill Induction with Neuro-Symbolic Learning for Long-Horizon Agentic Taskscited by 7
  7. 2026ElasticMem: Latent Memory as a Learnable Resource for LLM Agentscited by 4
  8. 2026daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficientlycited by 3
  9. 2026Rethinking the Reranker: Boundary-Aware Evidence Selection for Robust Retrieval-Augmented Generationcited by 3
  10. 2026Interactive Evaluation Requires a Design Sciencecited by 3
  11. 2026Evidence-Decision-Feedback: Theory-Driven Adaptive Scaffolding for LLM Agentscited by 2
  12. 2026ExpGraph: Model-Agnostic Experience Learning with Graph-Structured Memory for LLM Agentscited by 2
7 more
  1. 2026Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineeringcited by 2
  2. 2026Rethinking Psychometric Evaluation of LLMs: When and Why Self-Reports Predict Behaviorcited by 1
  3. 2026Think Big, Search Small: Where Capacity Matters in Hierarchical Search Agents?cited by 1
  4. 2026Efficient, Property-Aligned Fan-Out Retrieval via RL-Compiled Diffusioncited by 0
  5. 2026The Agent Use of Agent Beings: Agent Cybernetics Is the Missing Science of Foundation Agentscited by 0
  6. 2026LifeMem: Enabling Lifelong Experience Reuse for LLM Agentscited by 0
  7. 2026FORGE: Form-Optimal Routing of Grounded Evidence for Frozen LLM Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories
  2. 2026Skill-R1: Agent Skill Evolution via Reinforcement Learning
  3. 2024Offline Training of Language Model Agents with Functions as Learnable Weights
  4. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory
  5. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
  6. 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
  7. 2026Rethinking Agentic Reinforcement Learning In Large Language Models
  8. 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuning