Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systems
Not on the map. Why?
Abstract (arXiv)
Long-lived AI agents are increasingly deployed as persistent operational systems, yet they are still evaluated like freshly initialized models. Day-one benchmarks miss a basic systems question: how long does an agent remain reliable after deployment? Even when model weights are frozen, an agent's effective state keeps changing as it compresses interaction history, retrieves from a growing memory store, revises facts after updates, and undergoes routine maintenance. Reliability therefore becomes a lifespan property of the full agent harness, not only a snapshot property of the base model. We introduce AgingBench, a longitudinal reliability benchmark for agent lifespan engineering: measuring not only whether deployed agents degrade, but what form the degradation takes and where repair should target. AgingBench organizes agent aging into four mechanisms: compression aging, interference aging, revision aging, and maintenance aging. To diagnose these failures, AgingBench uses temporal dependency graphs and paired counterfactual probes that produce diagnostic profiles for the write, retrieval, and utilization stages of the memory pipeline. Across 7 scenarios, 14 models, multiple memory policies, and both runner-controlled and autonomous agents, over ~400 runs spanning 8 - 200 sessions show that agent aging is not one-dimensional: behavioral tests can remain clean while factual precision decays; derived-state tracking can collapse sharply within a single model; and the same wrong answer can require different repairs depending on what the diagnostic profile points to. These results suggest that reliable agent deployment requires lifespan evaluation, mechanism-level diagnosis, and stage-targeted repair, not only stronger day-one models.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 42 of its 55 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
42 of 55 references.
References · 42
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Qwen Technical Reportcited by 3,273
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
30 more
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2025Memory in the Age of AI Agentscited by 285
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 72
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2024Self-evolving Agents with reflective and memory-augmented abilitiescited by 52
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applicationscited by 46
- 2026PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agentscited by 30
- 2025A Survey of Vibe Coding with Large Language Modelscited by 25
- 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Breakcited by 25
- 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
- 2026AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversationscited by 20
- 2025RAFFLES: Reasoning-based Attribution of Faults for LLM Systemscited by 19
- 2026From Lossy to Verified: A Provenance-Aware Tiered Memory for Agentscited by 16
- 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 13
- 2026BeliefShift: Benchmarking Temporal Belief Consistency and Opinion Drift in LLM Agentscited by 11
- 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprisecited by 9
- 2026SWE-Milestone: Evaluating AI Agents on Continuous Software Evolutioncited by 6
- 2026D-Mem: A Dual-Process Memory System for LLM Agentscited by 5
- 2025Compliance Brain Assistant: Conversational Agentic AI for Assisting Compliance Tasks in Enterprise Environmentscited by 4
- 2026MemArchitect: A Policy Driven Memory Governance Layercited by 3
- 2022Extensible Database Simulator for Fast Prototyping In-Database Algorithmscited by 2
- 2026VehicleMemBench: An Executable Benchmark for Multi-User Long-Term Memory in In-Vehicle Agentscited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Online Skill Learning for Web Agents via State-Grounded Dynamic Retrievalcited by 2
- 2026Agents in the Large: Perception-Centered Architecture for Persistent Agentscited by 1
- 2026Learning on the Job: Continual Learning from Deployment Feedback for Frozen-Weights Agentscited by 0
- 2026SpecPath: Testing Coding Agents Across Contract-Equivalent Specification Historiescited by 0
- 2026Memory as Infrastructure: Reliability Engineering for Persistent Agent Memory in Months-Long LLM-Assisted Developmentcited by 0
- 2026What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memorycited by 0
- 2026Dude, Where's My State? Execution Information Requirements for Stateful Agentscited by 0
- 2026Dude, Where's My State? Execution Information Requirements for Stateful Agents26 Sep 2026
- 2026What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memory8 Sep 2026
- 2026Memory as Infrastructure: Reliability Engineering for Persistent Agent Memory in Months-Long LLM-Assisted Development31 Aug 2026
- 2026Agents in the Large: Perception-Centered Architecture for Persistent Agents31 Aug 2026
- 2026SpecPath: Testing Coding Agents Across Contract-Equivalent Specification Histories10 Aug 2026
- 2026Learning on the Job: Continual Learning from Deployment Feedback for Frozen-Weights Agents24 Jul 2026
- 2026Online Skill Learning for Web Agents via State-Grounded Dynamic Retrieval3 Jun 2026