mlsanityData to 14 Oct 2026

Persistent AI Agents in Academic Research: A Single-Investigator Implementation Case Study

arXiv 2605.26870 ↗First posted 26 May 2026cs.MA cs.AI cs.HCcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Background: Large language models are typically evaluated as models, benchmarks, or short conversational episodes. Less is known about what happens when an agent is embedded persistently in a real academic research environment with durable memory, local files, external tools, scheduled routines, delegated roles, and explicit safety protocols. Methods: A structured self-observed implementation case study was conducted from January 31 to May 25, 2026. The unit of analysis was the persistent human-agent environment: researcher, agent runtime, memory layer, tools, repositories, scheduled jobs, specialized agent roles, and governance rules. Outcomes were organized using PARE-M (Persistent Agentic Research Environment Measurement), a measurement framework covering architecture, utilization, artifact production, resource use, reproducibility, and governance. Results: Recoverable main-agent telemetry contained 75,671 de-duplicated records across 96 active days, with 8,059 user-role and 23,710 assistant-role messages. The workspace included 502 memory-related files, 17 configured agent directories, and 57 skill files. Active system time was 579.7 hours (30-minute capped-gap estimate). Memory-derived records identified 482 output-proxy events and 889 failure, verification, correction, or protocol-proxy events. A strict May 2026 trajectory subset captured 627 model-completed events and 73.95 million recorded tokens, of which 82.9% were cache reads. Conclusions: The workflow was cache-dominant, suggesting that persistent agentic environments may shift the economic unit from cost per token to cost per completed artifact. Future evaluations should use artifact-level denominators, reproducible parsing rules, correction taxonomies, and independent coding of governance events.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 16 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

11 of 16 references.

References · 11

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  5. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  6. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  7. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  8. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  9. 2025Memory OS of AI Agentcited by 150
  10. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 84
  11. 2025MEMTRACK: Evaluating Long-Term Memory and State Tracking in Multi-Platform Dynamic Agent Environmentscited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
  2. 2026Act As a Real Researcher: A Suite of Benchmarks Evaluating Frontier LLMs and Agentic Harnesses in Research Lifecycle
  3. 2026Research-Native by Construction: Minimal Nodes, Re-verifiable Workflows, and Compounding Memory for Long-Horizon Scientific Agents
  4. 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
  5. 2026The Hidden Footprint: Making Storage a First-Class Metric for LLM Agent Evaluation
  6. 2026A Society of Researchers: Designing Institutions for Populations of Autonomous Research Agents
  7. 2026YouRA: A Persistent-State Architecture for Evidence-Traceable Autonomous Research Agents
  8. 2026Are We Ready For An Agent-Native Memory System?