mlsanityData to 7 Oct 2026

PREPING: Building Agent Memory without Tasks

arXiv 2605.13880 ↗First posted 11 May 2026cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Agent memory is typically constructed either offline from curated demonstrations or online from post-deployment interactions. However, regardless of how it is built, an agent faces a cold-start gap when first introduced to a new environment without any task-specific experience available. In this paper, we study pre-task memory construction: whether an agent can build procedural memory before observing any target-environment tasks, using only self-generated synthetic practice. Yet, synthetic interaction alone is insufficient, as without controlling what to practice and what to store, synthetic tasks become redundant, infeasible, and ultimately uninformative, and memory further degrades quickly due to unfiltered trajectories. To overcome this, we present Preping, a proposer-guided memory construction framework. At its core is proposer memory, a structured control state that shapes future practice. A Proposer generates synthetic tasks conditioned on this state, a Solver executes them, and a Validator determines which trajectories are eligible for memory insertion while also providing feedback to guide future proposals. Experiments on AppWorld, BFCL v3, and MCP-Universe show that Preping substantially improves over a no-memory baseline and achieves performance competitive with strong playbook-based methods built from offline or online experience, with deployment cost 2.99× lower on AppWorld and 2.23× lower on BFCL v3 than online memory construction. Further analyses reveal that the main benefit does not come from synthetic volume alone, but from proposer-side control over feasibility, redundancy, and coverage, combined with selective memory updates.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 37 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

34 of 37 references.

References · 34

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  7. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  9. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  10. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  11. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  12. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
22 more
  1. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  2. 2024Agent Workflow Memorycited by 342
  3. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  4. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  5. 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
  6. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
  7. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  8. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
  9. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
  10. 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 89
  11. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 88
  12. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
  13. 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
  14. 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
  15. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
  16. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 66
  17. 2025Self-Challenging Language Model Agentscited by 56
  18. 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automationcited by 39
  19. 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 39
  20. 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
  21. 2026Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Datacited by 31
  22. 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
  2. 2025Memp: Exploring Agent Procedural Memory
  3. 2026Just-In-Time Agent Memory with Runtime Agentic Research
  4. 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning
  5. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
  6. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
  7. 2026CONTRAMEM: Learning Self-Evolving Procedural Memory from Contrasting Multi-Model Trajectories
  8. 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Tasks