PREPING: Building Agent Memory without Tasks
Not on the map. Why?
Abstract (arXiv)
Agent memory is typically constructed either offline from curated demonstrations or online from post-deployment interactions. However, regardless of how it is built, an agent faces a cold-start gap when first introduced to a new environment without any task-specific experience available. In this paper, we study pre-task memory construction: whether an agent can build procedural memory before observing any target-environment tasks, using only self-generated synthetic practice. Yet, synthetic interaction alone is insufficient, as without controlling what to practice and what to store, synthetic tasks become redundant, infeasible, and ultimately uninformative, and memory further degrades quickly due to unfiltered trajectories. To overcome this, we present Preping, a proposer-guided memory construction framework. At its core is proposer memory, a structured control state that shapes future practice. A Proposer generates synthetic tasks conditioned on this state, a Solver executes them, and a Validator determines which trajectories are eligible for memory insertion while also providing feedback to guide future proposals. Experiments on AppWorld, BFCL v3, and MCP-Universe show that Preping substantially improves over a no-memory baseline and achieves performance competitive with strong playbook-based methods built from offline or online experience, with deployment cost 2.99× lower on AppWorld and 2.23× lower on BFCL v3 than online memory construction. Further analyses reveal that the main benefit does not come from synthetic volume alone, but from proposer-side control over feasibility, redundancy, and coverage, combined with selective memory updates.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 37 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
34 of 37 references.
References · 34
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
22 more
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2024Agent Workflow Memorycited by 342
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
- 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 89
- 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 88
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
- 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 66
- 2025Self-Challenging Language Model Agentscited by 56
- 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automationcited by 39
- 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 39
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
- 2026Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Datacited by 31
- 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptationcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
- 2025Memp: Exploring Agent Procedural Memory
- 2026Just-In-Time Agent Memory with Runtime Agentic Research
- 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning
- 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
- 2026CONTRAMEM: Learning Self-Evolving Procedural Memory from Contrasting Multi-Model Trajectories
- 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Tasks