When Should Agents Check External State? Budgeting Observations for Stored Intentions
Not on the map. Why?
Abstract (arXiv)
Prospective memory allows an agent to retain an intention tied to a future condition, but the stored intention does not reveal whether that condition currently holds. Checking it may require web access, multi-step tool use, and paid calls. Existing systems decide when intentions require attention, but do not allocate the resulting observations under a shared budget. We introduce the first resource-allocation formulation for the external observations required by stored intentions under a shared episode budget. BudgetPM offers two policy variants that share a hard-budget executor. BudgetPM-Static uses a lightweight Logistic scorer to learn whether a check improves the current decision. BudgetPM-Sequential distills full-episode hindsight schedules into a lightweight policy that decides when to spend or reserve capacity using only pre-query information at deployment. We evaluate BudgetPM against two public memory-agent systems, five matched controls, and four hand-designed monitoring or budget-adaptation rules. Across two benchmarks and three backbones, BudgetPM-Static outperforms adapted Mem0 and PMA workflows. On PM-Bench, its Logistic scorer reaches competitive quality--cost operating points alongside higher-capacity scorers and retains 99.9--100% of unconstrained quality with 42--54% fewer observations. Under severe scarcity and the same hard caps, BudgetPM-Sequential exceeds the strongest tested natural monitoring schedule by 1.92--2.58 Set F1 points. It reaches the same Set F1 and on-time recall with 16--33% fewer observations. Matched attribution, exact-cost analysis, and a fixed-budget load intervention link this gain to competition between present and future opportunities. These results yield a demand--capacity design rule: local gating works when capacity covers demand, while future-aware supervision adds value when observations compete across time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 40 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
33 of 40 references.
References · 33
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2015Policy Distillationcited by 440
21 more
- 2013Bandits with Knapsackscited by 164
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 84
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 78
- 2025Budget-Aware Tool Use Enables Effective Agent Scalingcited by 44
- 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agentscited by 33
- 2024Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Modelscited by 20
- 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoningcited by 19
- 2026Learning Query-Aware Budget-Tier Routing for Runtime Agent Memorycited by 13
- 2026Lightweight LLM Agent Memory with Small Language Modelscited by 13
- 2026Remember When It Matters: Proactive Memory Agent for Long-Horizon Agentscited by 11
- 2022Towards Painless Policy Optimization for Constrained MDPscited by 8
- 2026Budget-Constrained Agentic Large Language Models: Intention-Based Planning for Costly Tool Usecited by 8
- 2014Optimal Value of Information in Graphical Modelscited by 7
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agentscited by 7
- 2026TriggerBench: Investigating Prospective Memory for Large Language Modelscited by 5
- 2026Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agentscited by 4
- 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agentscited by 4
- 2026WISERouter: LLM Routing with Workload Budget Constraintcited by 3
- 2025MDPs with a State Sensing Costcited by 1
- 2026MemoryCPT: An End-to-End Agent Memory Framework for Cost-Performance Trade-offcited by 1
- 2026Making Prospective Memory SLM-Shaped: Typed Intention Stores for Small-Model Agentscited by 1
Built on by
Not cited yet.