mlsanityData to 14 Oct 2026

TriggerBench: Investigating Prospective Memory for Large Language Models

arXiv 2606.23459 ↗First posted 22 Jun 2026cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

While Large Language Models (LLMs) are increasingly deployed in long interactions, existing evaluations focus predominantly on retrospective memory (RM) via explicit queries. Prospective memory (PM), the critical ability to spontaneously recall and act on latent constraints without direct prompts, remains largely unevaluated. We introduce TriggerBench, a comprehensive PM benchmark spanning five dimensions across both daily assistants and professional workflows. TriggerBench pairs scenarios with matched RM controls, contrastive positive/negative variants, and overloaded triggers, enabling fine-grained measurement of proactive recall, false-alarm rate, and attentional robustness under a single protocol. Our evaluation yields three key findings. (i) PM shows a precision-recall trade-off and attentional fragility. Though enhanced reasoning significantly improves proactive recall, models may overfit to an "always-remind" heuristic. Furthermore, PM accuracy degrades substantially under implicit constraints or triggers overloaded by concurrent user requests, indicating that robust PM remains an open challenge. (ii) PM is notably harder than RM: on identical contexts, RM near-saturates up to 100K tokens, while PM decays sharply as context length scales. (iii) PM may serve as a behavioral probe of spare reasoning capacity. Pairing PM scenarios with AIME-2025 math problems reveals that successful trajectories yield higher PM accuracy than failed ones at the same context length, showing PM tracks spare reasoning budget that token count obscures. Project page: https://github.com/KristenZHANG/TriggerBench-Official.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

21 of 38 references.

References · 21

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2024A Survey on LLM-as-a-Judgecited by 1,423
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  5. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  6. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  7. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  8. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  9. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 124
  10. 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 88
  11. 2025Training Proactive and Personalized LLM Agentscited by 46
  12. 2025ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptionscited by 45
9 more
  1. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
  2. 2025FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM Agentscited by 20
  3. 2025SafeGenBench: A Benchmark Framework for Security Vulnerability Detection in LLM-Generated Codecited by 19
  4. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 14
  5. 2025ProAgent: Harnessing On-Demand Sensory Contexts for Proactive LLM Agent Systems in the Wildcited by 10
  6. 2025ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agentscited by 9
  7. 2026Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agentscited by 6
  8. 2026Did You Forget What I Asked? Prospective Memory Failures in Large Language Modelscited by 6
  9. 2025Think Broad, Act Narrow: CWE Identification with Multi-Agent Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.