Did You Forget What I Asked? Prospective Memory Failures in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models often fail to satisfy formatting instructions when they must simultaneously perform demanding tasks. We study this behaviour through a prospective memory inspired lens from cognitive psychology, using a controlled paradigm that combines verifiable formatting constraints with benchmark tasks of increasing complexity. Across three model families and over 8,000 prompts, compliance drops by 2-21% under concurrent task load. Vulnerability is highly type-dependent: terminal constraints (requiring action at the response boundary) degrade most, with drops up to 50%, while avoidance constraints remain comparatively robust. A salience-enhanced format (explicit instruction framing plus a trailing reminder) recovers much of the lost compliance, restoring performance to 90-100% in many settings. Interference is bidirectional: formatting constraints can also reduce task accuracy, with one model's GSM8K accuracy dropping from 93% to 27%. In additional stacking experiments, joint compliance declines sharply as constraints accumulate. All results use deterministic programmatic checkers without an LLM-as-judge component on publicly available datasets.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 7 Mar 2026.
Builds on
16 of 30 references.
References · 16
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 290
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 144
4 more
- 2022Capturing Failures of Large Language Models via Human Cognitive Biasescited by 97
- 2024Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templatescited by 94
- 2025IHEval: Evaluating Language Models on Following the Instruction Hierarchycited by 48
- 2025AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarioscited by 44
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agentscited by 6
- 2026TriggerBench: Investigating Prospective Memory for Large Language Modelscited by 4
- 2026The Importance of Being Statistically Earnest: A Critical Re-evaluation of GSM-Symboliccited by 0
- 2026From Interpretability to Control: Insights from Six Years of the TrustNLP Workshopcited by 0
- 2026The Unreliable Progress Bar: Can LLM Agents Reliably Report Task Progress Throughout Execution?cited by 0
- 2026How Strongly Should Task State Influence an LLM Agent?cited by 0
- 2026How Strongly Should Task State Influence an LLM Agent?22 Sep 2026
- 2026The Unreliable Progress Bar: Can LLM Agents Reliably Report Task Progress Throughout Execution?8 Sep 2026
- 2026From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop11 Aug 2026
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agents14 Jul 2026
- 2026TriggerBench: Investigating Prospective Memory for Large Language Models22 Jun 2026
- 2026The Importance of Being Statistically Earnest: A Critical Re-evaluation of GSM-Symbolic27 May 2026