mlsanityData to 7 Oct 2026

Forgetting as a Feature: Cognitive Alignment of Large Language Models

arXiv 2601.09726 ↗First posted 28 Dec 2025cs.CLcited by 0

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this behavior as a limitation, we reinterpret forgetting as a functional cognitive mechanism. Drawing inspiration from human memory dynamics, we model LLM inference as a probabilistic memory process governed by exponential decay. We introduce a benchmark suite that evaluates temporal reasoning, concept drift adaptation, and associative recall, enabling direct comparison between model behavior and human cognitive patterns. Our empirical results reveal that LLMs demonstrate forgetting rates analogous to human memory efficiency trade-offs between stability and adaptability. Building on these observations, we propose probabilistic memory prompting, a lightweight strategy that shapes evidence integration to mimic human-like memory decay, leading to improved long-horizon reasoning performance. Our findings position forgetting not as a failure mode, but as a principled mechanism for adaptive intelligence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 17 of its 22 references that are in the map. First posted on arXiv 28 Dec 2025.

Builds on

17 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Preference-Oriented Supervised Fine-Tuning: Favoring Target Model Over Aligned Large Language Models17 Dec
  2. 2021A General Language Assistant as a Laboratory for Alignment1 Dec

Other references · 15

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2017Deep reinforcement learning from human preferencescited by 3,846
  3. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  4. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  5. 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 57
  6. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 56
  7. 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 36
  8. 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 34
  9. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
  10. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 33
  11. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 29
  12. 2025Failure-Driven Workflow Refinementcited by 19
3 more
  1. 2025Kolmogorov-Arnold Fourier Networkscited by 18
  2. 2025Learning Dynamics of VLM Finetuningcited by 17
  3. 2025Top-Down Semantic Refinement for Image Captioningcited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
  2. 2024Disentangling Memory and Reasoning Ability in Large Language Models
  3. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory
  4. 2026Unlocking the Working Memory of Large Language Models for Latent Reasoning
  5. 2025Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks
  6. 2026Is One Score Enough? Rethinking the Evaluation of Sequentially Evolving LLM Memory
  7. 2025On the Failure of Latent State Persistence in Large Language Models
  8. 2024Dual Traits in Probabilistic Reasoning of Large Language Models