How Implicit Bias Accumulates and Propagates in LLM Long-term Memory
Not on the map. Why?
Abstract (arXiv)
Long-term memory mechanisms enable Large Language Models (LLMs) to maintain continuity and personalization across extended interaction lifecycles, but they also introduce new and underexplored risks related to fairness. In this work, we study how implicit bias, defined as subtle statistical prejudice, accumulates and propagates within LLMs equipped with long-term memory. To support systematic analysis, we introduce the Decision-based Implicit Bias (DIB) Benchmark, a large-scale dataset comprising 3,776 decision-making scenarios across nine social domains, designed to quantify implicit bias in long-term decision processes. Using a realistic long-horizon simulation framework, we evaluate six state-of-the-art LLMs integrated with three representative memory architectures on DIB and demonstrate that LLMs' implicit bias does not remain static but intensifies over time and propagates across unrelated domains. We further analyze mitigation strategies and show that a static system-level prompting baseline provides limited and short-lived debiasing effects. To address this limitation, we propose Dynamic Memory Tagging (DMT), an agentic intervention that enforces fairness constraints at memory write time. Extensive experimental results show that DMT substantially reduces bias accumulation and effectively curtails cross-domain bias propagation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 62 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
42 of 62 references.
References · 42
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
30 more
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
- 2021Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasetscited by 179
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
- 2020Recipes for Safety in Open-domain Chatbotscited by 168
- 2024LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuningcited by 133
- 2018A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual & Group Unfairness via Inequality Indicescited by 97
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
- 2024On Large Language Model Continual Unlearningcited by 51
- 2021Non-Transferable Learning: A New Approach for Model Ownership Verification and Applicability Authorizationcited by 50
- 2024Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender?cited by 24
- 2024Can We Trust Embodied Agents? Exploring Backdoor Attacks against Embodied LLM-based Decision-Making Systemscited by 23
- 2025The Eye of Sherlock Holmes: Uncovering User Private Attribute Profiling via Vision-Language Model Agentic Frameworkcited by 9
- 2025Token Buncher: Shielding LLMs from Harmful Reinforcement Learning Fine-Tuningcited by 7
- 2025The Man Behind the Sound: Demystifying Audio Private Attribute Profiling via Multimodal Large Language Model Agentscited by 5
- 2026AppellateGen: A Benchmark for Appellate Legal Judgment Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Inference-Time Reasoning Selectively Reduces Implicit Social Bias in Large Language Models
- 2026Conditional Cognitive Biases in LLMs: How Biased User Turns Modulate In-Context Reasoning
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions
- 2026Memory Contagion: Cross-Temporal Propagation of Evaluator Bias via Agent Memory
- 2024Anchoring Bias in Large Language Models: An Experimental Study
- 2025Debiasing LLMs by Masking Unfairness-Driving Attention Heads
- 2025Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflection