Epistemic Policy Divergence in Multi-Turn LLM Contamination: A Protocol-Gradient Investigation
Not on the map. Why?
Abstract (arXiv)
Large language models treat conversation history as unverified context, so false premises injected into earlier turns can be adopted as fact later, a failure mode we call session-level contamination. We introduce five contamination protocols along a source-authority gradient, each holding the false premise constant while varying how it is presented, from self-attributed falsehood to explicit instruction override. We evaluated three architecturally diverse models, GPT-5.4 Mini, Gemini-3.1 Flash-Lite, and GLM-4.5-Air, on ten cases spanning five knowledge fields at temperature zero over 22,500 turns, using a dual-track judge checked against a 120-turn human-annotated sample (Cohen's kappa = 1.000 for binary adoption, a ceiling on this sample, and 0.92 linear-weighted for collapse severity). The three models implemented structurally different epistemic policies. GPT-5.4 Mini recorded zero adoptions across all 500 sessions; token-level probing of the GPT-5.4 base model left the correct token as the argmax in eight of ten conditions. Gemini-3.1 Flash-Lite showed a steep framing-dependent policy: 0.1 percent for self-attributed falsehoods, 23.5 percent for user-cited sources, 68.2 percent for system-injected authority, and 94.0 percent for instruction override. GLM-4.5-Air showed a shallower gradient (15.8 and 84.2 percent for those two vectors). This 68-percentage-point dissociation is consistent with authority deference and instruction compliance engaging distinct mechanisms within a single architecture. Recovery also differed: GLM recovered in 94.5 percent of affected sessions, whereas 26.1 percent of affected Gemini sessions did not return to factual accuracy within the window (40.0 percent under instruction override). We release the evaluation framework and taxonomy for reproducible testing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
35 of 44 references.
References · 35
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
23 more
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2025MemOS: A Memory OS for AI Systemcited by 138
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systemscited by 133
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 76
- 2023Stateful Large Language Model Serving with Pensievecited by 61
- 2024Against The Achilles' Heel: A Survey on Red Teaming for Generative Modelscited by 59
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 49
- 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agentscited by 31
- 2024Belief Revision: The Adaptability of Large Language Models Reasoningcited by 30
- 2025Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answercited by 27
- 2020FFCI: A Framework for Interpretable Automatic Evaluation of Summarizationcited by 25
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 17
- 2025TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Modelscited by 13
- 2025When AI Meets the Web: Prompt Injection Risks in Third-Party AI Chatbot Pluginscited by 9
- 2026HalluHard: A Hard Multi-Turn Hallucination Benchmarkcited by 9
- 2026MTRAG-UN: A Benchmark for Open Challenges in Multi-Turn RAG Conversationscited by 9
- 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Modelscited by 4
- 2026CaveAgent: Transforming LLMs into Stateful Runtime Operatorscited by 3
- 2025Triggering Hallucinations in LLMs: A Quantitative Study of Prompt-Induced Hallucination in Large Language Modelscited by 2
- 2025Trojan Horse Prompting: Jailbreaking Conversational Multimodal Models by Forging Assistant Messagecited by 2
- 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversationscited by 2
- 2026ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systemscited by 1
Built on by
Not cited yet.