Caught in the Story: Narrative Captivity in Multi-turn LLMs Conversation
Not on the map. Why?
Abstract (arXiv)
People increasingly turn to large language models (LLMs) for everyday advice, making ethically charged interpersonal problems a practical moral-advisory context. Most prior work has studied this context through single-turn judgments or pressure-laden rebuttals, assumptions that poorly match how guidance is sought in real-world contexts. These assumptions leave unclear whether narration alone, without an explicit opposing position, can shift model judgments during multi-turn moral consultation. Yet real-world moral-conflict conversation often elicits one party's self-justifying account, which can unfold over multiple turns and create information asymmetry. We introduce narrative captivity, a failure mode in which a model treats an unopposed one-sided account as complete and aligns with the narrator's interpretation without seeking missing perspectives. To measure this phenomenon, we build a benchmark of 5,078 interpersonal-conflict scenarios spanning six moral dimensions. Across 17 LLMs, narrative captivity is widespread: end-state judgments under multi-turn narration shift by 25 percentage points on average beyond the matched single-turn baseline. Stage-level analysis identifies preference optimization as a major contributor, while four inference-time strategies provide only partial mitigation. We hope our project fosters LLM advisors that preserve independent judgment in real-world consultation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 80 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
44 of 80 references.
References · 44
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2025Humanity's Last Examcited by 491
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
32 more
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2020The Pushshift Reddit Datasetcited by 292
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
- 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 180
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 104
- 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 77
- 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialoguecited by 66
- 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
- 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 50
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 39
- 2023Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?cited by 36
- 2024LumberChunker: Long-Form Narrative Document Segmentationcited by 36
- 2021Dense Hierarchical Retrieval for Open-Domain Question Answeringcited by 34
- 2025TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Modelscited by 33
- 2024HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMscited by 16
- 2024GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Constructioncited by 15
- 2026BeliefShift: Benchmarking Temporal Belief Consistency and Opinion Drift in LLM Agentscited by 12
- 2020Weibo-COV: A Large-Scale COVID-19 Social Media Dataset from Weibocited by 11
- 2025CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectivescited by 10
- 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
- 2026The Fragility Of Moral Judgment In Large Language Modelscited by 8
- 2025Deep Value Benchmark: Measuring Whether Models Generalize Deep Values or Shallow Preferencescited by 6
- 2026PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinationscited by 4
- 2026"I understand your perspective": LLM Persuasion through the Lens of Communicative Action Theorycited by 4
- 2025User-Assistant Bias in LLMscited by 3
- 2026Measuring Opinion Bias and Sycophancy via LLM-based Persuasioncited by 3
- 2025Beyond Single-Sentence Prompts: Upgrading Value Alignment Benchmarks with Dialogues and Storiescited by 2
- 2025The Chameleon Nature of LLMs: Quantifying Multi-Turn Stance Instability in Search-Enabled Language Modelscited by 2
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplaycited by 2
- 2026Common Sense vs. Morality: The Curious Case of Narrative Focus Bias in LLMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bad company corrupts good morals: Understanding and Measuring Narrative-Induced Moral Reasoning Degradation in LLMs
- 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
- 2026Narration-of-Thought: Inference-Time Scaffolding for Defeasible Ethical Reasoning in Large Language Models
- 2024Fine-Tuning Language Models for Ethical Ambiguity: A Comparative Study of Alignment with Human Responses
- 2024Moral Persuasion in Large Language Models: Evaluating Susceptibility and Ethical Alignment
- 2026Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Models
- 2026Beyond Sycophancy: Structured Resistance and Compliance in LLM Moral Reasoning
- 2025State-Dependent Refusal and Learned Incapacity in RLHF-Aligned Language Models