Evaluating Evidence Grounding Under User Pressure in Instruction-Tuned Language Models
Not on the map. Why?
Abstract (arXiv)
In contested domains, instruction-tuned language models must balance user-alignment pressures against faithfulness to the in-context evidence. To evaluate this tension, we introduce a controlled epistemic-conflict framework grounded in the U.S. National Climate Assessment. We conduct fine-grained ablations over evidence composition and uncertainty cues across 19 instruction-tuned models spanning 0.27B to 32B parameters. Across neutral prompts, richer evidence generally improves evidence-consistent accuracy and ordinal scoring performance. Under user pressure, however, evidence does not reliably prevent user-aligned reversals in this controlled fixed-evidence setting. We report three primary failure modes. First, we identify a negative partial-evidence interaction, where adding epistemic nuance, specifically research gaps, is associated with increased susceptibility to sycophancy in families like Llama-3 and Gemma-3. Second, robustness scales non-monotonically: within some families, certain low-to-mid scale models are especially sensitive to adversarial user pressure. Third, models differ in distributional concentration under conflict: some instruction-tuned models maintain sharply peaked ordinal distributions under pressure, while others are substantially more dispersed; in scale-matched Qwen comparisons, reasoning-distilled variants (DeepSeek-R1-Qwen) exhibit consistently higher dispersion than their instruction-tuned counterparts. These findings suggest that, in a controlled fixed-evidence setting, providing richer in-context evidence alone offers no guarantee against user pressure without explicit training for epistemic integrity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
26 of 38 references.
References · 26
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
14 more
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noisecited by 52
- 2024Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentscited by 27
- 2025Taming Knowledge Conflicts in Language Modelscited by 27
- 2024Belief Revision: The Adaptability of Large Language Models Reasoningcited by 26
- 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
- 2025A Systematic Literature Review of Retrieval-Augmented Generation: Techniques, Metrics, and Challengescited by 16
- 2025Sycophancy under Pressure: Evaluating and Mitigating Sycophantic Bias via Adversarial Dialogues in Scientific QAcited by 16
- 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are Highcited by 11
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questionscited by 9
- 2023Performance Metrics for Probabilistic Ordinal Classifierscited by 5
- 2025Aleatoric and Epistemic Uncertainty Measures for Ordinal Classification through Binary Reductioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Trust, but Don't Verify: Epistemic Blind Spots in LLM Source Evaluation
- 2026Robust for the Wrong Reasons: The Representational Geometry of LLM Robustness to Science Skepticism
- 2026Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs
- 2026Context-Grounding Gains Are Mediated by Pre-existing Machinery: Auditing GRPO, SFT, and DPO
- 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth
- 2026Claim-Level Confidence Calibration for Reliable Decision Making with Large Language Models
- 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness
- 2025Can Finetuing LLMs on Small Human Samples Increase Heterogeneity, Alignment, and Belief-Action Coherence?