mlsanityData to 7 Oct 2026

Evaluating Evidence Grounding Under User Pressure in Instruction-Tuned Language Models

arXiv 2603.20162 ↗First posted 20 Mar 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

In contested domains, instruction-tuned language models must balance user-alignment pressures against faithfulness to the in-context evidence. To evaluate this tension, we introduce a controlled epistemic-conflict framework grounded in the U.S. National Climate Assessment. We conduct fine-grained ablations over evidence composition and uncertainty cues across 19 instruction-tuned models spanning 0.27B to 32B parameters. Across neutral prompts, richer evidence generally improves evidence-consistent accuracy and ordinal scoring performance. Under user pressure, however, evidence does not reliably prevent user-aligned reversals in this controlled fixed-evidence setting. We report three primary failure modes. First, we identify a negative partial-evidence interaction, where adding epistemic nuance, specifically research gaps, is associated with increased susceptibility to sycophancy in families like Llama-3 and Gemma-3. Second, robustness scales non-monotonically: within some families, certain low-to-mid scale models are especially sensitive to adversarial user pressure. Third, models differ in distributional concentration under conflict: some instruction-tuned models maintain sharply peaked ordinal distributions under pressure, while others are substantially more dispersed; in scale-matched Qwen comparisons, reasoning-distilled variants (DeepSeek-R1-Qwen) exhibit consistently higher dispersion than their instruction-tuned counterparts. These findings suggest that, in a controlled fixed-evidence setting, providing richer in-context evidence alone offers no guarantee against user pressure without explicit training for epistemic integrity.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

26 of 38 references.

References · 26

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  7. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  8. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  9. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  10. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  11. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  12. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
14 more
  1. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
  2. 2024Knowledge Conflicts for LLMs: A Surveycited by 274
  3. 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
  4. 2023Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noisecited by 52
  5. 2024Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentscited by 27
  6. 2025Taming Knowledge Conflicts in Language Modelscited by 27
  7. 2024Belief Revision: The Adaptability of Large Language Models Reasoningcited by 26
  8. 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
  9. 2025A Systematic Literature Review of Retrieval-Augmented Generation: Techniques, Metrics, and Challengescited by 16
  10. 2025Sycophancy under Pressure: Evaluating and Mitigating Sycophantic Bias via Adversarial Dialogues in Scientific QAcited by 16
  11. 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are Highcited by 11
  12. 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questionscited by 9
  13. 2023Performance Metrics for Probabilistic Ordinal Classifierscited by 5
  14. 2025Aleatoric and Epistemic Uncertainty Measures for Ordinal Classification through Binary Reductioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Trust, but Don't Verify: Epistemic Blind Spots in LLM Source Evaluation
  2. 2026Robust for the Wrong Reasons: The Representational Geometry of LLM Robustness to Science Skepticism
  3. 2026Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs
  4. 2026Context-Grounding Gains Are Mediated by Pre-existing Machinery: Auditing GRPO, SFT, and DPO
  5. 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth
  6. 2026Claim-Level Confidence Calibration for Reliable Decision Making with Large Language Models
  7. 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness
  8. 2025Can Finetuing LLMs on Small Human Samples Increase Heterogeneity, Alignment, and Belief-Action Coherence?