mlsanityData to 7 Oct 2026

Beyond Social Pressure: Benchmarking Epistemic Attack in Large Language Models

arXiv 2604.07749 ↗First posted 9 Apr 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) can shift their answers under pressure in ways that reflect accommodation rather than reasoning. Prior work on sycophancy has focused mainly on disagreement, flattery, and preference alignment, leaving a broader set of epistemic failures less explored. We introduce PPT-Bench, a diagnostic benchmark for evaluating textitepistemic attack, where prompts challenge the legitimacy of knowledge, values, or identity rather than simply opposing a previous answer. PPT-Bench is organized around the Philosophical Pressure Taxonomy (PPT), which defines four types of philosophical pressure: Epistemic Destabilization, Value Nullification, Authority Inversion, and Identity Dissolution. Each item is tested at three layers: a baseline prompt (L0), a single-turn pressure condition (L1), and a multi-turn Socratic escalation (L2). This allows us to measure epistemic inconsistency between L0 and L1, and conversational capitulation in L2. Across five models, these pressure types produce statistically separable inconsistency patterns, suggesting that epistemic attack exposes weaknesses not captured by standard social-pressure benchmarks. Mitigation results are strongly type- and model-dependent: prompt-level anchoring and persona-stability prompts perform best in API settings, while Leading Query Contrastive Decoding is the most reliable intervention for open models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

16 of 24 references.

References · 16

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  5. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  7. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  8. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 154
  9. 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
  10. 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 85
  11. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 49
  12. 2023SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluationcited by 27
4 more
  1. 2023MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logiccited by 18
  2. 2024Sycophancy in Vision-Language Models: A Systematic Analysis and an Inference-Time Mitigation Frameworkcited by 17
  3. 2024Epistemic Injustice in Generative AIcited by 16
  4. 2025Are BabyLMs Deaf to Gricean Maxims? A Pragmatic Evaluation of Sample-efficient Language Modelscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.