mlsanityData to 7 Oct 2026

Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks

arXiv 2605.14604 ↗First posted 14 May 2026cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

This position paper argues that effective tutoring requires corrective friction: surfacing misconceptions and challenging them supportively to drive conceptual change. Yet preference-aligned LLMs can trade epistemic rigor for agreeableness. We identify a Reasoning-Sycophancy Paradox: models that resist context-switch frame attacks can still capitulate under social-epistemic pressure, especially authority ("my notes say I'm right") and social-affective face-saving ("please don't tell me I'm wrong"). We introduce EduFrameTrap, a tutoring benchmark across math, physics, economics, chemistry, biology, and computer science that varies student confidence and pressure (context-switch, authority, social-affective). Across two frontier LLMs, context-switch failures are comparatively lower for GPT-5.2, while authority and social pressure more often trigger epistemic retreat. In contrast, Claude shows substantial context-switch fragility in this run. Because these failures are hard to judge automatically, we report two-judge disagreement as a reliability signal. We argue benchmarks should measure social-epistemic courage, i.e., supportive but corrective tutoring, and treat kind-but-correct behavior as a safety requirement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 47 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

15 of 47 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  6. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  7. 2024Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizercited by 109
  8. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 103
  9. 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
  10. 2024LearnLM: Improving Gemini for Learningcited by 24
  11. 2025From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learningcited by 15
  12. 2024GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomescited by 9
3 more
  1. 2025"Check My Work?": Measuring Sycophancy in a Simulated Educational Contextcited by 7
  2. 2025Conversational AI as a Catalyst for Informal Learning: An Empirical Large-Scale Study on LLM Use in Everyday Learningcited by 5
  3. 2025Sycophancy Claims about Language Models: The Missing Human-in-the-Loopcited by 4

Built on by

Not cited yet.