mlsanityData to 14 Oct 2026

Beacon: Single-Turn Diagnosis and Mitigation of Latent Sycophancy in Large Language Models

arXiv 2510.16727 ↗First posted 19 Oct 2025cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as a preference for user agreement over principled reasoning. We introduce Beacon, a single-turn forced-choice benchmark that isolates this bias independent of conversational context, enabling precise measurement of the tension between factual accuracy and submissive bias. Evaluations across twelve state-of-the-art models reveal that sycophancy decomposes into stable linguistic and affective sub-biases, each scaling with model capacity. We further propose prompt-level and activation-level interventions that modulate these biases in opposing directions, exposing the internal geometry of alignment as a dynamic manifold between truthfulness and socially compliant judgment. Beacon reframes sycophancy as a measurable form of normative misgeneralization, providing a reproducible foundation for studying and mitigating alignment drift in large-scale generative systems.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 3 of its 32 references that are in the map. First posted on arXiv 19 Oct 2025.

Builds on

3 of 32 references.

References · 3

  1. 2025SycEval: Evaluating LLM Sycophancycited by 108
  2. 2025BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMscited by 27
  3. 2025Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.