Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Large multimodal reasoning models (LMRMs) are increasingly capable, largely through generating explicit chain-of-thought reasoning before answering, but in language models this often comes with sycophancy, the tendency to agree with the user over the evidence, and no reliable method to measure it in LMRMs yet exists. We bridge this gap with a benchmark and dataset for LMRM sycophancy when a user asserts a wrong answer, pairing four visually grounded datasets spanning mathematical, clinical, temporal, and demographic reasoning with five pressure conditions in single-turn and multi-turn settings, scored both in the final answer and within the reasoning chain. Sycophancy is prevalent under pressure: Statement pressure elicits the highest rates and Conviction among the lowest for all models except Mistral-Small-4, and under multi-turn pressure reasoning-level sycophancy intensifies sharply in PathVQA, reaching 95.7% for the most affected model. We further introduce a failure taxonomy separating reasoning-chain from answer-level sycophancy, and an exploratory sentence-level taxonomy locating where drift first emerges. A targeted intervention that restores a model's own correct reasoning recovers 79.2% of sycophantic answers on reasoning-heavy tasks, showing the answer follows the sycophantic reasoning rather than merely co-occurring with it. Thus, sycophancy corrupts not just the answer but the reasoning that produces it, so the chain itself is what we must measure.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 23 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
13 of 23 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
- 2024Sycophancy in Vision-Language Models: A Systematic Analysis and an Inference-Time Mitigation Frameworkcited by 17
- 2024Have the VLMs Lost Confidence? A Study of Sycophancy in VLMscited by 15
- 2025MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Modelscited by 12
- 2025BBQ-V: Benchmarking Visual Stereotype Bias in Large Multimodal Modelscited by 11
- 2025EchoBench: Benchmarking Sycophancy in Medical Large Vision-Language Modelscited by 9
- 2025Benchmarking and Mitigating Sycophancy in Medical Vision Language Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025PENDULUM: A Benchmark for Assessing Sycophancy in Multimodal Large Language Models
- 2026Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialogues
- 2026SPINE: Measuring LLM Sycophancy under Sustained Multi-Turn Pressure
- 2025Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMs
- 2026Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models
- 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
- 2025Pointing to a Llama and Call it a Camel: On the Sycophancy of Multimodal Large Language Models