mlsanityData to 7 Oct 2026

Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice

arXiv 2609.13841 ↗First posted 12 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used for emotional support and relationship advice, where a model's tendency to preserve a user's face can inadvertently reinforce harmful interpersonal behaviors. To systematically examine this risk, we developed the Romantic Relationship Advice-Seeking Prompts (RRASP) dataset of 2,400 prompts across five relationship themes and evaluated social sycophancy using the ELEPHANT framework on two consumer-facing models, GPT-5 Mini and Gemini 3 Flash. Contrary to our initial hypothesis, grammatical mood alone did not produce systematic differences in sycophantic behavior, suggesting that what a user implies matters more than how they phrase it. Instead, perspective-driven framing had a stronger influence, with gaps between original and flipped prompts widening in follow-up responses. Consistent increases in framing and moral sycophancy across turns indicate that models become more likely to accept a user's stated premises and affirm their ethical stance as a dialogue progresses. Notably, Gemini 3 Flash exhibited substantially smaller increases in moral sycophancy than GPT-5 Mini, suggesting it is more resistant to reinforcing ethically problematic positions across turns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

8 of 21 references.

References · 8

  1. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  2. 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
  3. 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 71
  4. 2023The language of prompting: What linguistic properties make a prompt successful?cited by 43
  5. 2025BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMscited by 23
  6. 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
  7. 2025Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving Taskscited by 8
  8. 2024Belief in the Machine: Investigating Epistemological Blind Spots of Language Modelscited by 5

Built on by

Not cited yet.