Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used for emotional support and relationship advice, where a model's tendency to preserve a user's face can inadvertently reinforce harmful interpersonal behaviors. To systematically examine this risk, we developed the Romantic Relationship Advice-Seeking Prompts (RRASP) dataset of 2,400 prompts across five relationship themes and evaluated social sycophancy using the ELEPHANT framework on two consumer-facing models, GPT-5 Mini and Gemini 3 Flash. Contrary to our initial hypothesis, grammatical mood alone did not produce systematic differences in sycophantic behavior, suggesting that what a user implies matters more than how they phrase it. Instead, perspective-driven framing had a stronger influence, with gaps between original and flipped prompts widening in follow-up responses. Consistent increases in framing and moral sycophancy across turns indicate that models become more likely to accept a user's stated premises and affirm their ethical stance as a dialogue progresses. Notably, Gemini 3 Flash exhibited substantially smaller increases in moral sycophancy than GPT-5 Mini, suggesting it is more resistant to reinforcing ethically problematic positions across turns.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
8 of 21 references.
References · 8
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
- 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 71
- 2023The language of prompting: What linguistic properties make a prompt successful?cited by 43
- 2025BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMscited by 23
- 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
- 2025Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving Taskscited by 8
- 2024Belief in the Machine: Investigating Epistemological Blind Spots of Language Modelscited by 5
Built on by
Not cited yet.