ChatGPT Reads Your Tone and Responds Accordingly -- Until It Does Not -- Emotional Framing Induces Bias in LLM Outputs
Not on the map. Why?
Abstract (arXiv)
Large Language Models like GPT-4 adjust their responses not only based on the question asked, but also on how it is emotionally phrased. We systematically vary the emotional tone of 156 prompts - spanning controversial and everyday topics - and analyze how it affects model responses. Our findings show that GPT-4 is three times less likely to respond negatively to a negatively framed question than to a neutral one. This suggests a "rebound" bias where the model overcorrects, often shifting toward neutrality or positivity. On sensitive topics (e.g., justice or politics), this effect is even more pronounced: tone-based variation is suppressed, suggesting an alignment override. We introduce concepts like the "tone floor" - a lower bound in response negativity - and use tone-valence transition matrices to quantify behavior. Visualizations based on 1536-dimensional embeddings confirm semantic drift based on tone. Our work highlights an underexplored class of biases driven by emotional framing in prompts, with implications for AI alignment and trust. Code and data are available at: https://github.com/bardolfranck/llm-responses-viewer
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 3 of its 5 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
3 of 5 references.
References · 3
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Too Open for Opinion? Embracing Open-Endedness in Large Language Models for Social Simulationcited by 1
- 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systemscited by 1
- 2026Evaluating the Usage of African-American Vernacular English in Large Language Modelscited by 0
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathycited by 0
- 2026Defeat Devices in AI Systemscited by 0
- 2026Reporting Under Pressure: Separating Factual and Tonal Sycophancy in LLM Statistical Analysiscited by 0
- 2026Reporting Under Pressure: Separating Factual and Tonal Sycophancy in LLM Statistical Analysis15 Aug 2026
- 2026Defeat Devices in AI Systems27 Jun 2026
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathy12 Apr 2026
- 2026Evaluating the Usage of African-American Vernacular English in Large Language Models25 Feb 2026
- 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systems23 Dec 2025
- 2025Too Open for Opinion? Embracing Open-Endedness in Large Language Models for Social Simulation14 Oct 2025