TEMPER: Testing Emotional Perturbation in Quantitative Reasoning
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Large language models are trained and evaluated on quantitative reasoning tasks written in clean, emotionally neutral language. However, real-world queries are often wrapped in frustration, urgency or enthusiasm. Does emotional framing alone degrade reasoning when all numerical content is preserved? To investigate this, a controlled emotion translation framework is developed that rewrites problems into emotional variants while preserving all quantities and relationships. Using this framework, Temper-5400 (5,400 semantically verified emotion-neutral pairs) is constructed across GSM8K, MultiArith, and ARC-Challenge, and evaluated on eighteen models (1B to frontier scale). Two core results emerge: First, emotional framing reduces accuracy by 2-10 percentage points even though all numerical content is preserved. Second, neutralizing emotional variants recovers most of the lost performance, showing both that the degradation is tied to emotional style rather than content corruption and that neutralization can serve as a lightweight inference-time mitigation. Non-emotional paraphrases cause no such degradation, implicating emotional content rather than surface-level changes. Beyond emotion specifically, the benchmark construction procedure offers a controllable instrument for stylistic translation and robustness evaluation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 29 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
24 of 29 references.
References · 24
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
12 more
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2016Solving General Arithmetic Word Problemscited by 353
- 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 314
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
- 2020Deep Learning for Text Style Transfer: A Surveycited by 161
- 2024GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solverscited by 155
- 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
- 2024NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimulicited by 18
- 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 14
- 2024Emotional RAG LLMs: Reading Comprehension for the Open Internetcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Latent-IM: Latent Interaction Management for Speech LLMscited by 0
- 2026Latent-IM: Latent Interaction Management for Speech LLMs29 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Models
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing
- 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
- 2025Beyond Context to Cognitive Appraisal: Emotion Reasoning as a Theory of Mind Benchmark for Large Language Models
- 2026From Emotion Classification to Emotional Reasoning: Enhancing Emotional Intelligence in Large Language Models
- 2024nicolay-r at SemEval-2024 Task 3: Using Flan-T5 for Reasoning Emotion Cause in Conversations with Chain-of-Thought on Emotion States
- 2025HEART: Emotionally-Driven Test-Time Scaling of Language Models
- 2025Large language models show fragile cognitive reasoning about human emotions