Non-literal Understanding of Number Words by Language Models
Not on the map. Why?
Abstract (arXiv)
Humans naturally interpret numbers non-literally, effortlessly combining context, world knowledge, and speaker intent. We investigate whether large language models (LLMs) interpret numbers similarly, focusing on hyperbole and pragmatic halo effects. Through systematic comparison with human data and computational models of pragmatic reasoning, we find that LLMs diverge from human interpretation in striking ways. By decomposing pragmatic reasoning into testable components, grounded in the Rational Speech Act framework, we pinpoint where LLM processing diverges from human cognition -- not in prior knowledge, but in reasoning with it. This insight leads us to develop a targeted solution -- chain-of-thought prompting inspired by an RSA model makes LLMs' interpretations more human-like. Our work demonstrates how computational cognitive models can both diagnose AI-human differences and guide development of more human-like language understanding capabilities.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
9 of 30 references.
References · 9
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
- 2020Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositioncited by 76
- 2022Testing the Ability of Language Models to Interpret Figurative Languagecited by 67
- 2024PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilitiescited by 58
- 2022The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMscited by 57
- 2022Psychologically-informed chain-of-thought prompts for metaphor understanding in large language modelscited by 14
- 2024Are LLMs good pragmatic speakers?cited by 7
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Conceptscited by 5
- 2025(RSA)2: A Rhetorical-Strategy-Aware Rational Speech Act Framework for Figurative Language Understandingcited by 0
- 2025Pragmatics beyond humans: meaning, communication, and LLMscited by 0
- 2026Social Meaning in Large Language Models: Structure, Magnitude, and Pragmatic Promptingcited by 0
- 2026Continuous Interpretive Steering for Scalar Diversitycited by 0
- 2026PragReST: Self-Reinforcing Counterfactual Reasoning for Pragmatic Language Understandingcited by 0
- 2026Instrument Effects in Language-Model Honesty Evaluation: An Auditable Single-System Demonstrationcited by 0
- 2026Computational models of pragmatic reasoning with flexible generation of meaning and expression alternativescited by 0
- 2026CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognitioncited by 0
- 2026CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition18 Sep 2026
- 2026Computational models of pragmatic reasoning with flexible generation of meaning and expression alternatives20 Jul 2026
- 2026Instrument Effects in Language-Model Honesty Evaluation: An Auditable Single-System Demonstration15 Jul 2026
- 2026PragReST: Self-Reinforcing Counterfactual Reasoning for Pragmatic Language Understanding17 Jun 2026
- 2026Continuous Interpretive Steering for Scalar Diversity8 Apr 2026
- 2026Social Meaning in Large Language Models: Structure, Magnitude, and Pragmatic Prompting2 Apr 2026
- 2025On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts8 Sep 2025
- 2025Pragmatics beyond humans: meaning, communication, and LLMs8 Aug 2025
- 2025(RSA)2: A Rhetorical-Strategy-Aware Rational Speech Act Framework for Figurative Language Understanding10 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Tracing the ongoing emergence of human-like reasoning in Large Language Models
- 2026Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
- 2025Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles
- 2023Studying and improving reasoning in humans and machines
- 2026SenseMath: Do LLMs Have Number Sense? Evaluating Shortcut Use, Judgment, and Generation
- 2025Semantic Deception: When Reasoning Models Can't Compute an Addition
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 2026Understanding Large Language Models