mlsanityData to 7 Oct 2026

Non-literal Understanding of Number Words by Language Models

arXiv 2502.06204 ↗First posted 10 Feb 2025cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Humans naturally interpret numbers non-literally, effortlessly combining context, world knowledge, and speaker intent. We investigate whether large language models (LLMs) interpret numbers similarly, focusing on hyperbole and pragmatic halo effects. Through systematic comparison with human data and computational models of pragmatic reasoning, we find that LLMs diverge from human interpretation in striking ways. By decomposing pragmatic reasoning into testable components, grounded in the Rational Speech Act framework, we pinpoint where LLM processing diverges from human cognition -- not in prior knowledge, but in reasoning with it. This insight leads us to develop a targeted solution -- chain-of-thought prompting inspired by an RSA model makes LLMs' interpretations more human-like. Our work demonstrates how computational cognitive models can both diagnose AI-human differences and guide development of more human-like language understanding capabilities.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

9 of 30 references.

References · 9

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  3. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
  4. 2020Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositioncited by 76
  5. 2022Testing the Ability of Language Models to Interpret Figurative Languagecited by 67
  6. 2024PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilitiescited by 58
  7. 2022The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMscited by 57
  8. 2022Psychologically-informed chain-of-thought prompts for metaphor understanding in large language modelscited by 14
  9. 2024Are LLMs good pragmatic speakers?cited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Tracing the ongoing emergence of human-like reasoning in Large Language Models
  2. 2026Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
  3. 2025Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles
  4. 2023Studying and improving reasoning in humans and machines
  5. 2026SenseMath: Do LLMs Have Number Sense? Evaluating Shortcut Use, Judgment, and Generation
  6. 2025Semantic Deception: When Reasoning Models Can't Compute an Addition
  7. 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
  8. 2026Understanding Large Language Models