mlsanityData to 7 Oct 2026

Towards an Analysis of Discourse and Interactional Pragmatic Reasoning Capabilities of Large Language Models

arXiv 2408.03074 ↗First posted 6 Aug 2024cs.CLcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

In this work, we want to give an overview on which pragmatic abilities have been tested in LLMs so far and how these tests have been carried out. To do this, we first discuss the scope of the field of pragmatics and suggest a subdivision into discourse pragmatics and interactional pragmatics. We give a non-exhaustive overview of the phenomena of those two subdomains and the methods traditionally used to analyze them. We subsequently consider the resulting heterogeneous set of phenomena and methods as a starting point for our survey of work on discourse pragmatics and interactional pragmatics in the context of LLMs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 5 of its 31 references that are in the map. First posted on arXiv 6 Aug 2024.

Builds on

5 of 31 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities16 Nov
  2. 2023Understanding Social Reasoning in Language Models with Language Models21 Jun

Other references · 3

  1. 2023Language Model Behavior: A Comprehensive Surveycited by 92
  2. 2022The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMscited by 57
  3. 2023Expectations over Unspoken Alternatives Predict Pragmatic Inferencescited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts
  2. 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
  3. 2025The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models
  4. 2026Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity
  5. 2025Pragmatic Theories Enhance Understanding of Implied Meanings in LLMs
  6. 2025Position: On the Methodological Pitfalls of Evaluating Base LLMs for Reasoning
  7. 2026Computational models of pragmatic reasoning with flexible generation of meaning and expression alternatives
  8. 2023Evaluating statistical language models as pragmatic reasoners