Communicating with Speakers and Listeners of Different Pragmatic Levels
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
This paper explores the impact of variable pragmatic competence on communicative success through simulating language learning and conversing between speakers and listeners with different levels of reasoning abilities. Through studying this interaction, we hypothesize that matching levels of reasoning between communication partners would create a more beneficial environment for communicative success and language learning. Our research findings indicate that learning from more explicit, literal language is advantageous, irrespective of the learner's level of pragmatic competence. Furthermore, we find that integrating pragmatic reasoning during language learning, not just during evaluation, significantly enhances overall communication performance. This paper provides key insights into the importance of aligning reasoning levels and incorporating pragmatic reasoning in optimizing communicative interactions.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 12 of its 36 references that are in the map. First posted on arXiv 8 Oct 2024.
Builds on
12 of 36 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2016Reasoning About Pragmatics with Neural Listeners and Speakerscited by 68
- 2020Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learningcited by 66
- 2017Unified Pragmatic Models for Generating and Following Instructionscited by 55
- 2018Pragmatically Informative Image Captioning with Character-Level Inferencecited by 42
- 2017ShapeWorld - A new test methodology for multimodal language understandingcited by 37
- 2021From partners to populations: A hierarchical Bayesian account of coordination and conventioncited by 27
- 2020Learning to refer informatively by amortizing pragmatic reasoningcited by 17
- 2015Learning in the Rational Speech Acts Modelcited by 16
- 2023Computational Language Acquisition with Theory of Mindcited by 15
- 2018Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialogcited by 11
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts
- 2025The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models
- 2026Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity
- 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
- 2026Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry
- 2025Pragmatic Theories Enhance Understanding of Implied Meanings in LLMs
- 2025Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models
- 2025Understand the Implication: Learning to Think for Pragmatic Understanding