# Emergence of Pragmatics from Referential Game between Theory of Mind Agents

arXiv: https://arxiv.org/abs/2001.07752 · HTML: https://mlsanity.com/paper/2001.07752/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Jan 2020.

## Built on by (most cited first, 17 of 17)

- [CodePDE: An Inference Framework for LLM-driven PDE Solver Generation](https://mlsanity.com/paper/2505.08783/) (2025)
- [Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction](https://mlsanity.com/paper/2506.07976/) (2025)
- [Few-shot Language Coordination by Modeling Theory of Mind](https://mlsanity.com/paper/2107.05697/) (2021)
- [Model-Based Opponent Modeling](https://mlsanity.com/paper/2108.01843/) (2021)
- [CAT: Content-Adaptive Image Tokenization](https://mlsanity.com/paper/2501.03120/) (2025)
- [Few-Shot Character Understanding in Movies as an Assessment to Meta-Learning of Theory-of-Mind](https://mlsanity.com/paper/2211.04684/) (2022)
- [A Review of the Applications of Deep Learning-Based Emergent Communication](https://mlsanity.com/paper/2407.03302/) (2024)
- [Towards More Human-like AI Communication: A Review of Emergent Communication Research](https://mlsanity.com/paper/2308.02541/) (2023)
- [Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability](https://mlsanity.com/paper/2106.03982/) (2021)
- [Emergence of hierarchical reference systems in multi-agent communication](https://mlsanity.com/paper/2203.13176/) (2022)
- [Iterative Teacher-Aware Learning](https://mlsanity.com/paper/2110.00137/) (2021)
- [CoMet: Metaphor-Driven Covert Communication for Multi-Agent Language Games](https://mlsanity.com/paper/2505.18218/) (2025)
- [Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channel](https://mlsanity.com/paper/2111.02827/) (2021)
- [A framework for the emergence and analysis of language in social learning agents](https://mlsanity.com/paper/2305.02632/) (2023)
- [BEDA: Belief Estimation as Probabilistic Constraints for Performing Strategic Dialogue Acts](https://mlsanity.com/paper/2512.24885/) (2025)
- [ECHo: A Visio-Linguistic Dataset for Event Causality Inference via Human-Centric Reasoning](https://mlsanity.com/paper/2305.14740/) (2023)
- [PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mind](https://mlsanity.com/paper/2504.15313/) (2025)

## Abstract (arXiv)

Pragmatics studies how context can contribute to language meanings. In human communication, language is never interpreted out of context, and sentences can usually convey more information than their literal meanings. However, this mechanism is missing in most multi-agent systems, restricting the communication efficiency and the capability of human-agent interaction. In this paper, we propose an algorithm, using which agents can spontaneously learn the ability to "read between lines" without any explicit hand-designed rules. We integrate the theory of mind (ToM) in a cooperative multi-agent pedagogical situation and propose an adaptive reinforcement learning (RL) algorithm to develop a communication protocol. ToM is a profound cognitive science concept, claiming that people regularly reason about other's mental states, including beliefs, goals, and intentions, to obtain performance advantage in competition, cooperation or coalition. With this ability, agents consider language as not only messages but also rational acts reflecting others' hidden states. Our experiments demonstrate the advantage of pragmatic protocols over non-pragmatic protocols. We also show the teaching complexity following the pragmatic protocol empirically approximates to recursive teaching dimension (RTD).