Emergent Communication through Negotiation
Not on the map. Why?
Abstract (arXiv)
Multi-agent reinforcement learning offers a way to study how communication could emerge in communities of agents needing to solve specific problems. In this paper, we study the emergence of communication in the negotiation environment, a semi-cooperative model of agent interaction. We introduce two communication protocols -- one grounded in the semantics of the game, and one which is textita priori ungrounded and is a form of cheap talk. We show that self-interested agents can use the pre-grounded communication channel to negotiate fairly, but are unable to effectively use the ungrounded channel. However, prosocial agents do learn to use cheap talk to find an optimal negotiating strategy, suggesting that cooperation is necessary for language to emerge. We also study communication behaviour in a setting where one agent interacts with agents in a community with different levels of prosociality and show how agent identifiability can aid negotiation.
Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 13; 2023: 9; 2024: 9; 2025: 8; 2026: 6.
62 papers.
Sort:
By area:
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 100
- 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 62
- 2025Embodied AI Agents: Modeling the Worldcited by 61
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulationscited by 34
- 2021Few-shot Language Coordination by Modeling Theory of Mindcited by 32
- 2021On the Critical Role of Conventions in Adaptive Human-AI Collaborationcited by 27
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 25
- 2021Learning to Draw: Emergent Communication through Sketchingcited by 23
- 2022AI for Global Climate Cooperation: Modeling Global Climate Negotiations, Agreements, and Long-Term Cooperation in RICE-Ncited by 22
38 more
- 2024K-Level Reasoning: Establishing Higher Order Beliefs in Large Language Models for Strategic Reasoningcited by 21
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2021Emergent Communication under Competitioncited by 18
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2021Emergent Graphical Conventions in a Visual Communication Gamecited by 16
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
- 2022Adversarial Cheap Talkcited by 16
- 2023Computational Language Acquisition with Theory of Mindcited by 15
- 2021The Emergence of the Shape Bias Results from Communicative Efficiencycited by 13
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 13
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 12
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2023Information Design in Multi-Agent Reinforcement Learningcited by 9
- 2025Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interactioncited by 9
- 2022RILI: Robustly Influencing Latent Intentcited by 8
- 2021Normative Disagreement as a Challenge for Cooperative AIcited by 7
- 2024Advantage Alignment Algorithmscited by 7
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2022MA-Dreamer: Coordination and communication through shared imaginationcited by 6
- 2023Combining Tree-Search, Generative Models, and Nash Bargaining Concepts in Game-Theoretic Reinforcement Learningcited by 6
- 2021The emergence of visual semantics through communication gamescited by 5
- 2022Learning Latent Representations to Co-Adapt to Humanscited by 5
- 2024Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoningcited by 5
- 2022Over-communicate no more: Situated RL agents learn concise communication protocolscited by 4
- 2021TexRel: a Green Family of Datasets for Emergent Communications on Relationscited by 3
- 2021Targeted Data Acquisition for Evolving Negotiation Agentscited by 3
- 2021Learning to Guide and to Be Guided in the Architect-Builder Problemcited by 3
- 2022Emergence of Machine Language: Towards Symbolic Intelligence with Neural Networkscited by 3
- 2022Beyond Rewards: a Hierarchical Perspective on Offline Multiagent Behavioral Analysiscited by 3
- 2023Emergent Communication in Interactive Sketch Question Answeringcited by 3
- 2022Recommendations for Systematic Research on Emergent Languagecited by 2
- 2024A Contextual Combinatorial Bandit Approach to Negotiationcited by 2
- 2025Playpen: An Environment for Exploring Learning Through Conversational Interactioncited by 2
- 2025Learning Robust Social Strategies with Large Language Modelscited by 2
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Modelscited by 2
- 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantizationcited by 2
- 2021gComm: An environment for investigating generalization in Grounded Language Acquisitioncited by 1
50 most cited of 62 All 62 (JSON)
- 2026Persistent Partners Raise Prices Among Learning Agents28 Sep 2026
- 2026Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs2 May 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantization2 Feb 2026
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Models28 Jan 2026
- 2026CtD: Composition through Decomposition in Emergent Communication15 Jan 2026
- 2025neuralFOMO: Can LLMs Handle Being Second Best? Measuring Envy-Like Preferences in Multi-Agent Settings15 Dec 2025
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordia3 Dec 2025
- 2025Learning Robust Social Strategies with Large Language Models24 Nov 2025
- 2025Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interaction23 Oct 2025
- 2025MusicSwarm: Biologically Inspired Intelligence for Music Composition15 Sep 2025
- 2025Embodied AI Agents: Modeling the World27 Jun 2025
38 more
- 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulations19 May 2025
- 2025Playpen: An Environment for Exploring Learning Through Conversational Interaction11 Apr 2025
- 2024Bidirectional Emergent Language in Situated Environments26 Aug 2024
- 2024Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoning8 Jul 2024
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2024A Contextual Combinatorial Bandit Approach to Negotiation30 Jun 2024
- 2024Advantage Alignment Algorithms20 Jun 2024
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agents4 Apr 2024
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb 2024
- 2024K-Level Reasoning: Establishing Higher Order Beliefs in Large Language Models for Strategic Reasoning2 Feb 2024
- 2024Emergent Communication in Continuous Worlds: Self-Organisation of Conceptually Grounded Vocabularies at Scale16 Jan 2024
- 2023Emergent Communication in Interactive Sketch Question Answering24 Oct 2023
- 2023Cheap Talking Algorithms11 Oct 2023
- 2023Deconstructing Cooperation and Ostracism via Multi-Agent Reinforcement Learning6 Oct 2023
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Research1 Aug 2023
- 2023Inductive Bias for Emergent Communication in a Continuous Setting6 Jun 2023
- 2023Networked Communication for Decentralised Agents in Mean-Field Games5 Jun 2023
- 2023Information Design in Multi-Agent Reinforcement Learning8 May 2023
- 2023Computational Language Acquisition with Theory of Mind2 Mar 2023
- 2023Combining Tree-Search, Generative Models, and Nash Bargaining Concepts in Game-Theoretic Reinforcement Learning1 Feb 2023
- 2022Learning Latent Representations to Co-Adapt to Humans19 Dec 2022
- 2022Adversarial Cheap Talk20 Nov 2022
- 2022Over-communicate no more: Situated RL agents learn concise communication protocols2 Nov 2022
- 2022A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayal23 Oct 2022
- 2022AI for Global Climate Cooperation: Modeling Global Climate Negotiations, Agreements, and Long-Term Cooperation in RICE-N15 Aug 2022
- 2022Recommendations for Systematic Research on Emergent Language22 Jun 2022
- 2022Beyond Rewards: a Hierarchical Perspective on Offline Multiagent Behavioral Analysis17 Jun 2022
- 2022Scalable Multi-Agent Model-Based Reinforcement Learning25 May 2022
- 2022MA-Dreamer: Coordination and communication through shared imagination10 Apr 2022
- 2022Distributed Reinforcement Learning for Robot Teams: A Review7 Apr 2022
- 2022RILI: Robustly Influencing Latent Intent23 Mar 2022
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communication16 Mar 2022
- 2022Emergence of Machine Language: Towards Symbolic Intelligence with Neural Networks14 Jan 2022
- 2021Learning to Guide and to Be Guided in the Architect-Builder Problem14 Dec 2021
- 2021Emergent Graphical Conventions in a Visual Communication Game28 Nov 2021
- 2021Normative Disagreement as a Challenge for Cooperative AI27 Nov 2021
- 2021Learning to Ground Multi-Agent Communication with Autoencoders28 Oct 2021
- 2021The Emergence of the Shape Bias Results from Communicative Efficiency13 Sep 2021
50 newest of 62 All 62 (JSON)
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 100
- 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulationscited by 34
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 12
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2025Learning Robust Social Strategies with Large Language Modelscited by 2
- 2025neuralFOMO: Can LLMs Handle Being Second Best? Measuring Envy-Like Preferences in Multi-Agent Settingscited by 1
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2025neuralFOMO: Can LLMs Handle Being Second Best? Measuring Envy-Like Preferences in Multi-Agent Settings15 Dec 2025
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordia3 Dec 2025
- 2025Learning Robust Social Strategies with Large Language Models24 Nov 2025
- 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulations19 May 2025
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb 2024
- 2025Embodied AI Agents: Modeling the Worldcited by 61
- 2025Embodied AI Agents: Modeling the World27 Jun 2025
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 62
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2021Few-shot Language Coordination by Modeling Theory of Mindcited by 32
- 2021On the Critical Role of Conventions in Adaptive Human-AI Collaborationcited by 27
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 25
- 2021Learning to Draw: Emergent Communication through Sketchingcited by 23
- 2022AI for Global Climate Cooperation: Modeling Global Climate Negotiations, Agreements, and Long-Term Cooperation in RICE-Ncited by 22
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2021Emergent Communication under Competitioncited by 18
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
12 most cited of 50 All 50 (JSON)
- 2026Persistent Partners Raise Prices Among Learning Agents28 Sep 2026
- 2026Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs2 May 2026
- 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantization2 Feb 2026
- 2026CtD: Composition through Decomposition in Emergent Communication15 Jan 2026
- 2025Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interaction23 Oct 2025
- 2025MusicSwarm: Biologically Inspired Intelligence for Music Composition15 Sep 2025
- 2024Bidirectional Emergent Language in Situated Environments26 Aug 2024
- 2024A Contextual Combinatorial Bandit Approach to Negotiation30 Jun 2024
- 2024Advantage Alignment Algorithms20 Jun 2024
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agents4 Apr 2024
- 2024Emergent Communication in Continuous Worlds: Self-Organisation of Conceptually Grounded Vocabularies at Scale16 Jan 2024
- 2023Emergent Communication in Interactive Sketch Question Answering24 Oct 2023
12 newest of 50 All 50 (JSON)