mlsanityData to 14 Oct 2026

Implicit Repair with Reinforcement Learning in Emergent Communication

arXiv 2502.12624 ↗First posted 18 Feb 2025cs.LG cs.MAcited by 2

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Conversational repair is a mechanism used to detect and resolve miscommunication and misinformation problems when two or more agents interact. One particular and underexplored form of repair in emergent communication is the implicit repair mechanism, where the interlocutor purposely conveys the desired information in such a way as to prevent misinformation from any other interlocutor. This work explores how redundancy can modify the emergent communication protocol to continue conveying the necessary information to complete the underlying task, even with additional external environmental pressures such as noise. We focus on extending the signaling game, called the Lewis Game, by adding noise in the communication channel and inputs received by the agents. Our analysis shows that agents add redundancy to the transmitted messages as an outcome to prevent the negative impact of noise on the task success. Additionally, we observe that the emerging communication protocol's generalization capabilities remain equivalent to architectures employed in simpler games that are entirely deterministic. Additionally, our method is the only one suitable for producing robust communication protocols that can handle cases with and without noise while maintaining increased generalization performance levels.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 24 of its 55 references that are in the map. First posted on arXiv 18 Feb 2025.

Builds on

24 of 55 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  7. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  8. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
  9. 2016Learning Multiagent Communication with Backpropagationcited by 366
  10. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 263
  11. 2020Experience Grounds Languagecited by 242
  12. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 185
12 more
  1. 2021Goal-Conditioned Reinforcement Learning with Imagined Subgoalscited by 134
  2. 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 125
  3. 2020Compositionality and Generalization in Emergent Languagescited by 103
  4. 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
  5. 2020Compositional Languages Emerge in a Neural Iterated Learning Modelcited by 75
  6. 2019Ease-of-Teaching and Language Structure from Emergent Communicationcited by 65
  7. 2019Anti-efficient encoding in emergent communicationcited by 59
  8. 2018Compositional Obverter Communication Learning From Raw Visual Inputcited by 30
  9. 2019The Emergence of Compositional Languages for Numeric Concepts Through Iterated Learning in Neural Agentscited by 26
  10. 2021Interpretable agent communication from scratch (with a generic visual processor emerging on the side)cited by 25
  11. 2022On the role of population heterogeneity in emergent communicationcited by 24
  12. 2018Emergence of Communication in an Interactive World with Consistent Speakerscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs
  2. 2026MUTE: Return-Preserving Communication Unlearning for Efficient Multi-Agent Coordination
  3. 2026Emergence, Not Bandwidth: Physical Coupling and the Limits of Learned Multi-Agent Communication
  4. 2026Talk is Cheap, Communication is Hard: Dynamic Grounding Failures and Repair in Multi-Agent Negotiation
  5. 2026Reinforcement Learning of Communication in a Mesh of Small Language Models
  6. 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning
  7. 2022Towards Human-Agent Communication via the Information Bottleneck Principle
  8. 2025In-Context Reinforcement Learning via Communicative World Models