mlsanityData to 7 Oct 2026

Decentralized Collective World Model for Emergent Communication and Coordination

arXiv 2504.03353 ↗First posted 4 Apr 2025cs.MA cs.AIcited by 5

On the map: World models → World models for language agents

Abstract (arXiv)

We propose a fully decentralized multi-agent world model that enables both symbol emergence for communication and coordinated behavior through temporal extension of collective predictive coding. Unlike previous research that focuses on either communication or coordination separately, our approach achieves both simultaneously. Our method integrates world models with communication channels, enabling agents to predict environmental dynamics, estimate states from partial observations, and share critical information through bidirectional message exchange with contrastive learning for message alignment. Using a two-agent trajectory drawing task, we demonstrate that our communication-based approach outperforms non-communicative models when agents have divergent perceptual capabilities, achieving the second-best coordination after centralized models. Importantly, our decentralized approach with constraints preventing direct access to other agents' internal states facilitates the emergence of more meaningful symbol systems that accurately reflect environmental states. These findings demonstrate the effectiveness of decentralized communication for supporting coordination while developing shared representations of the environment.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 25 of its 36 references that are in the map. First posted on arXiv 4 Apr 2025.

Builds on

25 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Generative Emergent Communication: Large Language Model is a Collective World Model31 Dec

Other references · 24

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  3. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  5. 2023Mastering Diverse Domains through World Modelscited by 1,193
  6. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  7. 2013The Complexity of Decentralized Control of Markov Decision Processescited by 225
  8. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 168
  9. 2020Open Problems in Cooperative AIcited by 167
  10. 2022Multi-Agent Reinforcement Learning is a Sequence Modeling Problemcited by 153
  11. 2021V-Learning -- A Simple, Efficient, Decentralized Algorithm for Multiagent RLcited by 111
  12. 2019On the Pitfalls of Measuring Emergent Communicationcited by 66
12 more
  1. 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 57
  2. 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
  3. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
  4. 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
  5. 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
  6. 2024Emergent Language: A Survey and Taxonomycited by 12
  7. 2023Learning Multi-Agent Communication with Contrastive Learningcited by 9
  8. 2024Learning to Communicate Through Implicit Communication Channelscited by 7
  9. 2023Metropolis-Hastings algorithm in joint-attention naming game: Experimental semiotics studycited by 5
  10. 2023Control as Probabilistic Inference as an Emergent Communication Mechanism in Multi-Agent Reinforcement Learningcited by 3
  11. 2024Fully Independent Communication in Multi-Agent Reinforcement Learningcited by 3
  12. 2024SimSiam Naming Game: A Unified Approach for Emergent Communication and Representation Learningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Communicating Plans, Not Percepts: Scalable Multi-Agent Coordination with Embodied World Models
  2. 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperation
  3. 2024CoDreamer: Communication-Based Decentralised World Models
  4. 2025Benchmarking LLMs' Swarm intelligence
  5. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs
  6. 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximity
  7. 2026Embodied Multi-Agent Coordination by Aligning World Models Through Dialogue
  8. 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation