SimSiam Naming Game: A Unified Approach for Emergent Communication and Representation Learning
Not on the map. Why?
Abstract (arXiv)
Emergent Communication (EmCom) investigates how agents develop symbolic communication through interaction without predefined language. Recent frameworks, such as the Metropolis--Hastings Naming Game (MHNG), formulate EmCom as the learning of shared external representations negotiated through interaction under joint attention, without explicit success or reward feedback. However, MHNG relies on sampling-based updates that suffer from high rejection rates in high-dimensional perceptual spaces, making the learning process sample-inefficient for complex visual datasets. In this work, we propose the SimSiam Naming Game (SSNG), a feedback-free EmCom framework that replaces sampling-based updates with a symmetric, self-supervised representation alignment objective between autonomous agents. Building on a variational inference--based probabilistic interpretation of self-supervised learning, SSNG formulates symbol emergence as an alignment process between agents' latent representations mediated by message exchange. To enable end-to-end gradient-based optimization, discrete symbolic messages are learned via a Gumbel--Softmax relaxation, preserving the discrete nature of communication while maintaining differentiability. Experiments on CIFAR-10 and ImageNet-100 show that the emergent messages learned by SSNG achieve substantially higher linear-probe classification accuracy than those produced by referential games, reconstruction games, and MHNG. These results indicate that self-supervised representation alignment provides an effective mechanism for feedback-free EmCom in multi-agent systems.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 49 of its 81 references that are in the map. First posted on arXiv 29 Oct 2024.
Builds on
49 of 81 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,730
- 2020Exploring Simple Siamese Representation Learningcited by 2,860
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,726
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,056
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,826
- 2016Variational Inference: A Review for Statisticianscited by 1,469
37 more
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,142
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 566
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2016Learning Multiagent Communication with Backpropagationcited by 359
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 259
- 2021Understanding self-supervised Learning Dynamics without Contrastive Pairscited by 255
- 2018TarMAC: Targeted Multi-Agent Communicationcited by 204
- 2018Hyperspherical Variational Auto-Encoderscited by 188
- 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
- 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 169
- 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 147
- 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 124
- 2020Compositionality and Generalization in Emergent Languagescited by 103
- 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
- 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
- 2019Measuring Compositionality in Representation Learningcited by 84
- 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 70
- 2018How agents see things: On visual representations in an emergent language gamecited by 45
- 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Languagecited by 42
- 2021Emergent Communication of Generalizationscited by 41
- 2018Symbol Emergence in Cognitive Developmental Systems: a Surveycited by 39
- 2015Symbol Emergence in Robotics: A Surveycited by 31
- 2020The Power Spherical distributioncited by 27
- 2022Representation Uncertainty in Self-Supervised Learning as Variational Inferencecited by 22
- 2019Word-order biases in deep-agent emergent communicationcited by 18
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2019Symbol Emergence as an Interpersonal Multimodal Categorizationcited by 14
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
- 2024Stem-JEPA: A Joint-Embedding Predictive Architecture for Musical Stem Compatibility Estimationcited by 8
- 2024Concept-Best-Matching: Evaluating Compositionality in Emergent Communicationcited by 7
- 2018Community Regularization of Visually-Grounded Dialogcited by 5
- 2020Structural Inductive Biases in Emergent Communicationcited by 5
- 2024Language Evolution with Deep Learningcited by 5
- 2023Emergent Communication in Interactive Sketch Question Answeringcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.