AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems
Not on the map. Why?
Abstract (arXiv)
In Decentralized Multi-Agent Reinforcement Learning (MARL), the development of Emergent Communication has long been constrained by the ``Joint Exploration Dilemma'', leading agents to fall into a ``Communication Vacuum Equilibrium'' . Traditional methods address this by introducing inductive biases to facilitate communication emergence . This study fundamentally questions whether such artificial inductive biases are, in fact, over-engineering. Through experiments with the ``AI Mother Tongue'' (AIM) framework, based on a Vector Quantized Variational Autoencoder (VQ-VAE), we demonstrate that when agents possess an endogenous symbol system, their neural representations naturally exhibit spontaneous semantic compression and Nash equilibrium-driven semantic convergence, achieving effective symbolic communication without external inductive biases. This aligns with recent neuroscience findings suggesting that the human brain does not directly use human language for internal thought , and resonates with research on ``soft thinking'' capabilities in Large Language Models (LLMs) . Compared to traditional explicit communication methods, AIM demonstrates stronger generality and efficiency. The interpretable analysis toolkit developed in this study confirms that symbol usage exhibits a significant power-law distribution, leading to three major theoretical insights: the ``Neural Communication Hypothesis'', the ``Tool-First Principle'', and the ``Semantic Interpretability Paradigm''. Future research will explore the integration of Hierarchical Quantized Variational Autoencoders (HQ-VAE) to enhance AIM's complex expressive capabilities and investigate the potential for ``Reinforcement Learning (RL) Low-Level Pre-training''. This discovery offers new avenues for bridging symbolism and connectionism.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
13 of 23 references.
References · 13
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2020Neurosymbolic AI: The 3rd Wavecited by 255
- 2017Learning with Opponent-Learning Awarenesscited by 222
- 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 209
- 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
- 2020Learning to Incentivize Other Learning Agentscited by 57
- 2019Biases for Emergent Communication in Multi-agent Reinforcement Learningcited by 48
- 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayescited by 27
- 2023Neurosymbolic AI -- Why, What, and Howcited by 19
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trendscited by 10
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studiescited by 8
- 2026Beyond Reward Suppression: Reshaping Steganographic Communication Protocols in MARL via Dynamic Representational Circuit Breakingcited by 1
- 2025Interpretable by AI Mother Tongue: Native Symbolic Reasoning in Neural Modelscited by 0
- 2026Probing the Latent World: Emergent Discrete Symbols and Physical Structure in Latent Representationscited by 0
- 2026Auditability Is Not One Property: Rule Overlap, Behavioural Agreement, and Composition in Reinforcement Learningcited by 0
- 2026Auditability Is Not One Property: Rule Overlap, Behavioural Agreement, and Composition in Reinforcement Learning23 Sep 2026
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studies22 Jun 2026
- 2026Probing the Latent World: Emergent Discrete Symbols and Physical Structure in Latent Representations20 Mar 2026
- 2026Beyond Reward Suppression: Reshaping Steganographic Communication Protocols in MARL via Dynamic Representational Circuit Breaking7 Mar 2026
- 2025Interpretable by AI Mother Tongue: Native Symbolic Reasoning in Neural Models26 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Emergent Language as an Approach to Conscious AI
- 2022Towards Human-Agent Communication via the Information Bottleneck Principle
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication
- 2024Generative Emergent Communication: Large Language Model is a Collective World Model
- 2024Emergent Language: A Survey and Taxonomy
- 2025Can LLMs Translate Human Instructions into a Reinforcement Learning Agent's Internal Emergent Symbolic Representation?
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs