The Hive Mind is a Single Reinforcement Learning Agent
On the map: Deep reinforcement learning methods → RL for games and combinatorial optimization
Abstract (arXiv)
Decision-making is an essential attribute of any intelligent agent or group. Natural systems are known to converge to effective strategies through at least two distinct mechanisms: collective decision-making via imitation of others, and trial-and-error by a single agent. This paper establishes an equivalence between these two paradigms. We show that the emergent distributed cognition (sometimes referred to as the textithive mind) arising from individuals following simple, local imitation-based rules is that of a single online reinforcement learning (RL) agent aggregating action-value samples from many parallel instances of a multi-armed bandit. More specifically, we show that, in the blindly imitative weighted voter model of honey bees' waggle dance, the update rule through which this macro-agent learns is an RL algorithm that we coin textitMaynard-Cross Learning. Our analysis implies that a group of individuals following simple imitative strategies can be equivalent to a more complex learning entity, substantiating the idea that group-level intelligence may explain how seemingly irrational individual behaviors are selected in nature. Beyond biology, the framework offers new tools for analyzing economic and social systems where individuals imitate successful strategies, effectively participating in a collective learning process. Our findings may further inform the design of scalable RL-inspired collective systems in artificial domains.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for games and combinatorial optimization, one of 15 directions in Deep reinforcement learning methods. Builds on 11 of its 85 references that are in the map. First posted on arXiv 23 Oct 2024.
Builds on
11 of 85 references.
References · 11
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 567
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 207
- 2024Streaming Deep Reinforcement Learning Finally Workscited by 25
- 2022Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Casecited by 2
- 2022Cross-inhibition leads to group consensus despite the presence of strongly opinionated minorities and asocial behaviourcited by 1
- 2023Congestion and Scalability in Robot Swarms: a Study on Collective Decision Makingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Increasing intelligence in AI agents can worsen collective outcomes
- 2025Illuminating the Three Dogmas of Reinforcement Learning under Evolutionary Light
- 2025Buzz, Choose, Forget: A Meta-Bandit Framework for Bee-Like Decision Making
- 2026Avalon-ToM-Bench: Evaluating Fine-Grained Theory of Mind via Asymmetric Game Mechanics
- 2026Emergent social transmission of model-based representations without inference
- 2025Revisiting Rogers' Paradox in the Context of Human-AI Interaction
- 2025The Society of HiveMind: Multi-Agent Optimization of Foundation Model Swarms to Unlock the Potential of Collective Intelligence
- 2025Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learning