Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We investigate the use of natural language to drive the generalization of policies in multi-agent settings. Unlike single-agent settings, the generalization of policies should also consider the influence of other agents. Besides, with the increasing number of entities in multi-agent settings, more agent-entity interactions are needed for language grounding, and the enormous search space could impede the learning process. Moreover, given a simple general instruction,e.g., beating all enemies, agents are required to decompose it into multiple subgoals and figure out the right one to focus on. Inspired by previous work, we try to address these issues at the entity level and propose a novel framework for language grounding in multi-agent reinforcement learning, entity divider (EnDi). EnDi enables agents to independently learn subgoal division at the entity level and act in the environment based on the associated entities. The subgoal division is regularized by opponent modeling to avoid subgoal conflicts and promote coordinated strategies. Empirically, EnDi demonstrates the strong generalization ability to unseen games with new dynamics and expresses the superiority over existing methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 25 Oct 2022.
Builds on
22 of 31 references.
References · 22
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 866
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
- 2020The NetHack Learning Environmentcited by 196
- 2022Goal-Conditioned Reinforcement Learning: Problems and Solutionscited by 145
- 2020ROMA: Multi-Agent Reinforcement Learning with Emergent Rolescited by 135
- 2020Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Textcited by 59
- 2020Grounded Language Learning Fast and Slowcited by 54
10 more
- 2019Environmental drivers of systematicity and generalization in a situated agentcited by 50
- 2021Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learningcited by 45
- 2019Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flightcited by 43
- 2019Hierarchical Cooperative Multi-Agent Reinforcement Learning with Skill Discoverycited by 42
- 2014Learning to Win by Reading Manuals in a Monte-Carlo Frameworkcited by 39
- 2018Guiding Policies with Language via Meta-Learningcited by 34
- 2022MASER: Multi-Agent Reinforcement Learning with Subgoals Generated from Experience Replay Buffercited by 34
- 2019RTFM: Generalising to Novel Environment Dynamics via Readingcited by 33
- 2017Representation Learning for Grounded Spatial Reasoningcited by 23
- 2021Variational Empowerment as Representation Learning for Goal-Based Reinforcement Learningcited by 15
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.