Capability-Aware Shared Hypernetworks for Flexible Heterogeneous Multi-Robot Coordination
Not on the map. Why?
Abstract (arXiv)
Recent advances have enabled heterogeneous multi-robot teams to learn complex and effective coordination skills. However, existing neural architectures that support heterogeneous teaming tend to force a trade-off between expressivity and efficiency. Shared-parameter designs prioritize sample efficiency by enabling a single network to be shared across all or a pre-specified subset of robots (via input augmentations), but tend to limit behavioral diversity. In contrast, recent designs employ a separate policy for each robot, enabling greater diversity and expressivity at the cost of efficiency and generalization. Our key insight is that such tradeoffs can be avoided by viewing these design choices as ends of a broad spectrum. Inspired by recent work in transfer and meta learning, and building on prior work in multi-robot task allocation, we propose Capability-Aware Shared Hypernetworks (CASH), a soft weight sharing architecture that uses hypernetworks to efficiently learn a flexible shared policy that dynamically adapts to each robot post-training. By explicitly encoding the impact of robot capabilities (e.g., speed and payload) on collective behavior, CASH enables zero-shot generalization to unseen robots or team compositions. Our experiments involve multiple heterogeneous tasks, three learning paradigms (imitation learning, value-based, and policy-gradient RL), and SOTA multi-robot simulation (JaxMARL) and hardware (Robotarium) platforms. Across all conditions, we find that CASH generates appropriately-diverse behaviors and consistently outperforms baseline architectures in terms of performance and sample efficiency during both training and zero-shot generalization, all with 60%-80% fewer learnable parameters.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 10 Jan 2025.
Builds on
28 of 45 references.
References · 28
- 2016Layer Normalizationcited by 5,669
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2016HyperNetworkscited by 1,027
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 485
- 2023Efficient Online Reinforcement Learning with Offline Datacited by 363
- 2019Continual learning with hypernetworkscited by 273
- 2020Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Taskscited by 212
- 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
- 2021Celebrating Diversity in Shared Multi-Agent Reinforcement Learningcited by 98
- 2018PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learningcited by 90
16 more
- 2021Scaling Multi-Agent Reinforcement Learning with Selective Parameter Sharingcited by 87
- 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 86
- 2024Simplifying Deep Temporal Difference Learningcited by 78
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAXcited by 63
- 2020Continual Model-Based Reinforcement Learning with Hypernetworkscited by 44
- 2022Hypernetworks in Meta-Reinforcement Learningcited by 42
- 2023Heterogeneous Multi-Robot Reinforcement Learningcited by 36
- 2021Recomposing the Reinforcement Learning Building Blocks with Hypernetworkscited by 35
- 2019Graph Policy Gradients for Large Scale Robot Controlcited by 28
- 2022Hypernetworks for Zero-shot Transfer in Reinforcement Learningcited by 19
- 2023Recurrent Hypernetworks are Surprisingly Strong in Meta-RLcited by 16
- 2023System Neural Diversity: Measuring Behavioral Heterogeneity in Multi-Agent Learningcited by 14
- 2020Heterogeneous Multi-Agent Reinforcement Learning for Unknown Environment Mappingcited by 13
- 2024HyperMARL: Adaptive Hypernetworks for Multi-Agent RLcited by 11
- 2023MARBLER: An Open Platform for Standardized Evaluation of Multi-Robot Reinforcement Learning Algorithmscited by 3
- 2024Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilitiescited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination ↗
- 2026MOCHA: Multi-Objective Co-Design using Hypernetwork Architectures
- 2026Communication-Aware Heterogeneous Graph Learning for Decentralized Multi-Human Multi-Robot Task Allocation ↗
- 2025SDHN: Skewness-Driven Hypergraph Networks for Enhanced Localized Multi-Robot Coordination
- 2025Hyper-GoalNet: Goal-Conditioned Manipulation Policy Learning with HyperNetworks
- 2025SADCHER: Scheduling using Attention-based Dynamic Coalitions of Heterogeneous Robots in Real-Time
- 2026CHORUS: Decentralized Multi-Embodiment Collaboration with One VLA Policy
- 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication