HARP: Human-Assisted Regrouping with Permutation Invariant Critic for Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Human-in-the-loop reinforcement learning integrates human expertise to accelerate agent learning and provide critical guidance and feedback in complex fields. However, many existing approaches focus on single-agent tasks and require continuous human involvement during the training process, significantly increasing the human workload and limiting scalability. In this paper, we propose HARP (Human-Assisted Regrouping with Permutation Invariant Critic), a multi-agent reinforcement learning framework designed for group-oriented tasks. HARP integrates automatic agent regrouping with strategic human assistance during deployment, enabling and allowing non-experts to offer effective guidance with minimal intervention. During training, agents dynamically adjust their groupings to optimize collaborative task completion. When deployed, they actively seek human assistance and utilize the Permutation Invariant Group Critic to evaluate and refine human-proposed groupings, allowing non-expert users to contribute valuable suggestions. In multiple collaboration scenarios, our approach is able to leverage limited guidance from non-experts and enhance performance. The project can be found at https://github.com/huawen-hu/HARP.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 18 Sep 2024.
Builds on
16 of 37 references.
References · 16
- 2019The StarCraft Multi-Agent Challengecited by 597
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 379
- 2020ROMA: Multi-Agent Reinforcement Learning with Emergent Rolescited by 137
- 2020RODE: Learning Roles to Decompose Multi-Agent Taskscited by 125
- 2019PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learningcited by 47
- 2023Settling the Sample Complexity of Online Reinforcement Learningcited by 45
- 2022i-Sim2Real: Reinforcement Learning of Robotic Policies in Tight Human-Robot Interaction Loopscited by 32
- 2024Group-Aware Coordination Graph for Multi-Agent Reinforcement Learningcited by 18
- 2023Multi-Robot Cooperative Socially-Aware Navigation Using Multi-Agent Reinforcement Learningcited by 17
- 2023Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedbackcited by 13
- 2022RTAW: An Attention Inspired Reinforcement Learning Method for Multi-Robot Task Allocation in Warehouse Environmentscited by 12
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learningcited by 9
4 more
- 2023Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learningcited by 5
- 2023DT/MARS-CycleGAN: Improved Object Detection for MARS Phenotyping Robotcited by 4
- 2020Battlesnake Challenge: A Multi-agent Reinforcement Learning Playground with Human-in-the-loopcited by 3
- 2023Learning When to Ask for Help: Efficient Interactive Navigation via Implicit Uncertainty Estimationcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Enabling Multi-Robot Collaboration from Single-Human Guidance
- 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learning
- 2025From Solo to Symphony: Orchestrating Multi-Agent Collaboration with Single-Agent Demos
- 2024ARMCHAIR: integrated inverse reinforcement learning and model predictive control for human-robot collaboration
- 2025M3HF: Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality
- 2025Human Implicit Preference-Based Policy Fine-tuning for Multi-Agent Reinforcement Learning in USV Swarm
- 2025Hierarchical Reinforcement Learning for Optimal Agent Grouping in Cooperative Systems
- 2024Open Human-Robot Collaboration using Decentralized Inverse Reinforcement Learning