Spatiotemporal Attention-Augmented Inverse Reinforcement Learning for Multi-Agent Task Allocation
On the map: Offline RL and imitation learning from data → Inverse reinforcement learning
Abstract (arXiv)
Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high variance and poor generalization. We propose an attention-structured adversarial IRL framework that constrains reward inference via spatiotemporal representation learning. Our method employs multi-head self-attention (MHSA) for long-range temporal dependencies and graph attention networks (GAT) for agent-task relational structures. We formulate reward inference as a low-capacity, adaptive linear transformation of the environment reward, ensuring stable and interpretable guidance. This framework decouples reward inference from policy learning and optimizes the reward model adversarially. Experiments on benchmark MATA scenarios show that our approach outperforms representative MARL baselines in convergence speed, cumulative rewards, and spatial efficiency. Results demonstrate that attention-guided, capacity-constrained reward inference is a scalable and effective mechanism for stabilizing adversarial IRL in complex multi-agent systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse reinforcement learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 11 of its 38 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
11 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2024Inverse Reinforcement Learning from Non-Stationary Learning Agents18 Oct
- 2018A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progress18 Jun
Other references · 9
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2017Learning Robust Rewards with Adversarial Inverse Reinforcement Learningcited by 485
- 2023Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RLcited by 37
- 2022Learning Scalable Policies over Graphs for Multi-Robot Task Allocation using Capsule Attention Networkscited by 10
- 2024A Local Information Aggregation based Multi-Agent Reinforcement Learning for Robot Swarm Dynamic Task Allocationcited by 6
- 2016Modelling resource contention in multi-robot task allocation problems with uncertain timingcited by 2
- 2023Discovering Individual Rewards in Collective Behavior through Inverse Multi-Agent Reinforcement Learningcited by 2
- 2023Joint Path planning and Power Allocation of a Cellular-Connected UAV using Apprenticeship Learning via Deep Inverse Reinforcement Learningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2020Scalable Multi-Agent Inverse Reinforcement Learning via Actor-Attention-Critic
- 2019Multi-Agent Adversarial Inverse Reinforcement Learning
- 2026Scalable Multi-Task Inverse Reinforcement Learning
- 2020Joint Goal and Strategy Inference across Heterogeneous Demonstrators via Reward Network Distillation
- 2022Learning Multi-Task Transferable Rewards via Variational Inverse Reinforcement Learning
- 2026Generalize and Guide: Decomposing Rewards for Few-Shot Inverse Reinforcement Learning
- 2020Active Task-Inference-Guided Deep Inverse Reinforcement Learning
- 2025Symmetry-Guided Multi-Agent Inverse Reinforcement Learning