Decentralized Multi-agent Reinforcement Learning for Resilient Critical Infrastructures
Not on the map. Why?
Abstract (arXiv)
Critical infrastructures are increasingly distributed, interdependent, and exposed to evolving disruptions, making resilience a central requirement for their operation and control. This paper argues that decentralized multi-agent reinforcement learning (MARL) should be understood not merely as a distributed alternative to centralized training with decentralized execution but as a paradigm structurally aligned with the requirements of resilient critical infrastructures. This perspective is grounded in an analysis of the properties of decentralized MARL and the requirements of critical infrastructures, including scalability to large numbers of agents, support for privacy and local autonomy, robustness to failures, and interaction-driven adaptation among interdependent components. However, structural alignment alone is insufficient for practical deployment. This paper identifies credit assignment and communication as two central conditions for its practical feasibility. Credit assignment determines whether local learning remains aligned with system-level objectives, while communication determines whether coordination can be learned and maintained under realistic operational constraints. Building on these challenges, this paper proposes a research agenda focused on structure-aware, causality-aware, and resilience-aware credit assignment; communication for both coordination and credit assignment; and safe, timely, and recoverable decentralized learning under deployment constraints. Overall, this paper reframes decentralized MARL as a promising but conditional foundation for resilient critical infrastructures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
15 of 33 references.
References · 15
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 567
- 2018Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agentscited by 194
- 2019Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Controlcited by 164
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2021Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networkscited by 54
- 2022Communication-Efficient Actor-Critic Methods for Homogeneous Markov Gamescited by 5
- 2018Holarchic Structures for Decentralized Deep Learning - A Performance Analysiscited by 3
- 2023Discrete-choice Multi-agent Optimization: Decentralized Hard Constraint Satisfaction for Smart Citiescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fully Byzantine-Resilient Multi-Agent Reinforcement Learning
- 2025Scalable Safe Multi-Agent Reinforcement Learning for Multi-Agent System
- 2025Contextual Knowledge Sharing in Multi-Agent Reinforcement Learning with Decentralized Communication and Coordination
- 2025Empirical Study on Robustness and Resilience in Cooperative Multi-Agent Reinforcement Learning
- 2025Optimization without Future Compromises? Decentralized Coordination via Collective and Reinforcement Learning
- 2024Hierarchical Consensus-Based Multi-Agent Reinforcement Learning for Multi-Robot Cooperation Tasks
- 2025Structured Cooperative Multi-Agent Reinforcement Learning: a Bayesian Network Perspective
- 2024An Initial Introduction to Cooperative Multi-Agent Reinforcement Learning