EcoFair-CH-MARL: Scalable Constrained Hierarchical Multi-Agent RL with Real-Time Emission Budgets and Fairness Guarantees
Not on the map. Why?
Abstract (arXiv)
Global decarbonisation targets and tightening market pressures demand maritime logistics solutions that are simultaneously efficient, sustainable, and equitable. We introduce EcoFair-CH-MARL, a constrained hierarchical multi-agent reinforcement learning framework that unifies three innovations: (i) a primal-dual budget layer that provably bounds cumulative emissions under stochastic weather and demand; (ii) a fairness-aware reward transformer with dynamically scheduled penalties that enforces max-min cost equity across heterogeneous fleets; and (iii) a two-tier policy architecture that decouples strategic routing from real-time vessel control, enabling linear scaling in agent count. New theoretical results establish O(√T) regret for both constraint violations and fairness loss. Experiments on a high-fidelity maritime digital twin (16 ports, 50 vessels) driven by automatic identification system traces, plus an energy-grid case study, show up to 15% lower emissions, 12% higher through-put, and a 45% fair-cost improvement over state-of-the-art hierarchical and constrained MARL baselines. In addition, EcoFair-CH-MARL achieves stronger equity (lower Gini and higher min-max welfare) than fairness-specific MARL baselines (e.g., SOTO, FEN), and its modular design is compatible with both policy- and value-based learners. EcoFair-CH-MARL therefore advances the feasibility of large-scale, regulation-compliant, and socially responsible multi-agent coordination in safety-critical domains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
17 of 30 references.
References · 17
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2017Constrained Policy Optimizationcited by 928
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 457
- 2018Reward Constrained Policy Optimizationcited by 397
- 2016Learning Multiagent Communication with Backpropagationcited by 355
- 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 278
- 2017Learning with Opponent-Learning Awarenesscited by 218
- 2019Constrained Reinforcement Learning Has Zero Duality Gapcited by 144
5 more
- 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
- 2019Algorithms for Fairness in Sequential Decision Makingcited by 53
- 2017Prosocial learning agents solve generalized Stag Hunts better than selfish onescited by 47
- 2020Multi-Agent Reinforcement Learning for Markov Routing Games: A New Modeling Paradigm For Dynamic Traffic Assignmentcited by 9
- 2024Cooperation and Fairness in Multi-Agent Reinforcement Learningcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026α-fair heterogeneous agent reinforcement learningcited by 0
- 2026α-fair heterogeneous agent reinforcement learning11 Jun 2026