Learning Fairness in Multi-Agent Systems
Not on the map. Why?
Abstract (arXiv)
Fairness is essential for human society, contributing to stability and productivity. Similarly, fairness is also the key for many multi-agent systems. Taking fairness into multi-agent learning could help multi-agent systems become both efficient and stable. However, learning efficiency and fairness simultaneously is a complex, multi-objective, joint-policy optimization. To tackle these difficulties, we propose FEN, a novel hierarchical reinforcement learning model. We first decompose fairness for each agent and propose fair-efficient reward that each agent learns its own policy to optimize. To avoid multi-objective conflict, we design a hierarchy consisting of a controller and several sub-policies, where the controller maximizes the fair-efficient reward by switching among the sub-policies that provides diverse behaviors to interact with the environment. FEN can be trained in a fully decentralized way, making it easy to be deployed in real-world applications. Empirically, we show that FEN easily learns both fairness and efficiency and significantly outperforms baselines in a variety of multi-agent scenarios.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 7; 2024: 9; 2025: 11; 2026: 8.
44 papers.
Sort:
By area:
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2025Virtual Agent Economiescited by 17
- 2021FaiR-IoT: Fairness-aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoTcited by 15
- 2022Survey on Fair Reinforcement Learning: Theory and Practicecited by 14
- 2022Socially Fair Reinforcement Learningcited by 13
- 2023Fair Off-Policy Learning from Observational Datacited by 11
- 2021Recommendation Fairness: From Static to Dynamiccited by 10
- 2023Fairness in Preference-based Reinforcement Learningcited by 9
- 2024Fairness in Reinforcement Learning: A Surveycited by 9
- 2024Balancing Act: Prioritization Strategies for LLM-Designed Restless Bandit Rewardscited by 9
- 2021Cooperative Multi-Agent Fairness and Equivariant Policiescited by 8
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
32 more
- 2024Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contractscited by 8
- 2025Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Frameworkcited by 6
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challengescited by 5
- 2024Cooperation and Fairness in Multi-Agent Reinforcement Learningcited by 5
- 2023Mediated Multi-Agent Reinforcement Learningcited by 4
- 2025DECAF: Learning to be Fair in Multi-agent Resource Allocationcited by 4
- 2025A Constrained Multi-Agent Reinforcement Learning Approach to Autonomous Traffic Signal Controlcited by 3
- 2025Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcarecited by 3
- 2022Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Gamecited by 2
- 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimizationcited by 2
- 2025HypRL: Reinforcement Learning of Control Policies for Hyperpropertiescited by 2
- 2026Learning Fair Pareto-Optimal Policies in Multi-Objective Reinforcement Learningcited by 2
- 2022Distributed Transmission Control for Wireless Networks using Multi-Agent Reinforcement Learningcited by 1
- 2024Temporal Fairness in Decision Making Problemscited by 1
- 2024Fairness in Reinforcement Learning with Bisimulation Metricscited by 1
- 2025Past-Discounting is Key for Learning Markovian Fairness with Long Horizonscited by 1
- 2025Fair Contracts in Principal-Agent Games with Heterogeneous Typescited by 1
- 2026Altruism and Fair Objective in Mixed-Motive Markov gamescited by 1
- 2026The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Gamescited by 1
- 2022Offsetting Unequal Competition through RL-assisted Incentive Schemescited by 0
- 2023FAIRO: Fairness-aware Adaptation in Sequential-Decision Making for Human-in-the-Loop Systemscited by 0
- 2023FinA: Fairness of Adverse Effects in Decision-Making of Human-Cyber-Physical-Systemcited by 0
- 2024General Automatic Solution Generation of Social Problemscited by 0
- 2024Using Protected Attributes to Consider Fairness in Multi-Agent Systemscited by 0
- 2024Fair Resource Allocation in Weakly Coupled Markov Decision Processescited by 0
- 2025MAFE: Enabling Equitable Algorithm Design in Multi-Agent Multi-Stage Decision-Making Systemscited by 0
- 2025A General Incentives-Based Framework for Fairness in Multi-agent Resource Allocationcited by 0
- 2026On Gossip Algorithms for Machine Learning with Pairwise Objectivescited by 0
- 2026α-fair heterogeneous agent reinforcement learningcited by 0
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordinationcited by 0
- 2026Unequal Trips, Unequal Places: Diagnosing and Mitigating Delay Inequity in Autonomous Vehicle Fleet Coordinationcited by 0
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learningcited by 0
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learning31 Jul 2026
- 2026Unequal Trips, Unequal Places: Diagnosing and Mitigating Delay Inequity in Autonomous Vehicle Fleet Coordination27 Jul 2026
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordination19 Jul 2026
- 2026Learning Fair Pareto-Optimal Policies in Multi-Objective Reinforcement Learning16 Jun 2026
- 2026α-fair heterogeneous agent reinforcement learning11 Jun 2026
- 2026On Gossip Algorithms for Machine Learning with Pairwise Objectives25 Mar 2026
- 2026The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Games6 Mar 2026
- 2026Altruism and Fair Objective in Mixed-Motive Markov games9 Feb 2026
- 2025A General Incentives-Based Framework for Fairness in Multi-agent Resource Allocation30 Oct 2025
- 2025Virtual Agent Economies12 Sep 2025
- 2025Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare26 Aug 2025
- 2025Fair Contracts in Principal-Agent Games with Heterogeneous Types18 Jun 2025
32 more
- 2025Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Framework17 May 2025
- 2025HypRL: Reinforcement Learning of Control Policies for Hyperproperties7 Apr 2025
- 2025Past-Discounting is Key for Learning Markovian Fairness with Long Horizons1 Apr 2025
- 2025A Constrained Multi-Agent Reinforcement Learning Approach to Autonomous Traffic Signal Control30 Mar 2025
- 2025MAFE: Enabling Equitable Algorithm Design in Multi-Agent Multi-Stage Decision-Making Systems25 Feb 2025
- 2025DECAF: Learning to be Fair in Multi-agent Resource Allocation6 Feb 2025
- 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimization6 Feb 2025
- 2024Fairness in Reinforcement Learning with Bisimulation Metrics22 Dec 2024
- 2024Fair Resource Allocation in Weakly Coupled Markov Decision Processes14 Nov 2024
- 2024Cooperation and Fairness in Multi-Agent Reinforcement Learning19 Oct 2024
- 2024Using Protected Attributes to Consider Fairness in Multi-Agent Systems16 Oct 2024
- 2024Temporal Fairness in Decision Making Problems23 Aug 2024
- 2024Balancing Act: Prioritization Strategies for LLM-Designed Restless Bandit Rewards22 Aug 2024
- 2024Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contracts25 Jul 2024
- 2024Fairness in Reinforcement Learning: A Survey11 May 2024
- 2024General Automatic Solution Generation of Social Problems25 Jan 2024
- 2023FinA: Fairness of Adverse Effects in Decision-Making of Human-Cyber-Physical-System6 Nov 2023
- 2023FAIRO: Fairness-aware Adaptation in Sequential-Decision Making for Human-in-the-Loop Systems12 Jul 2023
- 2023Fairness in Preference-based Reinforcement Learning16 Jun 2023
- 2023Mediated Multi-Agent Reinforcement Learning14 Jun 2023
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning1 Jun 2023
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges17 May 2023
- 2023Fair Off-Policy Learning from Observational Data15 Mar 2023
- 2022Socially Fair Reinforcement Learning26 Aug 2022
- 2022Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game3 Jun 2022
- 2022Survey on Fair Reinforcement Learning: Theory and Practice20 May 2022
- 2022Distributed Transmission Control for Wireless Networks using Multi-Agent Reinforcement Learning13 May 2022
- 2022Offsetting Unequal Competition through RL-assisted Incentive Schemes5 Jan 2022
- 2021A Sociotechnical View of Algorithmic Fairness27 Sep 2021
- 2021Recommendation Fairness: From Static to Dynamic5 Sep 2021
- 2021Cooperative Multi-Agent Fairness and Equivariant Policies10 Jun 2021
- 2021FaiR-IoT: Fairness-aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoT30 Mar 2021
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2025Virtual Agent Economiescited by 17
- 2021FaiR-IoT: Fairness-aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoTcited by 15
- 2022Survey on Fair Reinforcement Learning: Theory and Practicecited by 14
- 2022Socially Fair Reinforcement Learningcited by 13
- 2023Fair Off-Policy Learning from Observational Datacited by 11
- 2021Recommendation Fairness: From Static to Dynamiccited by 10
- 2023Fairness in Preference-based Reinforcement Learningcited by 9
- 2024Fairness in Reinforcement Learning: A Surveycited by 9
- 2021Cooperative Multi-Agent Fairness and Equivariant Policiescited by 8
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
- 2024Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contractscited by 8
12 most cited of 42 All 42 (JSON)
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learning31 Jul 2026
- 2026Unequal Trips, Unequal Places: Diagnosing and Mitigating Delay Inequity in Autonomous Vehicle Fleet Coordination27 Jul 2026
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordination19 Jul 2026
- 2026Learning Fair Pareto-Optimal Policies in Multi-Objective Reinforcement Learning16 Jun 2026
- 2026α-fair heterogeneous agent reinforcement learning11 Jun 2026
- 2026On Gossip Algorithms for Machine Learning with Pairwise Objectives25 Mar 2026
- 2026The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Games6 Mar 2026
- 2026Altruism and Fair Objective in Mixed-Motive Markov games9 Feb 2026
- 2025A General Incentives-Based Framework for Fairness in Multi-agent Resource Allocation30 Oct 2025
- 2025Virtual Agent Economies12 Sep 2025
- 2025Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare26 Aug 2025
- 2025Fair Contracts in Principal-Agent Games with Heterogeneous Types18 Jun 2025
12 newest of 42 All 42 (JSON)