mlsanityData to 14 Oct 2026

Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learning

arXiv 2401.06318 ↗First posted 12 Jan 2024cs.LG cs.AIcited by 4

On the map: Deep reinforcement learning methods → RL for games and combinatorial optimization

Abstract (arXiv)

While significant advancements have been made in the field of fair machine learning, the majority of studies focus on scenarios where the decision model operates on a static population. In this paper, we study fairness in dynamic systems where sequential decisions are made. Each decision may shift the underlying distribution of features or user behavior. We model the dynamic system through a Markov Decision Process (MDP). By acknowledging that traditional fairness notions and long-term fairness are distinct requirements that may not necessarily align with one another, we propose an algorithmic framework to integrate various fairness considerations with reinforcement learning using both pre-processing and in-processing approaches. Three case studies show that our method can strike a balance between traditional fairness notions, long-term fairness, and utility.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RL for games and combinatorial optimization, one of 15 directions in Deep reinforcement learning methods. Builds on 27 of its 44 references that are in the map. First posted on arXiv 12 Jan 2024.

Builds on

27 of 44 references.

References · 27

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2015Trust Region Policy Optimizationcited by 2,580
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  4. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  5. 2014Certifying and removing disparate impactcited by 715
  6. 2017Algorithmic decision making and the cost of fairnesscited by 403
  7. 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
  8. 2020Fairness in Machine Learningcited by 194
  9. 2018Delayed Impact of Fair Machine Learningcited by 184
  10. 2018FairGAN: Fairness-aware Generative Adversarial Networkscited by 164
  11. 2017Runaway Feedback Loops in Predictive Policingcited by 97
  12. 2016Fairness in Reinforcement Learningcited by 95
15 more
  1. 2021Towards Long-term Fairness in Recommendationcited by 77
  2. 2017From Parity to Preference-based Notions of Fairness in Classificationcited by 60
  3. 2020How Do Fair Decisions Fare in Long-term Qualification?cited by 60
  4. 2019Algorithms for Fairness in Sequential Decision Makingcited by 56
  5. 2019Causal Modeling for Fairness in Dynamical Systemscited by 47
  6. 2017A Short-term Intervention for Long-term Fairness in the Labor Marketcited by 44
  7. 2018Fairness Under Compositioncited by 43
  8. 2016Achieving non-discrimination in data releasecited by 23
  9. 2017Fair Pipelinescited by 21
  10. 2022Achieving Long-Term Fairness in Sequential Decision Makingcited by 19
  11. 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
  12. 2019Preference-Informed Fairnesscited by 15
  13. 2022Policy Optimization with Advantage Regularization for Long-Term Fairness in Decision Systemscited by 14
  14. 2019Fair treatment allocations in social networkscited by 9
  15. 2022Survey on Fairness Notions and Related Tensionscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2025A Causal Lens for Learning Long-term Fair Policiescited by 2
  2. 2024Fairness in Reinforcement Learning with Bisimulation Metricscited by 1
  3. 2025MAFE: Enabling Equitable Algorithm Design in Multi-Agent Multi-Stage Decision-Making Systemscited by 0
  4. 2026Long-term Fairness with Selective Labelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Fairness-Aware Reinforcement Learning (FAReL): A Framework for Transparent and Balanced Sequential Decision-Making
  2. 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning
  3. 2024Fairness in Reinforcement Learning: A Survey
  4. 2026Fair Policy Optimization in Major-Minor Weakly Coupled Markov Decision Processes
  5. 2024Fair Resource Allocation in Weakly Coupled Markov Decision Processes
  6. 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learning
  7. 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimization
  8. 2025Group Fairness in Multi-Task Reinforcement Learning