mlsanityData to 7 Oct 2026

Algorithms for Fairness in Sequential Decision Making

arXiv 1901.08568 ↗First posted 24 Jan 2019cs.LG stat.MLcited by 53

Not on the map. Why?

Abstract (arXiv)

It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually exacerbate unfairness. We propose to address this challenge by modeling feedback effects as Markov decision processes (MDPs). First, we propose analogs of fairness properties for the MDP setting. Second, we propose algorithms for learning fair decision-making policies for MDPs. Finally, we demonstrate the need to account for dynamical effects using simulations on a loan applicant MDP.

Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 12; 2023: 10; 2024: 9; 2025: 7; 2026: 8.

53 papers.

Sort:

By area:

  1. 2021A survey on datasets for fairness-aware machine learningcited by 157
  2. 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
  3. 2023Causal Reinforcement Learning: A Surveycited by 22
  4. 2021Algorithm Fairness in AI for Medicine and Healthcarecited by 21
  5. 2022Achieving Long-Term Fairness in Sequential Decision Makingcited by 18
  6. 2022Reward Reports for Reinforcement Learningcited by 18
  7. 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
  8. 2022Survey on Fair Reinforcement Learning: Theory and Practicecited by 14
  9. 2022Socially Fair Reinforcement Learningcited by 13
  10. 2021Recommendation Fairness: From Static to Dynamiccited by 10
  11. 2022Reinforcement Learning with Stepwise Fairness Constraintscited by 9
  12. 2023Fairness in Preference-based Reinforcement Learningcited by 9
38 more
  1. 2021Cooperative Multi-Agent Fairness and Equivariant Policiescited by 8
  2. 2022Mitigating Disparity while Maximizing Reward: Tight Anytime Guarantee for Improving Banditscited by 8
  3. 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
  4. 2023Designing Long-term Group Fair Policies in Dynamical Systemscited by 8
  5. 2022Enforcing Delayed-Impact Fairness Guaranteescited by 7
  6. 2023Tier Balancing: Towards Dynamic Fairness over Underlying Causal Factorscited by 7
  7. 2023Remembering to Be Fair: Non-Markovian Fairness in Sequential Decision Makingcited by 7
  8. 2021Long-Term Resource Allocation Fairness in Average Markov Decision Process (AMDP) Environmentcited by 6
  9. 2023Adapting Static Fairness to Sequential Decision-Making: Bias Mitigation Strategies towards Equal Long-term Benefit Ratecited by 6
  10. 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunitiescited by 5
  11. 2025Intersectional Fairness in Reinforcement Learning with Large State and Constraint Spacescited by 5
  12. 2022Fairness in Forecasting of Observations of Linear Dynamical Systemscited by 4
  13. 2023Holistic Survey of Privacy and Fairness in Machine Learningcited by 4
  14. 2024Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learningcited by 4
  15. 2024Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challengescited by 4
  16. 2022Closed-Loop View of the Regulation of AI: Equal Impact across Repeated Interactionscited by 3
  17. 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learningcited by 3
  18. 2025FairSense: Long-Term Fairness Analysis of ML-Enabled Systemscited by 3
  19. 2024Fair Classification with Partial Feedback: An Exploration-Based Data Collection Approachcited by 2
  20. 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimizationcited by 2
  21. 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Makingcited by 2
  22. 2025A Causal Lens for Learning Long-term Fair Policiescited by 2
  23. 2026Fairness under uncertainty in sequential decisionscited by 2
  24. 2021Fairness Through Counterfactual Utilitiescited by 1
  25. 2021Fair Decision-Making for Food Inspectionscited by 1
  26. 2024Long-Term Fairness in Sequential Multi-Agent Selection with Positive Reinforcementcited by 1
  27. 2024Fairness in Reinforcement Learning with Bisimulation Metricscited by 1
  28. 2025Ethics-Aware Safe Reinforcement Learning for Rare-Event Risk Control in Interactive Urban Drivingcited by 1
  29. 2026EcoFair-CH-MARL: Scalable Constrained Hierarchical Multi-Agent RL with Real-Time Emission Budgets and Fairness Guaranteescited by 1
  30. 2022Achievement and Fragility of Long-term Equitabilitycited by 0
  31. 2023Systemic Fairnesscited by 0
  32. 2024When fairness metrics fail: A utility-based perspective on varepsilon-fairnesscited by 0
  33. 2024DispaRisk: Auditing Fairness Through Usable Informationcited by 0
  34. 2024Fair Resource Allocation in Weakly Coupled Markov Decision Processescited by 0
  35. 2025Online Learning with Multiple Fairness Regularizers via Graph-Structured Feedbackcited by 0
  36. 2026Boosted Distributional Reinforcement Learning: Analysis and Healthcare Applicationscited by 0
  37. 2026Price of Fairness in Short-Term and Long-Term Algorithmic Selectionscited by 0
  38. 2026Long-term Fairness with Selective Labelscited by 0

50 most cited of 53 All 53 (JSON)