# Adaptive Fairness-Aware Online Meta-Learning for Changing Environments

arXiv: https://arxiv.org/abs/2205.11264 · HTML: https://mlsanity.com/paper/2205.11264/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 29 references that are in the map.
- First posted on arXiv 20 May 2022.

## Builds on (most cited first, 15 of 15)

- [Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks](https://mlsanity.com/paper/1703.03400/) (2017)
- [Equality of Opportunity in Supervised Learning](https://mlsanity.com/paper/1610.02413/) (2016)
- [WILDS: A Benchmark of in-the-Wild Distribution Shifts](https://mlsanity.com/paper/2012.07421/) (2020)
- [Online Meta-Learning](https://mlsanity.com/paper/1902.08438/) (2019)
- [Adaptive Online Learning in Dynamic Environments](https://mlsanity.com/paper/1810.10815/) (2018)
- [Strongly Adaptive Online Learning](https://mlsanity.com/paper/1502.07073/) (2015)
- [Adaptive Algorithms for Online Convex Optimization with Long-term Constraints](https://mlsanity.com/paper/1512.07422/) (2015)
- [Improved Strongly Adaptive Online Learning using Coin Betting](https://mlsanity.com/paper/1610.04578/) (2016)
- [Online convex optimization for cumulative constraints](https://mlsanity.com/paper/1802.06472/) (2018)
- [Faster Projection-free Online Learning](https://mlsanity.com/paper/2001.11568/) (2020)
- [Minimizing Dynamic Regret and Adaptive Regret Simultaneously](https://mlsanity.com/paper/2002.02085/) (2020)
- [Efficient Projection-Free Online Methods with Stochastic Recursive Gradient](https://mlsanity.com/paper/1910.09396/) (2019)
- [Rank-Based Multi-task Learning for Fair Regression](https://mlsanity.com/paper/2009.11405/) (2020)
- [Fairness-Aware Online Meta-learning](https://mlsanity.com/paper/2108.09435/) (2021)
- [Unfairness Discovery and Prevention For Few-Shot Regression](https://mlsanity.com/paper/2009.11406/) (2020)

## Built on by (most cited first, 17 of 17)

- [Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey](https://mlsanity.com/paper/2207.07068/) (2022)
- [Open Set Action Recognition via Multi-Label Evidential Learning](https://mlsanity.com/paper/2303.12698/) (2023)
- [Supervised Algorithmic Fairness in Distribution Shifts: A Survey](https://mlsanity.com/paper/2402.01327/) (2024)
- [Towards Fair Disentangled Online Learning for Changing Environments](https://mlsanity.com/paper/2306.01007/) (2023)
- [Towards Counterfactual Fairness-aware Domain Generalization in Changing Environments](https://mlsanity.com/paper/2309.13005/) (2023)
- [Algorithmic Fairness Generalization under Covariate and Dependence Shifts Simultaneously](https://mlsanity.com/paper/2311.13816/) (2023)
- [Learning Fair Invariant Representations under Covariate and Correlation Shifts Simultaneously](https://mlsanity.com/paper/2408.09312/) (2024)
- [MADOD: Generalizing OOD Detection to Unseen Domains via G-Invariance Meta-Learning](https://mlsanity.com/paper/2411.02444/) (2024)
- [Bi-directional Bias Attribution: Debiasing Large Language Models without Modifying Prompts](https://mlsanity.com/paper/2602.04398/) (2026)
- [SimFair: Physics-Guided Fairness-Aware Learning with Simulation Models](https://mlsanity.com/paper/2401.15270/) (2024)
- [MLDGG: Meta-Learning for Domain Generalization on Graphs](https://mlsanity.com/paper/2411.12913/) (2024)
- [Towards Effective Semantic OOD Detection in Unseen Domains: A Domain Generalization Perspective](https://mlsanity.com/paper/2309.10209/) (2023)
- [Referee-Meta-Learning for Fast Adaptation of Locational Fairness](https://mlsanity.com/paper/2402.13379/) (2024)
- [FEED: Fairness-Enhanced Meta-Learning for Domain Generalization](https://mlsanity.com/paper/2411.01316/) (2024)
- [Dynamic Environment Responsive Online Meta-Learning with Fairness Awareness](https://mlsanity.com/paper/2402.12319/) (2024)
- [Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference](https://mlsanity.com/paper/2405.16029/) (2024)
- [SafeFix: Targeted Model Repair via Controlled Image Generation](https://mlsanity.com/paper/2508.08701/) (2025)

## Abstract (arXiv)

The fairness-aware online learning framework has arisen as a powerful tool for the continual lifelong learning setting. The goal for the learner is to sequentially learn new tasks where they come one after another over time and the learner ensures the statistic parity of the new coming task across different protected sub-populations (e.g. race and gender). A major drawback of existing methods is that they make heavy use of the i.i.d assumption for data and hence provide static regret analysis for the framework. However, low static regret cannot imply a good performance in changing environments where tasks are sampled from heterogeneous distributions. To address the fairness-aware online learning problem in changing environments, in this paper, we first construct a novel regret metric FairSAR by adding long-term fairness constraints onto a strongly adapted loss regret. Furthermore, to determine a good model parameter at each round, we propose a novel adaptive fairness-aware online meta-learning algorithm, namely FairSAOML, which is able to adapt to changing environments in both bias control and model precision. The problem is formulated in the form of a bi-level convex-concave optimization with respect to the model's primal and dual parameters that are associated with the model's accuracy and fairness, respectively. The theoretic analysis provides sub-linear upper bounds for both loss regret and violation of cumulative fairness constraints. Our experimental evaluation on different real-world datasets with settings of changing environments suggests that the proposed FairSAOML significantly outperforms alternatives based on the best prior online learning approaches.
