Exacerbating Algorithmic Bias through Fairness Attacks
Not on the map. Why?
Abstract (arXiv)
Algorithmic fairness has attracted significant attention in recent years, with many quantitative measures suggested for characterizing the fairness of different machine learning algorithms. Despite this interest, the robustness of those fairness measures with respect to an intentional adversarial attack has not been properly addressed. Indeed, most adversarial machine learning has focused on the impact of malicious attacks on the accuracy of the system, without any regard to the system's fairness. We propose new types of data poisoning attacks where an adversary intentionally targets the fairness of a system. Specifically, we propose two families of attacks that target fairness measures. In the anchoring attack, we skew the decision boundary by placing poisoned points near specific target points to bias the outcome. In the influence attack on fairness, we aim to maximize the covariance between the sensitive attributes and the decision outcome and affect the fairness of the model. We conduct extensive experiments that indicate the effectiveness of our proposed attacks.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 12; 2023: 12; 2024: 11; 2025: 4; 2026: 2.
47 papers.
Sort:
By area:
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
- 2022Robust Conversational Agents against Imperceptible Toxicity Triggerscited by 23
- 2021Poisoning Attacks on Fair Machine Learningcited by 19
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2023Improving Fair Training under Correlation Shiftscited by 14
- 2022Robust Fair Clustering: A Novel Fairness Attack and Defense Frameworkcited by 13
- 2022Adversarial Inter-Group Link Injection Degrades the Fairness of Graph Neural Networkscited by 12
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shiftscited by 11
35 more
- 2023Bias in Pruned Vision Models: In-Depth Analysis and Countermeasurescited by 11
- 2024Safety in Graph Machine Learning: Threats and Safeguardscited by 11
- 2024Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Modelscited by 10
- 2022Towards Multi-Objective Statistically Fair Federated Learningcited by 8
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysiscited by 7
- 2023Deceptive Fairness Attacks on Graphs via Meta Learningcited by 6
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspectivecited by 6
- 2021Machine Learning for Fraud Detection in E-Commerce: A Research Agendacited by 5
- 2021Fairness Degrading Adversarial Attacks Against Clustering Algorithmscited by 5
- 2022Subverting Fair Image Search with Generative Adversarial Perturbationscited by 5
- 2022Breaking Fair Binary Classification with Optimal Flipping Attackscited by 4
- 2022Fairness-aware Regression Robust to Adversarial Attackscited by 4
- 2023Adversarial Attacks on Fairness of Graph Neural Networkscited by 4
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2024A Catalog of Fairness-Aware Practices in Machine Learning Engineeringcited by 4
- 2024EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learningcited by 4
- 2024BadFair: Backdoored Fairness Attacks with Group-conditioned Triggerscited by 4
- 2023Towards Poisoning Fair Representationscited by 3
- 2024The Effect of Data Poisoning on Counterfactual Explanationscited by 3
- 2022A Survey on Preserving Fairness Guarantees in Changing Environmentscited by 2
- 2023To be Robust and to be Fair: Aligning Fairness with Robustnesscited by 2
- 2023TrojFair: Trojan Fairness Attackscited by 2
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injectionscited by 2
- 2025Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifierscited by 2
- 2024PFAttack: Stealthy Attack Bypassing Group Fairness in Federated Learningcited by 1
- 2021FLEA: Provably Robust Fair Multisource Learning from Unreliable Training Datacited by 0
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomycited by 0
- 2023Fair Graph Machine Learning under Adversarial Missingness Processescited by 0
- 2024LayerMatch: Do Pseudo-labels Benefit All Layers?cited by 0
- 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimizationcited by 0
- 2025Adversarial Bias: Data Poisoning Attacks on Fairnesscited by 0
- 2026SoK: Colluding Adversaries in Machine Learning Pipelinescited by 0
- 2026Fairness Attacks on Recommender Systemscited by 0
- 2026Fairness Attacks on Recommender Systems27 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2025Adversarial Bias: Data Poisoning Attacks on Fairness11 Nov 2025
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization29 Mar 2025
- 2025Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifiers8 Mar 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024BadFair: Backdoored Fairness Attacks with Group-conditioned Triggers23 Oct 2024
- 2024PFAttack: Stealthy Attack Bypassing Group Fairness in Federated Learning9 Oct 2024
- 2024EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning2 Oct 2024
- 2024A Catalog of Fairness-Aware Practices in Machine Learning Engineering29 Aug 2024
- 2024LayerMatch: Do Pseudo-labels Benefit All Layers?20 Jun 2024
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injections5 Jun 2024
35 more
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024Safety in Graph Machine Learning: Threats and Safeguards17 May 2024
- 2024Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Models6 May 2024
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspective28 Feb 2024
- 2024The Effect of Data Poisoning on Counterfactual Explanations13 Feb 2024
- 2023TrojFair: Trojan Fairness Attacks16 Dec 2023
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Risks7 Dec 2023
- 2023Survey on AI Ethics: A Socio-technical Perspective28 Nov 2023
- 2023Fair Graph Machine Learning under Adversarial Missingness Processes2 Nov 2023
- 2023Deceptive Fairness Attacks on Graphs via Meta Learning24 Oct 2023
- 2023Adversarial Attacks on Fairness of Graph Neural Networks20 Oct 2023
- 2023Towards Poisoning Fair Representations28 Sep 2023
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A survey6 Jun 2023
- 2023Bias in Pruned Vision Models: In-Depth Analysis and Countermeasures25 Apr 2023
- 2023To be Robust and to be Fair: Aligning Fairness with Robustness31 Mar 2023
- 2023Improving Fair Training under Correlation Shifts5 Feb 2023
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomy18 Jan 2023
- 2022A Survey on Preserving Fairness Guarantees in Changing Environments14 Nov 2022
- 2022Fairness-aware Regression Robust to Adversarial Attacks4 Nov 2022
- 2022Robust Fair Clustering: A Novel Fairness Attack and Defense Framework4 Oct 2022
- 2022Adversarial Inter-Group Link Injection Degrades the Fairness of Graph Neural Networks13 Sep 2022
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts4 Jul 2022
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis1 Jun 2022
- 2022Subverting Fair Image Search with Generative Adversarial Perturbations5 May 2022
- 2022Robust Conversational Agents against Imperceptible Toxicity Triggers5 May 2022
- 2022Fairness in Graph Mining: A Survey21 Apr 2022
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability18 Apr 2022
- 2022Breaking Fair Binary Classification with Optimal Flipping Attacks12 Apr 2022
- 2022Towards Multi-Objective Statistically Fair Federated Learning24 Jan 2022
- 2021Interpretable Data-Based Explanations for Fairness Debugging17 Dec 2021
- 2021Fairness Degrading Adversarial Attacks Against Clustering Algorithms22 Oct 2021
- 2021Poisoning Attacks on Fair Machine Learning17 Oct 2021
- 2021Machine Learning for Fraud Detection in E-Commerce: A Research Agenda5 Jul 2021
- 2021FLEA: Provably Robust Fair Multisource Learning from Unreliable Training Data22 Jun 2021
- 2021Fairness-Aware PAC Learning from Corrupted Data11 Feb 2021
- 2023Towards Poisoning Fair Representationscited by 3
- 2024The Effect of Data Poisoning on Counterfactual Explanationscited by 3
- 2025Adversarial Bias: Data Poisoning Attacks on Fairnesscited by 0
- 2025Adversarial Bias: Data Poisoning Attacks on Fairness11 Nov 2025
- 2024The Effect of Data Poisoning on Counterfactual Explanations13 Feb 2024
- 2023Towards Poisoning Fair Representations28 Sep 2023
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
- 2021Poisoning Attacks on Fair Machine Learningcited by 19
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2023Improving Fair Training under Correlation Shiftscited by 14
- 2022Robust Fair Clustering: A Novel Fairness Attack and Defense Frameworkcited by 13
- 2022Adversarial Inter-Group Link Injection Degrades the Fairness of Graph Neural Networkscited by 12
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shiftscited by 11
- 2023Bias in Pruned Vision Models: In-Depth Analysis and Countermeasurescited by 11
12 most cited of 42 All 42 (JSON)
- 2026Fairness Attacks on Recommender Systems27 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization29 Mar 2025
- 2025Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifiers8 Mar 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024BadFair: Backdoored Fairness Attacks with Group-conditioned Triggers23 Oct 2024
- 2024PFAttack: Stealthy Attack Bypassing Group Fairness in Federated Learning9 Oct 2024
- 2024EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning2 Oct 2024
- 2024A Catalog of Fairness-Aware Practices in Machine Learning Engineering29 Aug 2024
- 2024LayerMatch: Do Pseudo-labels Benefit All Layers?20 Jun 2024
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injections5 Jun 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
12 newest of 42 All 42 (JSON)