Data Poisoning against Differentially-Private Learners: Attacks and Defenses
Not on the map. Why?
Cited by 23 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Data poisoning attacks aim to manipulate the model produced by a learning algorithm by adversarially modifying the training set. We consider differential privacy as a defensive measure against this type of attack. We show that such learners are resistant to data poisoning attacks when the adversary is only able to poison a small number of items. However, this protection degrades as the adversary poisons more data. To illustrate, we design attack algorithms targeting objective and output perturbation learners, two standard approaches to differentially-private machine learning. Experiments show that our methods are effective when the attacker is allowed to poison sufficiently many training items.
Key facts. Cited by 75 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 17; 2023: 16; 2024: 14; 2025: 10.
75 papers.
Sort:
By area:
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2021Large Scale Private Learning via Low-rank Reparametrizationcited by 87
- 2021Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learningcited by 86
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2022Mixed Differential Privacy in Computer Visioncited by 53
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 50
- 2021Data Poisoning Attacks to Deep Learning Based Recommender Systemscited by 41
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2021DP-InstaHide: Provably Defusing Poisoning and Backdoor Attacks with Differentially Private Data Augmentationscited by 33
- 2022PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learningcited by 33
38 more
- 2022SNAP: Efficient Extraction of Private Properties with Poisoningcited by 29
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoningcited by 29
- 2022A General Framework for Auditing Differentially Private Machine Learningcited by 25
- 2024Decentralized Federated Learning: A Survey on Security and Privacycited by 25
- 2021What Doesn't Kill You Makes You Robust(er): How to Adversarially Train against Data Poisoningcited by 22
- 2021Curse or Redemption? How Data Heterogeneity Affects the Robustness of Federated Learningcited by 21
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learningcited by 21
- 2022BagFlip: A Certified Defense against Data Poisoningcited by 18
- 2022Backdoor Cleansing with Unlabeled Datacited by 17
- 2021Robust learning under clean-label attackcited by 15
- 2021Poisoning Attack against Estimating from Pairwise Comparisonscited by 14
- 2023Detection and Defense of Unlearnable Examplescited by 13
- 2022Lethal Dose Conjecture on Data Poisoningcited by 12
- 2022Unraveling the Connections between Privacy and Certified Robustness in Federated Learning Against Poisoning Attackscited by 12
- 2023PrivImage: Differentially Private Synthetic Image Generation using Diffusion Models with Semantic-Aware Pretrainingcited by 12
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governancecited by 12
- 2023Temporal Robustness against Data Poisoningcited by 10
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imagingcited by 10
- 2021SoK: Machine Learning Governancecited by 9
- 2023A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspectivecited by 9
- 2021Meta Federated Learningcited by 8
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challengescited by 7
- 2023Adversarial Attacks on Adversarial Banditscited by 6
- 2023Enhancing the Antidote: Improved Pointwise Certifications against Poisoning Attackscited by 6
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyondcited by 6
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusionscited by 6
- 202110 Security and Privacy Problems in Large Foundation Modelscited by 5
- 2023PECAN: A Deterministic Certified Defense Against Backdoor Attackscited by 5
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attackscited by 5
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoningcited by 5
- 2022Federated and Transfer Learning: A Survey on Adversaries and Defense Mechanismscited by 4
- 2022Renyi Differential Privacy of Propose-Test-Release and Applications to Private and Robust Machine Learningcited by 4
- 2023Recursive Euclidean Distance Based Robust Aggregation Technique For Federated Learningcited by 4
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacycited by 4
- 2021Combining Differential Privacy and Byzantine Resilience in Distributed SGDcited by 3
- 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamicscited by 3
- 2024The poison of dimensionalitycited by 3
50 most cited of 75 All 75 (JSON)
- 2025Robustness Certificates for Neural Networks Against Data Poisoning and Evasion Attacks24 Dec 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025On the Fragility of Contribution Score Computation in Federated Learning24 Sep 2025
- 2025Amulet: a Python Library for Assessing Interactions Among ML Defenses and Risks15 Sep 2025
- 2025Multi-level Certified Defense Against Poisoning Attacks in Offline Reinforcement Learning27 May 2025
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacy9 May 2025
- 2025Empirical Privacy Variance16 Mar 2025
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond10 Mar 2025
- 2025FedNIA: Noise-Induced Activation Analysis for Mitigating Data Poisoning in Federated Learning23 Feb 2025
- 2025Cooperative Decentralized Backdoor Attacks on Vertical Federated Learning16 Jan 2025
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoning30 Nov 2024
- 2024Combining Machine Learning Defenses without Conflicts14 Nov 2024
38 more
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imaging7 Nov 2024
- 2024The poison of dimensionality25 Sep 2024
- 2024Data Poisoning and Leakage Analysis in Federated Learning19 Sep 2024
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks15 Jul 2024
- 2024Venomancer: Towards Imperceptible and Target-on-Demand Backdoor Attacks in Federated Learning3 Jul 2024
- 2024PureEBM: Universal Poison Purification via Mid-Run Dynamics of Energy-Based Models28 May 2024
- 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics28 May 2024
- 2024Have You Poisoned My Data? Defending Neural Networks against Data Poisoning20 Mar 2024
- 2024Certified Robustness to Clean-Label Poisoning Using Diffusion Denoising18 Mar 2024
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance2 Feb 2024
- 2024Decentralized Federated Learning: A Survey on Security and Privacy25 Jan 2024
- 2024Security and Privacy Issues and Solutions in Federated Learning for Digital Healthcare16 Jan 2024
- 2023Balancing Privacy, Robustness, and Efficiency in Machine Learning22 Dec 2023
- 2023Detection and Defense of Unlearnable Examples14 Dec 2023
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Risks7 Dec 2023
- 2023Mendata: A Framework to Purify Manipulated Training Data3 Dec 2023
- 2023A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspective27 Nov 2023
- 2023Does Differential Privacy Prevent Backdoor Attacks in Practice?10 Nov 2023
- 2023PrivImage: Differentially Private Synthetic Image Generation using Diffusion Models with Semantic-Aware Pretraining19 Oct 2023
- 2023Enhancing the Antidote: Improved Pointwise Certifications against Poisoning Attacks15 Aug 2023
- 2023Systematic Testing of the Data-Poisoning Robustness of KNN17 Jul 2023
- 2023On Practical Aspects of Aggregation Defenses against Data Poisoning Attacks28 Jun 2023
- 2023Differentially-Private Decision Trees and Provable Robustness to Data Poisoning24 May 2023
- 2023Recursive Euclidean Distance Based Robust Aggregation Technique For Federated Learning20 Mar 2023
- 2023Temporal Robustness against Data Poisoning7 Feb 2023
- 2023Universal Soldier: Using Universal Adversarial Perturbations for Detecting Backdoor Attacks1 Feb 2023
- 2023Adversarial Attacks on Adversarial Bandits30 Jan 2023
- 2023PECAN: A Deterministic Certified Defense Against Backdoor Attacks27 Jan 2023
- 2022Backdoor Cleansing with Unlabeled Data22 Nov 2022
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoning18 Oct 2022
- 2022A General Framework for Auditing Differentially Private Machine Learning16 Oct 2022
- 2022On the Robustness of Random Forest Against Untargeted Data Poisoning: An Ensemble-Based Approach28 Sep 2022
- 2022Renyi Differential Privacy of Propose-Test-Release and Applications to Private and Robust Machine Learning16 Sep 2022
- 2022Unraveling the Connections between Privacy and Certified Robustness in Federated Learning Against Poisoning Attacks8 Sep 2022
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learning29 Aug 2022
- 2022SNAP: Efficient Extraction of Private Properties with Poisoning25 Aug 2022
- 2022Lethal Dose Conjecture on Data Poisoning5 Aug 2022
- 2022Federated and Transfer Learning: A Survey on Adversaries and Defense Mechanisms5 Jul 2022
50 newest of 75 All 75 (JSON)
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 50
- 2021Data Poisoning Attacks to Deep Learning Based Recommender Systemscited by 41
- 2022PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learningcited by 33
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoningcited by 29
- 2021What Doesn't Kill You Makes You Robust(er): How to Adversarially Train against Data Poisoningcited by 22
- 2021Curse or Redemption? How Data Heterogeneity Affects the Robustness of Federated Learningcited by 21
- 2022BagFlip: A Certified Defense against Data Poisoningcited by 18
- 2022Lethal Dose Conjecture on Data Poisoningcited by 12
- 2023Temporal Robustness against Data Poisoningcited by 10
- 2021Meta Federated Learningcited by 8
- 2023Recursive Euclidean Distance Based Robust Aggregation Technique For Federated Learningcited by 4
12 most cited of 22 All 22 (JSON)
- 2025Robustness Certificates for Neural Networks Against Data Poisoning and Evasion Attacks24 Dec 2025
- 2025FedNIA: Noise-Induced Activation Analysis for Mitigating Data Poisoning in Federated Learning23 Feb 2025
- 2024Data Poisoning and Leakage Analysis in Federated Learning19 Sep 2024
- 2024PureEBM: Universal Poison Purification via Mid-Run Dynamics of Energy-Based Models28 May 2024
- 2024Have You Poisoned My Data? Defending Neural Networks against Data Poisoning20 Mar 2024
- 2023Systematic Testing of the Data-Poisoning Robustness of KNN17 Jul 2023
- 2023On Practical Aspects of Aggregation Defenses against Data Poisoning Attacks28 Jun 2023
- 2023Differentially-Private Decision Trees and Provable Robustness to Data Poisoning24 May 2023
- 2023Recursive Euclidean Distance Based Robust Aggregation Technique For Federated Learning20 Mar 2023
- 2023Temporal Robustness against Data Poisoning7 Feb 2023
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoning18 Oct 2022
- 2022On the Robustness of Random Forest Against Untargeted Data Poisoning: An Ensemble-Based Approach28 Sep 2022
12 newest of 22 All 22 (JSON)
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
- 2021Large Scale Private Learning via Low-rank Reparametrizationcited by 87
- 2021Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learningcited by 86
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2022Mixed Differential Privacy in Computer Visioncited by 53
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2021DP-InstaHide: Provably Defusing Poisoning and Backdoor Attacks with Differentially Private Data Augmentationscited by 33
- 2022SNAP: Efficient Extraction of Private Properties with Poisoningcited by 29
- 2022A General Framework for Auditing Differentially Private Machine Learningcited by 25
- 2024Decentralized Federated Learning: A Survey on Security and Privacycited by 25
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learningcited by 21
12 most cited of 50 All 50 (JSON)
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025On the Fragility of Contribution Score Computation in Federated Learning24 Sep 2025
- 2025Amulet: a Python Library for Assessing Interactions Among ML Defenses and Risks15 Sep 2025
- 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacy9 May 2025
- 2025Empirical Privacy Variance16 Mar 2025
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond10 Mar 2025
- 2025Cooperative Decentralized Backdoor Attacks on Vertical Federated Learning16 Jan 2025
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoning30 Nov 2024
- 2024Combining Machine Learning Defenses without Conflicts14 Nov 2024
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imaging7 Nov 2024
- 2024The poison of dimensionality25 Sep 2024
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks15 Jul 2024
12 newest of 50 All 50 (JSON)