Certified Defenses for Data Poisoning Attacks
Not on the map. Why?
Cited by 91 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Machine learning systems trained on user-provided data are susceptible to data poisoning attacks, whereby malicious users inject false training data with the aim of corrupting the learned model. While recent work has proposed a number of attacks and defenses, little is understood about the worst-case loss of a defense in the face of a determined attacker. We address this by constructing approximate upper bounds on the loss across a broad family of attacks, for defenders that first perform outlier removal followed by empirical risk minimization. Our approximation relies on two assumptions: (1) that the dataset is large enough for statistical concentration between train and test error to hold, and (2) that outliers within the clean (non-poisoned) data do not have a strong effect on the model. Our bound comes paired with a candidate attack that often nearly matches the upper bound, giving us a powerful tool for quickly assessing defenses on a given dataset. Empirically, we find that even under a simple defense, the MNIST-1-7 and Dogfish datasets are resilient to attack, while in contrast the IMDB sentiment dataset can be driven from 12% to 23% test error by adding only 3% poisoned data.
Key facts. Cited by 303 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 55; 2022: 64; 2023: 52; 2024: 60; 2025: 38; 2026: 34.
303 papers.
Sort:
By area:
- 2021A Field Guide to Federated Optimizationcited by 315
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 222
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2021SPECTRE: Defending Against Backdoor Attacks Using Robust Statisticscited by 130
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 102
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 95
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2023Machine Unlearning: Solutions and Challengescited by 93
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 90
38 more
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2021Handcrafted Backdoors in Deep Neural Networkscited by 63
- 2021Property Inference From Poisoningcited by 60
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 59
- 2023Identifying and Mitigating Vulnerabilities in LLM-Integrated Applicationscited by 54
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 47
- 2021Poisoning the Unlabeled Dataset of Semi-Supervised Learningcited by 44
- 2021Data Poisoning Attacks to Deep Learning Based Recommender Systemscited by 43
- 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 43
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 41
- 2021Few-shot Backdoor Defense Using Shapley Estimationcited by 41
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Triggercited by 40
- 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 39
- 2025BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimizationcited by 38
- 2024Machine Unlearning Fails to Remove Data Poisoning Attackscited by 37
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generationcited by 36
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Robust Unlearnable Examples: Protecting Data Against Adversarial Learningcited by 35
- 2022PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learningcited by 34
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2021De-Pois: An Attack-Agnostic Defense against Data Poisoning Attackscited by 33
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2024Teach LLMs to Phish: Stealing Private Information from Language Modelscited by 32
- 2022SNAP: Efficient Extraction of Private Properties with Poisoningcited by 31
- 2021Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filteringcited by 30
- 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
- 2022Byzantine-Robust Federated Learning with Optimal Statistical Rates and Privacy Guaranteescited by 30
- 2022FLCert: Provably Secure Federated Learning against Poisoning Attackscited by 30
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoningcited by 30
- 2023Label Poisoning is All You Needcited by 29
- 2022One-shot Neural Backdoor Erasing via Adversarial Weight Maskingcited by 28
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generationcited by 28
- 2024Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuningcited by 27
- 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoningcited by 27
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 26
50 most cited of 303 All 303 (JSON)
- 2026Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors9 Oct 2026
- 2026SAGE: Similarity-Based Cleaning of Poisoned Training Data from Verified Examples1 Oct 2026
- 2026Why Backdooring Neural Networks is so Easy?28 Sep 2026
- 2026Let the Neurons Die: Exploiting ReLU-Induced Model Degradation28 Sep 2026
- 2026TRIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning31 Aug 2026
- 2026Robustness of Anomaly Detection Models for Industrial Control Systems under Training-Time Data Contamination24 Aug 2026
- 2026Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval17 Aug 2026
- 2026TextCloak: Thwarting Unauthorized LLM Exploitation via RL-Driven Unlearnable Text30 Jul 2026
- 2026Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations29 Jul 2026
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generation26 Jul 2026
- 2026Certified in Theory, Broken in Practice: Assumption Gaps in Cryptographic Model Certification23 Jul 2026
- 2026Data-Poisoning Audits for Causal Effect Estimation22 Jul 2026
38 more
- 2026Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints8 Jul 2026
- 2026Covert Trait Propagation Is Representation Alignment: Mechanistic Evidence from Hidden-Channel Distillation5 Jul 2026
- 2026Fixed-Set Robustness in Programming by Example: Example Corruption and Semantic Partition Recovery1 Jul 2026
- 2026Clustering Unsupervised Representations as Defense against Poisoning Attacks on Speech Commands Classification System27 Jun 2026
- 2026Amnesia: A Stealthy Replay Attack on Continual Learning Dreams10 Jun 2026
- 2026Sequential Data Poisoning in LLM Post-Training3 Jun 2026
- 2026On the Fragility of Data Attribution When Learning Is Distributed15 May 2026
- 2026Learning with Conflicts of Interest15 May 2026
- 2026Seed Hijacking of LLM Sampling and Quantum Random Number Defense8 May 2026
- 2026When AI reviews science: Can we trust the referee?26 Apr 2026
- 2026DeepSeek Robustness Against Semantic-Character Dual-Space Mutated Prompt Injection14 Apr 2026
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoning10 Apr 2026
- 2026Sample Complexity Bounds for Robust Mean Estimation with Mean-Shift Contamination25 Feb 2026
- 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglement19 Feb 2026
- 2026Exact Certification of Data-Poisoning Attacks Using Mixed-Integer Programming18 Feb 2026
- 2026Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories16 Feb 2026
- 2026One RNG to Rule Them All: How Randomness Becomes an Attack Vector in Machine Learning9 Feb 2026
- 2026DF-LoGiT: Data-Free Logic-Gated Backdoor Attacks in Vision Transformers3 Feb 2026
- 2026Representation Unlearning: Forgetting through Information Compression29 Jan 2026
- 2026Topology-Independent Robustness of the Weighted Mean under Label Poisoning Attacks in Heterogeneous Decentralized Learning6 Jan 2026
- 2026dataRLsec: Safety, Security, and Reliability With Robust Offline Reinforcement Learning for DPAs3 Jan 2026
- 2025Subtract the Corruption: Training-Data-Free Corrective Machine Unlearning using Task Arithmetic24 Nov 2025
- 2025SG-OIF: A Stability-Guided Online Influence Framework for Reliable Vision Data21 Nov 2025
- 2025Uncover and Unlearn Nuisances: Agnostic Fully Test-Time Adaptation16 Nov 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Density-Ratio Weighted Behavioral Cloning: Learning Control Policies from Corrupted Datasets1 Oct 2025
- 2025Poisoning Prompt-Guided Sampling in Video Large Language Models25 Sep 2025
- 2025Linear Regression under Missing or Corrupted Coordinates23 Sep 2025
- 2025Heterogeneity-Oblivious Robust Federated Learning5 Aug 2025
- 2025Data Security in Large Language Models: Risks, Defense, and Directions4 Aug 2025
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Models2 Aug 2025
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in data20 Jul 2025
- 2025MT4DP: Data Poisoning Attack Detection for DL-based Code Search Models via Metamorphic Testing15 Jul 2025
- 2025Tuning without Peeking: Provable Generalization Bounds and Robust LLM Post-Training2 Jul 2025
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection1 Jun 2025
- 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuning31 May 2025
- 2025Confidential Guardian: Cryptographically Prohibiting the Abuse of Model Abstention29 May 2025
50 newest of 303 All 303 (JSON)
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 222
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 102
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2023Machine Unlearning: Solutions and Challengescited by 93
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
- 2021CoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoningcited by 47
- 2021Data Poisoning Attacks to Deep Learning Based Recommender Systemscited by 43
- 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 43
- 2024Machine Unlearning Fails to Remove Data Poisoning Attackscited by 37
- 2022PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learningcited by 34
- 2021De-Pois: An Attack-Agnostic Defense against Data Poisoning Attackscited by 33
12 most cited of 83 All 83 (JSON)
- 2026SAGE: Similarity-Based Cleaning of Poisoned Training Data from Verified Examples1 Oct 2026
- 2026DeepSeek Robustness Against Semantic-Character Dual-Space Mutated Prompt Injection14 Apr 2026
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoning10 Apr 2026
- 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglement19 Feb 2026
- 2026Exact Certification of Data-Poisoning Attacks Using Mixed-Integer Programming18 Feb 2026
- 2026DF-LoGiT: Data-Free Logic-Gated Backdoor Attacks in Vision Transformers3 Feb 2026
- 2026Representation Unlearning: Forgetting through Information Compression29 Jan 2026
- 2026dataRLsec: Safety, Security, and Reliability With Robust Offline Reinforcement Learning for DPAs3 Jan 2026
- 2025Subtract the Corruption: Training-Data-Free Corrective Machine Unlearning using Task Arithmetic24 Nov 2025
- 2025Data Security in Large Language Models: Risks, Defense, and Directions4 Aug 2025
- 2025MT4DP: Data Poisoning Attack Detection for DL-based Code Search Models via Metamorphic Testing15 Jul 2025
12 newest of 83 All 83 (JSON)
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generationcited by 36
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generationcited by 28
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Modelscited by 5
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generationcited by 0
- 2026Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrievalcited by 0
- 2026TRIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoningcited by 0
- 2026TRIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning31 Aug 2026
- 2026Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval17 Aug 2026
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generation26 Jul 2026
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generation30 Apr 2025
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generation4 Apr 2025
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Models10 Mar 2025
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb 2024
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 90
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2025LLM Misalignment via Adversarial RLHF Platformscited by 5
- 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuningcited by 1
- 2026Sequential Data Poisoning in LLM Post-Trainingcited by 0
- 2026Sequential Data Poisoning in LLM Post-Training3 Jun 2026
- 2025SafeTuneBed: A Toolkit for Benchmarking LLM Safety Alignment in Fine-Tuning31 May 2025
- 2025LLM Misalignment via Adversarial RLHF Platforms4 Mar 2025
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey26 Sep 2024
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
- 2024Security of AI Agentscited by 26
- 2024The Wolf Within: Covert Injection of Malice into MLLM Societies via an MLLM Operativecited by 21
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifestocited by 7
- 2024Security of AI Agents12 Jun 2024
- 2024The Wolf Within: Covert Injection of Malice into MLLM Societies via an MLLM Operative20 Feb 2024
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifesto4 Dec 2023
- 2021A Field Guide to Federated Optimizationcited by 315
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2021SPECTRE: Defending Against Backdoor Attacks Using Robust Statisticscited by 130
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 95
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2021Handcrafted Backdoors in Deep Neural Networkscited by 63
- 2021Property Inference From Poisoningcited by 60
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 59
- 2023Identifying and Mitigating Vulnerabilities in LLM-Integrated Applicationscited by 54
- 2021Poisoning the Unlabeled Dataset of Semi-Supervised Learningcited by 44
12 most cited of 197 All 197 (JSON)
- 2026Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors9 Oct 2026
- 2026Why Backdooring Neural Networks is so Easy?28 Sep 2026
- 2026Let the Neurons Die: Exploiting ReLU-Induced Model Degradation28 Sep 2026
- 2026Robustness of Anomaly Detection Models for Industrial Control Systems under Training-Time Data Contamination24 Aug 2026
- 2026TextCloak: Thwarting Unauthorized LLM Exploitation via RL-Driven Unlearnable Text30 Jul 2026
- 2026Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations29 Jul 2026
- 2026Certified in Theory, Broken in Practice: Assumption Gaps in Cryptographic Model Certification23 Jul 2026
- 2026Data-Poisoning Audits for Causal Effect Estimation22 Jul 2026
- 2026Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints8 Jul 2026
- 2026Covert Trait Propagation Is Representation Alignment: Mechanistic Evidence from Hidden-Channel Distillation5 Jul 2026
- 2026Fixed-Set Robustness in Programming by Example: Example Corruption and Semantic Partition Recovery1 Jul 2026
- 2026Clustering Unsupervised Representations as Defense against Poisoning Attacks on Speech Commands Classification System27 Jun 2026
12 newest of 197 All 197 (JSON)