MetaPoison: Practical General-purpose Clean-label Data Poisoning
Not on the map. Why?
Cited by 45 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Data poisoning -- the process by which an attacker takes control of a model by making imperceptible changes to a subset of the training data -- is an emerging threat in the context of neural networks. Existing attacks for data poisoning neural networks have relied on hand-crafted heuristics, because solving the poisoning problem directly via bilevel optimization is generally thought of as intractable for deep models. We propose MetaPoison, a first-order method that approximates the bilevel problem via meta-learning and crafts poisons that fool neural networks. MetaPoison is effective: it outperforms previous clean-label poisoning methods by a large margin. MetaPoison is robust: poisoned data made for one model transfer to a variety of victim models with unknown training settings and architectures. MetaPoison is general-purpose, it works not only in fine-tuning scenarios, but also for end-to-end training from scratch, which till now hasn't been feasible for clean-label attacks with deep nets. MetaPoison can achieve arbitrary adversary goals -- like using poisons of one class to make a target image don the label of another arbitrarily chosen class. Finally, MetaPoison works in the real-world. We demonstrate for the first time successful data poisoning of models trained on the black-box Google Cloud AutoML API. Code and premade poisons are provided at https://github.com/wronnyhuang/metapoison
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 22; 2023: 24; 2024: 29; 2025: 12; 2026: 10.
114 papers.
Sort:
By area:
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2021Adversarial Examples Make Strong Poisonscited by 115
- 2023On the Exploitability of Instruction Tuningcited by 110
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 98
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2021Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimizationcited by 75
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2022Advancing Model Pruning via Bi-level Optimizationcited by 55
- 2023Unveiling Security, Privacy, and Ethical Concerns of ChatGPTcited by 53
- 2021Hard to Forget: Poisoning Attacks on Certified Machine Unlearningcited by 47
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 47
38 more
- 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learningcited by 42
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learningcited by 39
- 2021Poison Forensics: Traceback of Data Poisoning Attacks in Neural Networkscited by 37
- 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 37
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
- 2024Machine Unlearning Fails to Remove Data Poisoning Attackscited by 35
- 2021DP-InstaHide: Provably Defusing Poisoning and Backdoor Attacks with Differentially Private Data Augmentationscited by 33
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2022Marksman Backdoor: Backdoor Attacks with Arbitrary Target Classcited by 32
- 2021Defending Against Backdoor Attacks in Natural Language Generationcited by 30
- 2022LoMar: A Local Defense Against Poisoning Attack on Federated Learningcited by 29
- 2022One-Pixel Shortcut: on the Learning Preference of Deep Neural Networkscited by 29
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoningcited by 29
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2024Corrective Machine Unlearningcited by 26
- 2024Scaling Trends for Data Poisoning in LLMscited by 26
- 2022One-shot Neural Backdoor Erasing via Adversarial Weight Maskingcited by 25
- 2022Indiscriminate Data Poisoning Attacks on Neural Networkscited by 24
- 2021What Doesn't Kill You Makes You Robust(er): How to Adversarially Train against Data Poisoningcited by 22
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2022Friendly Noise against Adversarial Noise: A Powerful Defense against Data Poisoning Attackscited by 20
- 2024Noisy Neighbors: Efficient membership inference attacks against LLMscited by 20
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2022Self-Ensemble Protection: Training Checkpoints Are Good Data Protectorscited by 19
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splattingcited by 17
- 2022An Equivalence Between Data Poisoning and Byzantine Gradient Attackscited by 16
- 2022Few-shot Backdoor Attacks via Neural Tangent Kernelscited by 15
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2023Detection and Defense of Unlearnable Examplescited by 13
- 2021Understanding the Limits of Unsupervised Domain Adaptation via Data Poisoningcited by 11
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2024Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimizationcited by 11
- 2021Accumulative Poisoning Attacks on Real-time Datacited by 10
- 2021Going Grayscale: The Road to Understanding and Improving Unlearnable Examplescited by 10
- 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Predictioncited by 10
50 most cited of 114 All 114 (JSON)
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era6 Aug 2026
- 2026Reviewing Model Collapse and Countermeasures17 Jun 2026
- 2026SoK: A Comprehensive Analysis of the Current Status of Neural Tangent Generalization Attacks with Research Directions12 May 2026
- 2026SoK: Unlearnability and Unlearning for Model Dememorization12 May 2026
- 2026Synthetic Data for any Differentiable Target9 Apr 2026
- 2026Efficient Bilevel Optimization with KFAC-Based Hypergradients31 Mar 2026
- 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining5 Mar 2026
- 2026Analyzing Fairness of Neural Network Prediction via Counterfactual Dataset Generation11 Feb 2026
- 2026Infusion: Shaping Model Behavior by Editing Training Data via Influence Functions10 Feb 2026
- 2026Stealthy Poisoning Attacks Bypass Defenses in Regression Settings29 Jan 2026
- 2025Robustness Certificates for Neural Networks Against Data Poisoning and Evasion Attacks24 Dec 2025
- 2025ToxicTextCLIP: Text-Based Poisoning and Backdoor Attacks on CLIP Pre-training1 Nov 2025
38 more
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks25 Oct 2025
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Models2 Aug 2025
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Models11 Jul 2025
- 2025Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agents16 Jun 2025
- 2025Beyond Invisibility: Learning Robust Visible Watermarks for Stronger Copyright Protection3 Jun 2025
- 2025Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning22 May 2025
- 2025SFIBA: Spatial-based Full-target Invisible Backdoor Attacks29 Apr 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2025Approaching the Harm of Gradient Attacks While Only Flipping Labels28 Feb 2025
- 2025Neuroplasticity and Corruption in Model Mechanisms: A Case Study Of Indirect Object Identification27 Feb 2025
- 2024Generalizable Targeted Data Poisoning against Varying Physical Objects5 Dec 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Inverting Gradient Attacks Makes Powerful Data Poisoning28 Oct 2024
- 2024Fragile Giants: Understanding the Susceptibility of Models to Subpopulation Attacks11 Oct 2024
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splatting10 Oct 2024
- 2024Empirical Perturbation Analysis of Linear System Solvers from a Data Poisoning Perspective1 Oct 2024
- 2024Timber! Poisoning Decision Trees1 Oct 2024
- 2024The poison of dimensionality25 Sep 2024
- 2024Data Poisoning and Leakage Analysis in Federated Learning19 Sep 2024
- 2024VFLIP: A Backdoor Defense for Vertical Federated Learning via Identification and Purification28 Aug 2024
- 2024Unlearnable Examples Detection via Iterative Filtering15 Aug 2024
- 2024Scaling Trends for Data Poisoning in LLMs6 Aug 2024
- 2024On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness23 Jul 2024
- 2024Improving SAM Requires Rethinking its Optimization Formulation17 Jul 2024
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks15 Jul 2024
- 2024Machine Unlearning Fails to Remove Data Poisoning Attacks25 Jun 2024
- 2024Noisy Neighbors: Efficient membership inference attacks against LLMs24 Jun 2024
- 2024Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization20 Jun 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024Watermarking Counterfactual Explanations29 May 2024
- 2024PureEBM: Universal Poison Purification via Mid-Run Dynamics of Energy-Based Models28 May 2024
- 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics28 May 2024
- 2024Hard Work Does Not Always Pay Off: Poisoning Attacks on Neural Architecture Search9 May 2024
- 2024Generating Potent Poisons and Backdoors from Scratch with Guided Diffusion25 Mar 2024
- 2024Certified Robustness to Clean-Label Poisoning Using Diffusion Denoising18 Mar 2024
- 2024Corrective Machine Unlearning21 Feb 2024
- 2024Dynamic Byzantine-Robust Learning: Adapting to Switching Byzantine Workers5 Feb 2024
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
50 newest of 114 All 114 (JSON)
- 2023On the Exploitability of Instruction Tuningcited by 110
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 98
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2021Hard to Forget: Poisoning Attacks on Certified Machine Unlearningcited by 47
- 2021Poison Forensics: Traceback of Data Poisoning Attacks in Neural Networkscited by 37
- 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 37
- 2024Machine Unlearning Fails to Remove Data Poisoning Attackscited by 35
- 2021Defending Against Backdoor Attacks in Natural Language Generationcited by 30
- 2022Not All Poisons are Created Equal: Robust Training against Data Poisoningcited by 29
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2024Corrective Machine Unlearningcited by 26
- 2024Scaling Trends for Data Poisoning in LLMscited by 26
12 most cited of 40 All 40 (JSON)
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era6 Aug 2026
- 2026SoK: Unlearnability and Unlearning for Model Dememorization12 May 2026
- 2025Robustness Certificates for Neural Networks Against Data Poisoning and Evasion Attacks24 Dec 2025
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks25 Oct 2025
- 2025Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning22 May 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2024Generalizable Targeted Data Poisoning against Varying Physical Objects5 Dec 2024
- 2024Inverting Gradient Attacks Makes Powerful Data Poisoning28 Oct 2024
- 2024Empirical Perturbation Analysis of Linear System Solvers from a Data Poisoning Perspective1 Oct 2024
- 2024Data Poisoning and Leakage Analysis in Federated Learning19 Sep 2024
- 2024Unlearnable Examples Detection via Iterative Filtering15 Aug 2024
- 2024Scaling Trends for Data Poisoning in LLMs6 Aug 2024
12 newest of 40 All 40 (JSON)
- 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learningcited by 42
- 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamicscited by 3
- 2024Generating Potent Poisons and Backdoors from Scratch with Guided Diffusioncited by 0
- 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics28 May 2024
- 2024Generating Potent Poisons and Backdoors from Scratch with Guided Diffusion25 Mar 2024
- 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learning22 Nov 2023
- 2026Synthetic Data for any Differentiable Targetcited by 2
- 2026Reviewing Model Collapse and Countermeasurescited by 0
- 2026Reviewing Model Collapse and Countermeasures17 Jun 2026
- 2026Synthetic Data for any Differentiable Target9 Apr 2026
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2021Adversarial Examples Make Strong Poisonscited by 115
- 2021Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimizationcited by 75
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2022Advancing Model Pruning via Bi-level Optimizationcited by 55
- 2023Unveiling Security, Privacy, and Ethical Concerns of ChatGPTcited by 53
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 47
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learningcited by 39
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
12 most cited of 65 All 65 (JSON)
- 2026SoK: A Comprehensive Analysis of the Current Status of Neural Tangent Generalization Attacks with Research Directions12 May 2026
- 2026Efficient Bilevel Optimization with KFAC-Based Hypergradients31 Mar 2026
- 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining5 Mar 2026
- 2026Analyzing Fairness of Neural Network Prediction via Counterfactual Dataset Generation11 Feb 2026
- 2026Infusion: Shaping Model Behavior by Editing Training Data via Influence Functions10 Feb 2026
- 2026Stealthy Poisoning Attacks Bypass Defenses in Regression Settings29 Jan 2026
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Models2 Aug 2025
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Models11 Jul 2025
- 2025Beyond Invisibility: Learning Robust Visible Watermarks for Stronger Copyright Protection3 Jun 2025
- 2025SFIBA: Spatial-based Full-target Invisible Backdoor Attacks29 Apr 2025
- 2025Approaching the Harm of Gradient Attacks While Only Flipping Labels28 Feb 2025
- 2025Neuroplasticity and Corruption in Model Mechanisms: A Case Study Of Indirect Object Identification27 Feb 2025
12 newest of 65 All 65 (JSON)