Machine Learning Security against Data Poisoning: Are We There Yet?
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised when such data is maliciously manipulated to mislead the learning process. In this article, we first review poisoning attacks that compromise the training data used to learn ML models, including attacks that aim to reduce the overall performance, manipulate the predictions on specific test samples, and even implant backdoors in the model. We then discuss how to mitigate these attacks using basic security principles, or by deploying ML-oriented defensive mechanisms. We conclude our article by formulating some relevant open challenges which are hindering the development of testing methods and benchmarks suitable for assessing and improving the trustworthiness of ML models against data poisoning attacks
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 12 of its 37 references that are in the map. First posted on arXiv 12 Apr 2022.
Builds on
12 of 37 references.
References · 12
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 519
- 2017Certified Defenses for Data Poisoning Attackscited by 303
- 2017Towards Poisoning of Deep Learning Algorithms with Back-gradient Optimizationcited by 197
- 2019Demon in the Variant: Statistical Analysis of DNNs for Robust Backdoor Contamination Detectioncited by 124
- 2020Adversarial Machine Learning -- Industry Perspectivescited by 122
- 2020On the Effectiveness of Mitigating Data Poisoning Attacks with Gradient Shapingcited by 83
- 2019Learning to Confuse: Generating Training Time Adversarial Data with Auto-Encodercited by 70
- 2020Subpopulation Data Poisoning Attackscited by 70
- 2020Poisoning Attacks on Algorithmic Fairnesscited by 59
- 2022Energy-Latency Attacks via Sponge Poisoningcited by 29
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 4; 2025: 9; 2026: 3.
23 papers.
Sort:
By area:
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memorycited by 67
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attackscited by 33
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
- 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulationcited by 7
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Codecited by 6
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoningcited by 6
- 2025LLM Misalignment via Adversarial RLHF Platformscited by 5
- 2023Minimizing Energy Consumption of Deep Learning Models by Energy-Aware Trainingcited by 3
- 2025Automatic Grid Updates for Kolmogorov-Arnold Networks using Layer Histogramscited by 3
- 2023Hardening RGB-D Object Recognition Systems against Adversarial Patch Attackscited by 2
11 more
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systemscited by 2
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
- 2024Federated Learning in Adversarial Environments: Testbed Design and Poisoning Resilience in Cybersecuritycited by 1
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomycited by 0
- 2024Sonic: Fast and Transferable Data Poisoning on Clustering Algorithmscited by 0
- 2025Task-Agnostic Federation over Decentralized Data: Research Landscape and Visionscited by 0
- 2025How to Protect Models against Adversarial Unlearning?cited by 0
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Modelscited by 0
- 2026Topology-Independent Robustness of the Weighted Mean under Label Poisoning Attacks in Heterogeneous Decentralized Learningcited by 0
- 2026RPP: A Certified Poisoned-Sample Detection Framework for Backdoor Attacks under Dataset Imbalancecited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logisticscited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026RPP: A Certified Poisoned-Sample Detection Framework for Backdoor Attacks under Dataset Imbalance30 Jan 2026
- 2026Topology-Independent Robustness of the Weighted Mean under Label Poisoning Attacks in Heterogeneous Decentralized Learning6 Jan 2026
- 2025Automatic Grid Updates for Kolmogorov-Arnold Networks using Layer Histograms11 Nov 2025
- 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory29 Sep 2025
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Models2 Aug 2025
- 2025How to Protect Models against Adversarial Unlearning?15 Jul 2025
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systems5 Jul 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2025Task-Agnostic Federation over Decentralized Data: Research Landscape and Visions5 Mar 2025
- 2025LLM Misalignment via Adversarial RLHF Platforms4 Mar 2025
- 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulation18 Feb 2025
11 more
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoning30 Nov 2024
- 2024Federated Learning in Adversarial Environments: Testbed Design and Poisoning Resilience in Cybersecurity15 Sep 2024
- 2024Sonic: Fast and Transferable Data Poisoning on Clustering Algorithms14 Aug 2024
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code11 Mar 2024
- 2023Hardening RGB-D Object Recognition Systems against Adversarial Patch Attacks13 Sep 2023
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks4 Aug 2023
- 2023Minimizing Energy Consumption of Deep Learning Models by Energy-Aware Training1 Jul 2023
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoning6 May 2023
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelines9 Feb 2023
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomy18 Jan 2023
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning4 May 2022
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attackscited by 33
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulationcited by 7
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Codecited by 6
- 2025How to Protect Models against Adversarial Unlearning?cited by 0
- 2025How to Protect Models against Adversarial Unlearning?15 Jul 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulation18 Feb 2025
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code11 Mar 2024
- 2023Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks4 Aug 2023
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning4 May 2022
- 2025LLM Misalignment via Adversarial RLHF Platformscited by 5
- 2025LLM Misalignment via Adversarial RLHF Platforms4 Mar 2025
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoningcited by 6
- 2023Minimizing Energy Consumption of Deep Learning Models by Energy-Aware Trainingcited by 3
- 2025Automatic Grid Updates for Kolmogorov-Arnold Networks using Layer Histogramscited by 3
- 2023Hardening RGB-D Object Recognition Systems against Adversarial Patch Attackscited by 2
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systemscited by 2
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
- 2024Federated Learning in Adversarial Environments: Testbed Design and Poisoning Resilience in Cybersecuritycited by 1
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomycited by 0
- 2024Sonic: Fast and Transferable Data Poisoning on Clustering Algorithmscited by 0
- 2025Task-Agnostic Federation over Decentralized Data: Research Landscape and Visionscited by 0
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026RPP: A Certified Poisoned-Sample Detection Framework for Backdoor Attacks under Dataset Imbalance30 Jan 2026
- 2026Topology-Independent Robustness of the Weighted Mean under Label Poisoning Attacks in Heterogeneous Decentralized Learning6 Jan 2026
- 2025Automatic Grid Updates for Kolmogorov-Arnold Networks using Layer Histograms11 Nov 2025
- 2025Defending Against Beta Poisoning Attacks in Machine Learning Models2 Aug 2025
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systems5 Jul 2025
- 2025Task-Agnostic Federation over Decentralized Data: Research Landscape and Visions5 Mar 2025
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoning30 Nov 2024
- 2024Federated Learning in Adversarial Environments: Testbed Design and Poisoning Resilience in Cybersecurity15 Sep 2024
- 2024Sonic: Fast and Transferable Data Poisoning on Clustering Algorithms14 Aug 2024
- 2023Hardening RGB-D Object Recognition Systems against Adversarial Patch Attacks13 Sep 2023
- 2023Minimizing Energy Consumption of Deep Learning Models by Energy-Aware Training1 Jul 2023
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Survey
- 2021Preventing Machine Learning Poisoning Attacks Using Authentication and Provenance
- 2023Analysis of Label-Flip Poisoning Attack on Machine Learning Based Malware Detector
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks
- 2025Detecting and Preventing Data Poisoning Attacks on AI Models
- 2022Lethal Dose Conjecture on Data Poisoning
- 2023Exploring the Limits of Model-Targeted Indiscriminate Data Poisoning Attacks
- 2022How to Sift Out a Clean Data Subset in the Presence of Data Poisoning?