Detecting and Preventing Data Poisoning Attacks on AI Models
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
This paper investigates the critical issue of data poisoning attacks on AI models, a growing concern in the ever-evolving landscape of artificial intelligence and cybersecurity. As advanced technology systems become increasingly prevalent across various sectors, the need for robust defence mechanisms against adversarial attacks becomes paramount. The study aims to develop and evaluate novel techniques for detecting and preventing data poisoning attacks, focusing on both theoretical frameworks and practical applications. Through a comprehensive literature review, experimental validation using the CIFAR-10 and Insurance Claims datasets, and the development of innovative algorithms, this paper seeks to enhance the resilience of AI models against malicious data manipulation. The study explores various methods, including anomaly detection, robust optimization strategies, and ensemble learning, to identify and mitigate the effects of poisoned data during model training. Experimental results indicate that data poisoning significantly degrades model performance, reducing classification accuracy by up to 27% in image recognition tasks (CIFAR-10) and 22% in fraud detection models (Insurance Claims dataset). The proposed defence mechanisms, including statistical anomaly detection and adversarial training, successfully mitigated poisoning effects, improving model robustness and restoring accuracy levels by an average of 15-20%. The findings further demonstrate that ensemble learning techniques provide an additional layer of resilience, reducing false positives and false negatives caused by adversarial data injections.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 4 of its 19 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
4 of 19 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Survey
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning
- 2022Machine Learning Security against Data Poisoning: Are We There Yet?
- 2024Have You Poisoned My Data? Defending Neural Networks against Data Poisoning
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attacks
- 2021Defending Against Adversarial Denial-of-Service Data Poisoning Attacks
- 2021What Doesn't Kill You Makes You Robust(er): How to Adversarially Train against Data Poisoning
- 2021Poison Forensics: Traceback of Data Poisoning Attacks in Neural Networks