Autoregressive Perturbations for Data Poisoning
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
The prevalence of data scraping from social media as a means to obtain datasets has led to growing concerns regarding unauthorized use of data. Data poisoning attacks have been proposed as a bulwark against scraping, as they make data "unlearnable" by adding small, imperceptible perturbations. Unfortunately, existing methods require knowledge of both the target architecture and the complete dataset so that a surrogate network can be trained, the parameters of which are used to generate the attack. In this work, we introduce autoregressive (AR) poisoning, a method that can generate poisoned data without access to the broader dataset. The proposed AR perturbations are generic, can be applied across different datasets, and can poison different architectures. Compared to existing unlearnable methods, our AR poisons are more resistant against common defenses such as adversarial training and strong data augmentations. Our analysis further provides insight into what makes an effective data poison.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 30 of its 46 references that are in the map. First posted on arXiv 8 Jun 2022.
Builds on
30 of 46 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2014Going Deeper with Convolutionscited by 4,231
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
18 more
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 349
- 2020Large image datasets: A pyrrhic win for computer vision?cited by 237
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
- 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
- 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 156
- 2019Transferable Clean-Label Poisoning Attacks on Deep Neural Netscited by 129
- 2021Adversarial Examples Make Strong Poisonscited by 115
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Poisons that are learned faster are more effectivecited by 14
- 2021Fooling Adversarial Training with Inducing Noisecited by 12
- 2022Learnability Lock: Authorized Learnability Control Through Adversarial Invertible Transformationscited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 18; 2025: 8; 2026: 10.
45 papers.
Sort:
By area:
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attackscited by 28
- 2023Exploring the Limits of Model-Targeted Indiscriminate Data Poisoning Attackscited by 23
- 2023What Can We Learn from Unlearnable Datasets?cited by 21
- 2022Self-Ensemble Protection: Training Checkpoints Are Good Data Protectorscited by 19
- 2023The Devil's Advocate: Shattering the Illusion of Unexploitable Data using Diffusion Modelscited by 19
- 2024Purify Unlearnable Examples via Rate-Constrained Variational Autoencoderscited by 18
- 2024Provably Unlearnable Data Examplescited by 18
- 2024Semantic Deep Hiding for Robust Unlearnable Examplescited by 13
- 2024UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentationcited by 13
- 2024Efficient Availability Attacks against Supervised and Contrastive Learning Simultaneouslycited by 12
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learningcited by 11
33 more
- 2024Disguised Copyright Infringement of Latent Diffusion Modelscited by 10
- 2024ECLIPSE: Expunging Clean-label Indiscriminate Poisons via Sparse Diffusion Purificationcited by 9
- 2024Unlearnable Examples Detection via Iterative Filteringcited by 9
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Trackingcited by 9
- 2024Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractorscited by 8
- 2023APBench: A Unified Benchmark for Availability Poisoning Attacks and Defensescited by 7
- 2024Toward Availability Attacks in 3D Point Cloudscited by 7
- 2023Transferable Availability Poisoning Attackscited by 5
- 2024Nonlinear Transformations Against Unlearnable Datasetscited by 5
- 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretrainingcited by 5
- 2025How Far Are We from True Unlearnability?cited by 4
- 2024Towards Operationalizing Right to Data Protectioncited by 3
- 2024BridgePure: Limited Protection Leakage Can Break Black-Box Data Protectioncited by 3
- 2025T2UE: Generating Unlearnable Examples from Text Descriptionscited by 3
- 2026Full spectrum Unlearnable Examples via Spectral Equalizationcited by 3
- 2024Finding needles in a haystack: A Black-Box Approach to Invisible Watermark Detectioncited by 2
- 2025Provable Watermarking for Data Poisoning Attackscited by 2
- 2026Why Do Unlearnable Examples Work: A Novel Perspective of Mutual Informationcited by 2
- 2026LLM Benchmark Datasets Should Be Contamination-Resistantcited by 2
- 2023Unlearnable Examples Give a False Sense of Data Privacy: Understanding and Relearningcited by 1
- 2024Be Persistent: Towards a Unified Solution for Mitigating Shortcuts in Deep Learningcited by 1
- 2024Beyond Full Poisoning: Effective Availability Attacks with Partial Perturbationcited by 1
- 2024Learning from Convolution-based Unlearnable Datasetscited by 1
- 2025Detect & Score: Privacy-Preserving Misbehaviour Detection and Contribution Evaluation in Federated Learningcited by 1
- 2026Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifierscited by 1
- 2024Deferred Poisoning: Making the Model More Vulnerable via Hessian Singularizationcited by 0
- 2025Are Targeted Data Poisoning Attacks as Effective as We Think?cited by 0
- 2025Learning to Generate Cross-Task Unexploitable Examplescited by 0
- 2026UTOPIA: Unlearnable Tabular Data via Decoupled Shortcut Embeddingcited by 0
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipelinecited by 0
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 0
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Eracited by 0
- 2026Leveraging Imperfect Restoration for Data Availability Attackcited by 0
- 2026Leveraging Imperfect Restoration for Data Availability Attack4 Sep 2026
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era6 Aug 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026Full spectrum Unlearnable Examples via Spectral Equalization25 Jun 2026
- 2026LLM Benchmark Datasets Should Be Contamination-Resistant19 May 2026
- 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining5 Mar 2026
- 2026Why Do Unlearnable Examples Work: A Novel Perspective of Mutual Information4 Mar 2026
- 2026UTOPIA: Unlearnable Tabular Data via Decoupled Shortcut Embedding7 Feb 2026
- 2026Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifiers27 Jan 2026
- 2025Learning to Generate Cross-Task Unexploitable Examples15 Dec 2025
- 2025Provable Watermarking for Data Poisoning Attacks10 Oct 2025
33 more
- 2025How Far Are We from True Unlearnability?9 Sep 2025
- 2025Are Targeted Data Poisoning Attacks as Effective as We Think?8 Sep 2025
- 2025T2UE: Generating Unlearnable Examples from Text Descriptions5 Aug 2025
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Tracking10 Jul 2025
- 2025Detect & Score: Privacy-Preserving Misbehaviour Detection and Contribution Evaluation in Federated Learning30 Jun 2025
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learning8 May 2025
- 2024BridgePure: Limited Protection Leakage Can Break Black-Box Data Protection30 Dec 2024
- 2024Towards Operationalizing Right to Data Protection13 Nov 2024
- 2024Deferred Poisoning: Making the Model More Vulnerable via Hessian Singularization6 Nov 2024
- 2024Learning from Convolution-based Unlearnable Datasets4 Nov 2024
- 2024UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation13 Oct 2024
- 2024Unlearnable Examples Detection via Iterative Filtering15 Aug 2024
- 2024Beyond Full Poisoning: Effective Availability Attacks with Partial Perturbation2 Jul 2024
- 2024Toward Availability Attacks in 3D Point Clouds26 Jun 2024
- 2024Semantic Deep Hiding for Robust Unlearnable Examples25 Jun 2024
- 2024ECLIPSE: Expunging Clean-label Indiscriminate Poisons via Sparse Diffusion Purification21 Jun 2024
- 2024Nonlinear Transformations Against Unlearnable Datasets5 Jun 2024
- 2024Provably Unlearnable Data Examples6 May 2024
- 2024Purify Unlearnable Examples via Rate-Constrained Variational Autoencoders2 May 2024
- 2024Disguised Copyright Infringement of Latent Diffusion Models10 Apr 2024
- 2024Finding needles in a haystack: A Black-Box Approach to Invisible Watermark Detection23 Mar 2024
- 2024Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractors20 Feb 2024
- 2024Be Persistent: Towards a Unified Solution for Mitigating Shortcuts in Deep Learning17 Feb 2024
- 2024Efficient Availability Attacks against Supervised and Contrastive Learning Simultaneously6 Feb 2024
- 2023Transferable Availability Poisoning Attacks8 Oct 2023
- 2023APBench: A Unified Benchmark for Availability Poisoning Attacks and Defenses7 Aug 2023
- 2023Unlearnable Examples Give a False Sense of Data Privacy: Understanding and Relearning3 Jun 2023
- 2023What Can We Learn from Unlearnable Datasets?30 May 2023
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attacks27 Mar 2023
- 2023The Devil's Advocate: Shattering the Illusion of Unexploitable Data using Diffusion Models15 Mar 2023
- 2023Exploring the Limits of Model-Targeted Indiscriminate Data Poisoning Attacks7 Mar 2023
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compression31 Jan 2023
- 2022Self-Ensemble Protection: Training Checkpoints Are Good Data Protectors22 Nov 2022
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attackscited by 28
- 2023Exploring the Limits of Model-Targeted Indiscriminate Data Poisoning Attackscited by 23
- 2024Unlearnable Examples Detection via Iterative Filteringcited by 9
- 2024Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractorscited by 8
- 2023Transferable Availability Poisoning Attackscited by 5
- 2025Are Targeted Data Poisoning Attacks as Effective as We Think?cited by 0
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Eracited by 0
- 2026Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era6 Aug 2026
- 2025Are Targeted Data Poisoning Attacks as Effective as We Think?8 Sep 2025
- 2024Unlearnable Examples Detection via Iterative Filtering15 Aug 2024
- 2024Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractors20 Feb 2024
- 2023Transferable Availability Poisoning Attacks8 Oct 2023
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attacks27 Mar 2023
- 2023Exploring the Limits of Model-Targeted Indiscriminate Data Poisoning Attacks7 Mar 2023
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2023What Can We Learn from Unlearnable Datasets?cited by 21
- 2022Self-Ensemble Protection: Training Checkpoints Are Good Data Protectorscited by 19
- 2024Purify Unlearnable Examples via Rate-Constrained Variational Autoencoderscited by 18
- 2024Provably Unlearnable Data Examplescited by 18
- 2024Semantic Deep Hiding for Robust Unlearnable Examplescited by 13
- 2024UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentationcited by 13
- 2024Efficient Availability Attacks against Supervised and Contrastive Learning Simultaneouslycited by 12
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learningcited by 11
- 2024ECLIPSE: Expunging Clean-label Indiscriminate Poisons via Sparse Diffusion Purificationcited by 9
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Trackingcited by 9
- 2023APBench: A Unified Benchmark for Availability Poisoning Attacks and Defensescited by 7
12 most cited of 36 All 36 (JSON)
- 2026Leveraging Imperfect Restoration for Data Availability Attack4 Sep 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026Full spectrum Unlearnable Examples via Spectral Equalization25 Jun 2026
- 2026LLM Benchmark Datasets Should Be Contamination-Resistant19 May 2026
- 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining5 Mar 2026
- 2026Why Do Unlearnable Examples Work: A Novel Perspective of Mutual Information4 Mar 2026
- 2026UTOPIA: Unlearnable Tabular Data via Decoupled Shortcut Embedding7 Feb 2026
- 2026Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifiers27 Jan 2026
- 2025Learning to Generate Cross-Task Unexploitable Examples15 Dec 2025
- 2025Provable Watermarking for Data Poisoning Attacks10 Oct 2025
- 2025How Far Are We from True Unlearnability?9 Sep 2025
12 newest of 36 All 36 (JSON)