PRADA: Protecting against DNN Model Stealing Attacks
Not on the map. Why?
Cited by 23 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Machine learning (ML) applications are increasingly prevalent. Protecting the confidentiality of ML models becomes paramount for two reasons: (a) a model can be a business advantage to its owner, and (b) an adversary may use a stolen model to find transferable adversarial examples that can evade classification by the original model. Access to the model can be restricted to be only via well-defined prediction APIs. Nevertheless, prediction APIs still provide enough information to allow an adversary to mount model extraction attacks by sending repeated queries via the prediction API. In this paper, we describe new model extraction attacks using novel approaches for generating synthetic queries, and optimizing training hyperparameters. Our attacks outperform state-of-the-art model extraction in terms of transferability of both targeted and non-targeted adversarial examples (up to +29-44 percentage points, pp), and prediction accuracy (up to +46 pp) on two datasets. We provide take-aways on how to perform effective model extraction attacks. We then propose PRADA, the first step towards generic and effective detection of DNN model extraction attacks. It analyzes the distribution of consecutive API queries and raises an alarm when this distribution deviates from benign behavior. We show that PRADA can detect all prior model extraction attacks with no false positives.
Key facts. Cited by 165 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 31; 2023: 39; 2024: 24; 2025: 24; 2026: 21.
165 papers.
Sort:
By area:
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2023The False Promise of Imitating Proprietary LLMscited by 263
- 2023Protecting Language Generation Models via Invisible Watermarkingcited by 90
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermarkcited by 84
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2023Bag of Tricks for Training Data Extraction from Language Modelscited by 70
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 66
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 46
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
38 more
- 2023Privacy Side Channels in Machine Learning Systemscited by 40
- 2021The Threat of Offensive AI to Organizationscited by 38
- 2021Undistillable: Making A Nasty Teacher That CANNOT teach studentscited by 36
- 2022Dataset Inference for Self-Supervised Modelscited by 36
- 2021MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AIcited by 35
- 2022DualCF: Efficient Model Extraction Attack from Counterfactual Explanationscited by 32
- 2022Distillation-Resistant Watermarking for Model Protection in NLPcited by 30
- 2021Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attackcited by 25
- 2022StolenEncoder: Stealing Pre-trained Encoders in Self-supervised Learningcited by 23
- 2022On the Difficulty of Defending Self-Supervised Learning against Model Extractioncited by 22
- 2022Increasing the Cost of Model Extraction with Calibrated Proof of Workcited by 21
- 2022How to Steer Your Adversary: Targeted and Efficient Model Stealing Defenses with Gradient Redirectioncited by 21
- 2022Machine Learning Security in Industry: A Quantitative Surveycited by 21
- 2022MOVE: Effective and Harmless Ownership Verification via Embedded External Featurescited by 21
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device MLcited by 21
- 2023Model Extraction Attacks Revisitedcited by 21
- 2023False Claims against Model Ownership Resolutioncited by 17
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attackcited by 17
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Surveycited by 16
- 2023GrOVe: Ownership Verification of Graph Neural Networks using Embeddingscited by 16
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governancecited by 14
- 2021AdvParams: An Active DNN Intellectual Property Protection Technique via Adversarial Perturbation Based Parameter Encryptioncited by 13
- 2022Cosine Model Watermarking Against Ensemble Distillationcited by 13
- 2022Conflicting Interactions Among Protection Mechanisms for Machine Learning Modelscited by 12
- 2024WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protectioncited by 12
- 2023Marich: A Query-efficient Distributionally Equivalent Model Extraction Attack using Public Datacited by 11
- 2023Stateful Defenses for Machine Learning Models Are Not Yet Secure Against Black-box Attackscited by 11
- 2021SoK: Machine Learning Governancecited by 10
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipelinecited by 10
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
- 2025CEGA: A Cost-Effective Approach for Graph-Based Model Extraction and Acquisitioncited by 10
- 2022A Survey on XAI for 5G and Beyond Security: Technical Aspects, Challenges and Research Directionscited by 9
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Modelscited by 9
- 2024QUEEN: Query Unlearning against Model Extractioncited by 9
- 2021Model Extraction and Defenses on Generative Adversarial Networkscited by 8
- 2021Stateful Detection of Model Extraction Attackscited by 8
50 most cited of 165 All 165 (JSON)
- 2026The Limits of Query Monitoring against Distributed Model Extraction9 Oct 2026
- 2026Dagger: Decoupling-based Model Stealing Attack against Graph Neural Networks29 Sep 2026
- 2026Retrospective Distillation Attribution via Normalized Response Similarity26 Sep 2026
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Services14 Sep 2026
- 2026SoK: Privacy Attacks on Machine Learning via Explainable AI9 Sep 2026
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Caliber: Cross-Architecture Extraction-Cost Control for Score-Returning APIs2 Aug 2026
- 2026ADS-C: Antidistillation Sampling for Classification16 Jul 2026
- 2026Let Them Steal: Trapping Large Language Model Extraction Attacks with Knowledge Honeypot14 Jun 2026
- 2026T2S: A Rehearsal-Based Approach for Extraction-Resistant Model Watermarking10 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic4 Jun 2026
38 more
- 2026AI Model Extraction Attacks: Bypassing Single-Client Assumptions in Defenses2 Jun 2026
- 2026Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection22 May 2026
- 2026Lossless Anti-Distillation Sampling12 May 2026
- 2026COPYCOP: Ownership Verification for Graph Neural Networks6 May 2026
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings21 Feb 2026
- 2026Connect the Dots: Knowledge Graph-Guided Crawler Attack on Retrieval-Augmented Generation Systems22 Jan 2026
- 2026DiMEx: Breaking the Cold Start Barrier in Data-Free Model Extraction via Latent Diffusion Priors4 Jan 2026
- 2025DivQAT: Enhancing Robustness of Quantized Convolutional Neural Networks against Model Extraction Attacks30 Dec 2025
- 2025Black-Box Behavioral Distillation Breaks Safety Alignment in Medical LLMs10 Dec 2025
- 2025Black-Box Guardrail Reverse-engineering Attack6 Nov 2025
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025I Stolenly Swear That I Am Up to (No) Good: Design and Evaluation of Model Stealing Attacks29 Aug 2025
- 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defenses27 Aug 2025
- 2025Securing AI Systems: A Guide to Known Attacks and Impacts29 Jun 2025
- 2025CEGA: A Cost-Effective Approach for Graph-Based Model Extraction and Acquisition21 Jun 2025
- 2025Benchmarking Misuse Mitigation Against Covert Adversaries6 Jun 2025
- 2025BESA: Boosting Encoder Stealing Attack with Perturbation Recovery5 Jun 2025
- 2025MISLEADER: Defending against Model Extraction with Ensembles of Distilled Models3 Jun 2025
- 2025RADEP: A Resilient Adaptive Defense Framework Against Model Extraction Attacks25 May 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025StyleRec: A Benchmark Dataset for Prompt Recovery in Writing Style Transformation6 Apr 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025Model-Guardian: Protecting against Data-Free Model Stealing Using Gradient Representations and Deceptive Predictions23 Mar 2025
- 2025D-ADD: An Effective Plug-In for Defending Against Model Stealing16 Mar 2025
- 2025Attackers Can Do Better: Over- and Understated Factors of Model Stealing Attacks8 Mar 2025
- 2025ADAGE: Active Defenses Against GNN Extraction27 Feb 2025
- 2025A Survey of Model Extraction Attacks and Defenses in Distributed Computing Environments22 Feb 2025
- 2025Model Privacy: A Unified Framework for Understanding Model Stealing Attacks and Defenses21 Feb 2025
- 2025Neural Honeytrace: Plug&Play Watermarking Framework against Model Extraction Attacks16 Jan 2025
- 2025HoneypotNet: Backdoor Attacks Against Model Extraction2 Jan 2025
- 2024SoK: Blockchain-Based Decentralized AI (DeAI)26 Nov 2024
- 2024SoK: A Systems Perspective on Compound AI Threats and Countermeasures20 Nov 2024
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models15 Nov 2024
- 2024Privacy-Preserving Verifiable Neural Network Inference Service12 Nov 2024
- 2024TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems11 Nov 2024
50 newest of 165 All 165 (JSON)
- 2023Protecting Language Generation Models via Invisible Watermarkingcited by 90
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermarkcited by 84
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
- 2022Distillation-Resistant Watermarking for Model Protection in NLPcited by 30
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attackcited by 17
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Surveycited by 16
- 2021AdvParams: An Active DNN Intellectual Property Protection Technique via Adversarial Perturbation Based Parameter Encryptioncited by 13
- 2022Cosine Model Watermarking Against Ensemble Distillationcited by 13
- 2024QUEEN: Query Unlearning against Model Extractioncited by 9
- 2024ModelShield: Adaptive and Robust Watermark against Model Extraction Attackcited by 7
- 2023A Red Teaming Framework for Securing AI in Maritime Autonomous Systemscited by 3
- 2022Defend Data Poisoning Attacks on Voice Authenticationcited by 2
12 most cited of 22 All 22 (JSON)
- 2026T2S: A Rehearsal-Based Approach for Extraction-Resistant Model Watermarking10 Jun 2026
- 2026Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection22 May 2026
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings21 Feb 2026
- 2025Black-Box Guardrail Reverse-engineering Attack6 Nov 2025
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025RADEP: A Resilient Adaptive Defense Framework Against Model Extraction Attacks25 May 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025Neural Honeytrace: Plug&Play Watermarking Framework against Model Extraction Attacks16 Jan 2025
- 2024QUEEN: Query Unlearning against Model Extraction1 Jul 2024
- 2024ModelShield: Adaptive and Robust Watermark against Model Extraction Attack3 May 2024
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attack26 Jan 2024
12 newest of 22 All 22 (JSON)
- 2023Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generationcited by 2
- 2026DiMEx: Breaking the Cold Start Barrier in Data-Free Model Extraction via Latent Diffusion Priorscited by 0
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Servicescited by 0
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Services14 Sep 2026
- 2026DiMEx: Breaking the Cold Start Barrier in Data-Free Model Extraction via Latent Diffusion Priors4 Jan 2026
- 2023Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation29 Sep 2023
- 2026ADS-C: Antidistillation Sampling for Classification16 Jul 2026
- 2022Distilling the Undistillable: Learning from a Nasty Teacher21 Oct 2022
- 2021Undistillable: Making A Nasty Teacher That CANNOT teach students16 May 2021
- 2023The False Promise of Imitating Proprietary LLMscited by 263
- 2023The False Promise of Imitating Proprietary LLMs25 May 2023
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2023Bag of Tricks for Training Data Extraction from Language Modelscited by 70
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 66
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 46
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2023Privacy Side Channels in Machine Learning Systemscited by 40
- 2021The Threat of Offensive AI to Organizationscited by 38
- 2022Dataset Inference for Self-Supervised Modelscited by 36
- 2021MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AIcited by 35
12 most cited of 132 All 132 (JSON)
- 2026The Limits of Query Monitoring against Distributed Model Extraction9 Oct 2026
- 2026Dagger: Decoupling-based Model Stealing Attack against Graph Neural Networks29 Sep 2026
- 2026SoK: Privacy Attacks on Machine Learning via Explainable AI9 Sep 2026
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Caliber: Cross-Architecture Extraction-Cost Control for Score-Returning APIs2 Aug 2026
- 2026Let Them Steal: Trapping Large Language Model Extraction Attacks with Knowledge Honeypot14 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic4 Jun 2026
- 2026AI Model Extraction Attacks: Bypassing Single-Client Assumptions in Defenses2 Jun 2026
- 2026Lossless Anti-Distillation Sampling12 May 2026
- 2026COPYCOP: Ownership Verification for Graph Neural Networks6 May 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
12 newest of 132 All 132 (JSON)