Exploring Connections Between Active Learning and Model Extraction
Not on the map. Why?
Abstract (arXiv)
Machine learning is being increasingly used by individuals, research institutions, and corporations. This has resulted in the surge of Machine Learning-as-a-Service (MLaaS) - cloud services that provide (a) tools and resources to learn the model, and (b) a user-friendly query interface to access the model. However, such MLaaS systems raise privacy concerns such as model extraction. In model extraction attacks, adversaries maliciously exploit the query interface to steal the model. More precisely, in a model extraction attack, a good approximation of a sensitive or proprietary model held by the server is extracted (i.e. learned) by a dishonest user who interacts with the server only via the query interface. This attack was introduced by Tramer et al. at the 2016 USENIX Security Symposium, where practical attacks for various models were shown. We believe that better understanding the efficacy of model extraction attacks is paramount to designing secure MLaaS systems. To that end, we take the first step by (a) formalizing model extraction and discussing possible defense strategies, and (b) drawing parallels between model extraction and established area of active learning. In particular, we show that recent advancements in the active learning domain can be used to implement powerful model extraction attacks, and investigate possible defense strategies.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 21; 2023: 17; 2024: 11; 2025: 9; 2026: 10.
85 papers.
Sort:
By area:
- 2021Dataset Inference: Ownership Resolution in Machine Learningcited by 116
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2022Towards Data-Free Model Stealing in a Hard Label Settingcited by 58
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practicecited by 56
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 55
- 2021Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!cited by 53
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 46
- 2022SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoderscited by 45
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
38 more
- 2021MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AIcited by 35
- 2022StolenEncoder: Stealing Pre-trained Encoders in Self-supervised Learningcited by 23
- 2022Increasing the Cost of Model Extraction with Calibrated Proof of Workcited by 21
- 2022MOVE: Effective and Harmless Ownership Verification via Embedded External Featurescited by 21
- 2023Model Extraction Attacks Revisitedcited by 21
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splattingcited by 18
- 2022SoK: The Impact of Unlabelled Data in Cyberthreat Detectioncited by 15
- 2024WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protectioncited by 12
- 2023Marich: A Query-efficient Distributionally Equivalent Model Extraction Attack using Public Datacited by 11
- 2023Watermarking Vision-Language Pre-trained Models for Multi-modal Embedding as a Servicecited by 11
- 2021SoK: Machine Learning Governancecited by 10
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipelinecited by 10
- 2021Hitting the Target: Stopping Active Learning at the Cost-Based Optimumcited by 9
- 2022ImpNet: Imperceptible and blackbox-undetectable backdoors in compiled neural networkscited by 9
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Modelscited by 9
- 2021Model Extraction and Defenses on Generative Adversarial Networkscited by 8
- 2021GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborationscited by 8
- 2026On Protecting Agentic Systems' Intellectual Property via Watermarkingcited by 8
- 2021Evaluating the Cybersecurity Risk of Real World, Machine Learning Production Systemscited by 6
- 202110 Security and Privacy Problems in Large Foundation Modelscited by 6
- 2023MeaeQ: Mount Model Extraction Attacks with Efficient Queriescited by 6
- 2023Army of Thieves: Enhancing Black-Box Model Extraction via Ensemble based sample selectioncited by 6
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidencecited by 5
- 2023Fault Injection and Safe-Error Attack for Extraction of Embedded Neural Network Modelscited by 5
- 2022AWEncoder: Adversarial Watermarking Pre-trained Encoders in Contrastive Learningcited by 4
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directionscited by 4
- 2023Beyond Labeling Oracles: What does it mean to steal ML models?cited by 4
- 2023SAME: Sample Reconstruction against Model Extraction Attackscited by 4
- 2024Efficient and Effective Model Extractioncited by 4
- 2025GRID: Protecting Training Graph from Link Stealing Attacks on GNN Modelscited by 4
- 2025RegionMarker: A Region-Triggered Semantic Watermarking Framework for Embedding-as-a-Service Copyright Protectioncited by 4
- 2021HODA: Hardness-Oriented Detection of Model Extraction Attackscited by 3
- 2022Adversarial Machine Learning Threat Analysis and Remediation in Open Radio Access Network (O-RAN)cited by 3
- 2023Active Cost-aware Labeling of Streaming Datacited by 3
- 2023FDINet: Protecting against DNN Model Extraction via Feature Distortion Indexcited by 3
- 2023The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learningcited by 3
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Modelscited by 3
- 2026An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Trafficcited by 3
50 most cited of 85 All 85 (JSON)
- 2026Information Design Against Gaming and Learning Adversaries12 Sep 2026
- 2026Let Them Steal: Trapping Large Language Model Extraction Attacks with Knowledge Honeypot14 Jun 2026
- 2026An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic4 Jun 2026
- 2026TrEEStealer: Stealing Decision Trees via Enclave Side Channels20 Apr 2026
- 2026ALDEN: Boosting Private Data Extraction from Retrieval-Augmented Generation Systems via Active Learning and Distribution Estimation10 Apr 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026Linear Model Extraction via Factual and Counterfactual Queries10 Feb 2026
- 2026Benchmarking Knowledge-Extraction Attack and Defense on Retrieval-Augmented Generation10 Feb 2026
- 2026On Protecting Agentic Systems' Intellectual Property via Watermarking9 Feb 2026
- 2026DiMEx: Breaking the Cold Start Barrier in Data-Free Model Extraction via Latent Diffusion Priors4 Jan 2026
- 2025RegionMarker: A Region-Triggered Semantic Watermarking Framework for Embedding-as-a-Service Copyright Protection17 Nov 2025
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
38 more
- 2025Holmes: Towards Effective and Harmless Model Ownership Verification to Personalized Large Vision Models via Decoupling Common Features24 Jun 2025
- 2025Attackers Can Do Better: Over- and Understated Factors of Model Stealing Attacks8 Mar 2025
- 2025Models That Are Interpretable But Not Transparent26 Feb 2025
- 2025Model Privacy: A Unified Framework for Understanding Model Stealing Attacks and Defenses21 Feb 2025
- 2025Reformulation is All You Need: Addressing Malicious Text Features in DNNs2 Feb 2025
- 2025GRID: Protecting Training Graph from Link Stealing Attacks on GNN Models19 Jan 2025
- 2025Neural Honeytrace: Plug&Play Watermarking Framework against Model Extraction Attacks16 Jan 2025
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models15 Nov 2024
- 2024Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermark14 Nov 2024
- 2024Privacy-Preserving Verifiable Neural Network Inference Service12 Nov 2024
- 2024DeepCore: Simple Fingerprint Construction for Differentiating Homologous and Piracy Models1 Nov 2024
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splatting10 Oct 2024
- 2024Efficient and Effective Model Extraction21 Sep 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024Watermarking Counterfactual Explanations29 May 2024
- 2024Deep Privacy Funnel Model: From a Discriminative to a Generative Approach with an Application to Face Recognition3 Apr 2024
- 2024WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection3 Mar 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2023SAME: Sample Reconstruction against Model Extraction Attacks17 Dec 2023
- 2023Model Extraction Attacks Revisited8 Dec 2023
- 2023Watermarking Vision-Language Pre-trained Models for Multi-modal Embedding as a Service10 Nov 2023
- 2023Army of Thieves: Enhancing Black-Box Model Extraction via Ensemble based sample selection8 Nov 2023
- 2023MeaeQ: Mount Model Extraction Attacks with Efficient Queries21 Oct 2023
- 2023Beyond Labeling Oracles: What does it mean to steal ML models?3 Oct 2023
- 2023Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation29 Sep 2023
- 2023Fault Injection and Safe-Error Attack for Extraction of Embedded Neural Network Models31 Aug 2023
- 2023The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learning31 Aug 2023
- 2023Data-Free Model Extraction Attacks in the Context of Object Detection9 Aug 2023
- 2023Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems3 Jul 2023
- 2023FDINet: Protecting against DNN Model Extraction via Feature Distortion Index20 Jun 2023
- 2023Active Cost-aware Labeling of Streaming Data13 Apr 2023
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidence10 Apr 2023
- 2023Decision-BADGE: Decision-based Adversarial Batch Attack with Directional Gradient Estimation9 Mar 2023
- 2023Marich: A Query-efficient Distributionally Equivalent Model Extraction Attack using Public Data16 Feb 2023
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Models4 Feb 2023
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practice29 Dec 2022
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipeline11 Dec 2022
- 2022ImpNet: Imperceptible and blackbox-undetectable backdoors in compiled neural networks30 Sep 2022
50 newest of 85 All 85 (JSON)
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2022Towards Data-Free Model Stealing in a Hard Label Settingcited by 58
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practicecited by 56
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 55
- 2021Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!cited by 53
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 46
- 2022SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoderscited by 45
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
- 2021MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AIcited by 35
12 most cited of 76 All 76 (JSON)
- 2026Information Design Against Gaming and Learning Adversaries12 Sep 2026
- 2026Let Them Steal: Trapping Large Language Model Extraction Attacks with Knowledge Honeypot14 Jun 2026
- 2026An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic4 Jun 2026
- 2026TrEEStealer: Stealing Decision Trees via Enclave Side Channels20 Apr 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026Linear Model Extraction via Factual and Counterfactual Queries10 Feb 2026
- 2025RegionMarker: A Region-Triggered Semantic Watermarking Framework for Embedding-as-a-Service Copyright Protection17 Nov 2025
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
- 2025Holmes: Towards Effective and Harmless Model Ownership Verification to Personalized Large Vision Models via Decoupling Common Features24 Jun 2025
- 2025Attackers Can Do Better: Over- and Understated Factors of Model Stealing Attacks8 Mar 2025
- 2025Models That Are Interpretable But Not Transparent26 Feb 2025
- 2025Model Privacy: A Unified Framework for Understanding Model Stealing Attacks and Defenses21 Feb 2025
12 newest of 76 All 76 (JSON)