Stealing Hyperparameters in Machine Learning
Not on the map. Why?
Cited by 25 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Hyperparameters are critical in machine learning, as different hyperparameters often result in models with significantly different performance. Hyperparameters may be deemed confidential because of their commercial value and the confidentiality of the proprietary algorithms that the learner uses to learn them. In this work, we propose attacks on stealing the hyperparameters that are learned by a learner. We call our attacks hyperparameter stealing attacks. Our attacks are applicable to a variety of popular machine learning algorithms such as ridge regression, logistic regression, support vector machine, and neural network. We evaluate the effectiveness of our attacks both theoretically and empirically. For instance, we evaluate our attacks on Amazon Machine Learning. Our results demonstrate that our attacks can accurately steal hyperparameters. We also study countermeasures. Our results highlight the need for new defenses against our hyperparameter stealing attacks for certain machine learning algorithms.
Key facts. Cited by 115 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 21; 2023: 22; 2024: 16; 2025: 13; 2026: 7.
115 papers.
Sort:
By area:
- 2021Membership Inference Attacks From First Principlescited by 839
- 2022Reconstructing Training Data from Trained Neural Networkscited by 129
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 113
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2021ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Modelscited by 79
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2021Practical Blind Membership Inference Attack via Differential Comparisonscited by 73
- 2021EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learningcited by 68
- 2021Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble Architecturecited by 63
- 2021Property Inference From Poisoningcited by 56
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
38 more
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Formalizing and Estimating Distribution Inference Riskscited by 42
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
- 2021The Threat of Offensive AI to Organizationscited by 37
- 2021Quantifying and Mitigating Privacy Risks of Contrastive Learningcited by 35
- 2023A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutionscited by 34
- 2021Property Inference Attacks Against GANscited by 32
- 2022Can't Steal? Cont-Steal! Contrastive Stealing Attacks Against Image Encoderscited by 30
- 2021Practical Defences Against Model Inversion Attacks for Split Neural Networkscited by 29
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applicationscited by 22
- 2022StolenEncoder: Stealing Pre-trained Encoders in Self-supervised Learningcited by 21
- 2023Model Extraction Attacks Revisitedcited by 21
- 2023Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscationcited by 20
- 2021Property Inference Attacks on Convolutional Neural Networks: Influence and Implications of Target Model's Complexitycited by 19
- 2021"Adversarial Examples" for Proof-of-Learningcited by 19
- 2023Stealing the Decoding Algorithms of Language Modelscited by 19
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2021Membership Inference Attacks are Easier on Difficult Problemscited by 16
- 2021Teacher Model Fingerprinting Attacks Against Transfer Learningcited by 15
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Surveycited by 15
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challengescited by 14
- 2021Get a Model! Model Hijacking Attack Against Machine Learning Modelscited by 13
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscapecited by 13
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governancecited by 12
- 2021Membership Inference Attacks on Knowledge Graphscited by 11
- 2022Federated Learning Attacks and Defenses: A Surveycited by 11
- 2021Dompteur: Taming Audio Adversarial Examplescited by 10
- 2022Semi-Leak: Membership Inference Attacks Against Semi-supervised Learningcited by 10
- 2023Blockchain-based Federated Learning with Secure Aggregation in Trusted Execution Environment for Internet-of-Thingscited by 10
- 2023Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attackscited by 10
- 2021Towards a Robust and Trustworthy Machine Learning System Development: An Engineering Perspectivecited by 9
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Modelscited by 9
- 2024Model Stealing for Any Low-Rank Language Modelcited by 9
- 2021Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channelcited by 8
- 2025Fingerprinting LLMs via Prompt Injectioncited by 8
- 2021Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIscited by 7
50 most cited of 115 All 115 (JSON)
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Defending against Model Extraction for GNNs with Model Reprogramming11 Aug 2026
- 2026Steal the Patch Size: Adversarially Manipulate Vision-Language Models30 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Enabling Adversarial Robustness in AI Models through Kubeflow MLOps14 May 2026
- 2026Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions8 Mar 2026
- 2026CREDIT: Certified Ownership Verification of Deep Neural Networks Against Model Extraction Attacks23 Feb 2026
- 2025Black-Box Behavioral Distillation Breaks Safety Alignment in Medical LLMs10 Dec 2025
- 2025An Invariant Latent Space Perspective on Language Model Inversion24 Nov 2025
- 2025Black-Box Guardrail Reverse-engineering Attack6 Nov 2025
- 2025Fingerprinting LLMs via Prompt Injection29 Sep 2025
- 2025Securing AI Systems: A Guide to Known Attacks and Impacts29 Jun 2025
38 more
- 2025Differentiation-Based Extraction of Proprietary Data from Fine-Tuned LLMs20 Jun 2025
- 2025Stealix: Model Stealing via Prompt Evolution6 Jun 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025TAPE: Tailored Posterior Difference for Auditing of Machine Unlearning27 Feb 2025
- 2025A Survey of Model Extraction Attacks and Defenses in Distributed Computing Environments22 Feb 2025
- 2025Model Privacy: A Unified Framework for Understanding Model Stealing Attacks and Defenses21 Feb 2025
- 2025Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment4 Feb 2025
- 2025GRID: Protecting Training Graph from Link Stealing Attacks on GNN Models19 Jan 2025
- 2024Model Stealing for Any Low-Rank Language Model12 Nov 2024
- 2024Privacy-Preserving Verifiable Neural Network Inference Service12 Nov 2024
- 2024Towards Understanding and Enhancing Security of Proof-of-Training for DNN Model Ownership Verification6 Oct 2024
- 2024Subject Data Auditing via Source Inference Attack in Cross-Silo Federated Learning28 Sep 2024
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends22 Sep 2024
- 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learning29 Aug 2024
- 2024Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services5 Aug 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024Efficient Model-Stealing Attacks Against Inductive Graph Neural Networks20 May 2024
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applications10 May 2024
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscape6 May 2024
- 2024Proteus: Preserving Model Confidentiality during Graph Optimizations18 Apr 2024
- 2024Deep Privacy Funnel Model: From a Discriminative to a Generative Approach with an Application to Face Recognition3 Apr 2024
- 2024On the Impact of Uncertainty and Calibration on Likelihood-Ratio Membership Inference Attacks16 Feb 2024
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance2 Feb 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2023GanFinger: GAN-Based Fingerprint Generation for Deep Neural Network Ownership Verification25 Dec 2023
- 2023Model Stealing Attack against Recommender System18 Dec 2023
- 2023Model Stealing Attack against Graph Classification with Authenticity, Uncertainty and Diversity18 Dec 2023
- 2023Model Extraction Attacks Revisited8 Dec 2023
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Models19 Oct 2023
- 2023A Comprehensive Study of Privacy Risks in Curriculum Learning16 Oct 2023
- 2023Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation29 Sep 2023
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges14 Sep 2023
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applications31 Aug 2023
- 2023Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attacks2 Aug 2023
- 2023DREAM: Domain-free Reverse Engineering Attributes of Black-box Model20 Jul 2023
- 2023A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions25 May 2023
- 2023Finding Meaningful Distributions of ML Black-boxes under Forensic Investigation10 May 2023
- 2023Blockchain-based Federated Learning with Secure Aggregation in Trusted Execution Environment for Internet-of-Things25 Apr 2023
50 newest of 115 All 115 (JSON)
- 2021Membership Inference Attacks From First Principlescited by 839
- 2021ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Modelscited by 79
- 2021Practical Blind Membership Inference Attack via Differential Comparisonscited by 73
- 2021EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learningcited by 68
- 2021Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble Architecturecited by 63
- 2021Quantifying and Mitigating Privacy Risks of Contrastive Learningcited by 35
- 2021Property Inference Attacks Against GANscited by 32
- 2023Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscationcited by 20
- 2021Membership Inference Attacks are Easier on Difficult Problemscited by 16
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Surveycited by 15
- 2021Membership Inference Attacks on Knowledge Graphscited by 11
- 2022Semi-Leak: Membership Inference Attacks Against Semi-supervised Learningcited by 10
12 most cited of 24 All 24 (JSON)
- 2026Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions8 Mar 2026
- 2025Black-Box Guardrail Reverse-engineering Attack6 Nov 2025
- 2025Fingerprinting LLMs via Prompt Injection29 Sep 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025TAPE: Tailored Posterior Difference for Auditing of Machine Unlearning27 Feb 2025
- 2024On the Impact of Uncertainty and Calibration on Likelihood-Ratio Membership Inference Attacks16 Feb 2024
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Models19 Oct 2023
- 2023Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscation17 Mar 2023
- 2022Pre-trained Encoders in Self-Supervised Learning Improve Secure and Privacy-preserving Supervised Learning6 Dec 2022
- 2022On the Vulnerability of Data Points under Multiple Membership Inference Attacks and Target Models28 Oct 2022
- 2022Privacy Attacks Against Biometric Models with Fewer Samples: Incorporating the Output of Multiple Models22 Sep 2022
- 2022Semi-Leak: Membership Inference Attacks Against Semi-supervised Learning25 Jul 2022
12 newest of 24 All 24 (JSON)
- 2022Reconstructing Training Data from Trained Neural Networkscited by 129
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 113
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2021Property Inference From Poisoningcited by 56
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Formalizing and Estimating Distribution Inference Riskscited by 42
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
- 2021The Threat of Offensive AI to Organizationscited by 37
12 most cited of 87 All 87 (JSON)
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Defending against Model Extraction for GNNs with Model Reprogramming11 Aug 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Enabling Adversarial Robustness in AI Models through Kubeflow MLOps14 May 2026
- 2026CREDIT: Certified Ownership Verification of Deep Neural Networks Against Model Extraction Attacks23 Feb 2026
- 2025An Invariant Latent Space Perspective on Language Model Inversion24 Nov 2025
- 2025Securing AI Systems: A Guide to Known Attacks and Impacts29 Jun 2025
- 2025Stealix: Model Stealing via Prompt Evolution6 Jun 2025
- 2025A Survey of Model Extraction Attacks and Defenses in Distributed Computing Environments22 Feb 2025
- 2025Model Privacy: A Unified Framework for Understanding Model Stealing Attacks and Defenses21 Feb 2025
- 2025Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment4 Feb 2025
- 2025GRID: Protecting Training Graph from Link Stealing Attacks on GNN Models19 Jan 2025
12 newest of 87 All 87 (JSON)