Stealing Neural Networks via Timing Side Channels
Not on the map. Why?
Abstract (arXiv)
Deep learning is gaining importance in many applications. However, Neural Networks face several security and privacy threats. This is particularly significant in the scenario where Cloud infrastructures deploy a service with Neural Network model at the back end. Here, an adversary can extract the Neural Network parameters, infer the regularization hyperparameter, identify if a data point was part of the training data, and generate effective transferable adversarial examples to evade classifiers. This paper shows how a Neural Network model is susceptible to timing side channel attack. In this paper, a black box Neural Network extraction attack is proposed by exploiting the timing side channels to infer the depth of the network. Although, constructing an equivalent architecture is a complex search problem, it is shown how Reinforcement Learning with knowledge distillation can effectively reduce the search space to infer a target model. The proposed approach has been tested with VGG architectures on CIFAR10 data set. It is observed that it is possible to reconstruct substitute models with test accuracy close to the target models and the proposed approach is scalable and independent of type of Neural Network architectures.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 6; 2024: 9; 2025: 6; 2026: 5.
43 papers.
Sort:
By area:
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 46
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 41
- 2023Privacy Side Channels in Machine Learning Systemscited by 40
- 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistantscited by 26
- 2025Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inferencecited by 18
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attackcited by 17
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2022Learning to Reverse DNNs from AI Programs Automaticallycited by 12
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2022SSL-WM: A Black-Box Watermarking Approach for Encoders Pre-trained by Self-supervised Learningcited by 9
31 more
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Modelscited by 9
- 2021Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channelcited by 8
- 2022Decompiling x86 Deep Neural Network Executablescited by 7
- 2021Confidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspectivecited by 4
- 2022The Security of Deep Learning Defences for Medical Imagingcited by 4
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directionscited by 4
- 2023Beyond Labeling Oracles: What does it mean to steal ML models?cited by 4
- 2021Ownership Verification of DNN Architectures via Hardware Cache Side Channelscited by 3
- 2021Good Artists Copy, Great Artists Steal: Model Extraction Attacks Against Image Translation Modelscited by 3
- 2024A Survey on Offensive AI Within Cybersecuritycited by 3
- 2022PINCH: An Adversarial Extraction Attack Framework for Deep Learning Modelscited by 2
- 2022Unintended Memorization and Timing Attacks in Named Entity Recognition Modelscited by 2
- 2023Like an Open Book? Read Neural Network Architecture with Simple Power Analysis on 32-bit Microcontrollerscited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2025Examining the Threat Landscape: Foundation Models and Model Stealingcited by 2
- 2025Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channelscited by 2
- 2025Stealing AI Model Weights Through Covert Communication Channelscited by 2
- 2026Steal the Patch Size: Adversarially Manipulate Vision-Language Modelscited by 2
- 2021Power-Based Attacks on Spatial DNN Acceleratorscited by 1
- 2023The Adversarial Implications of Variable-Time Inferencecited by 1
- 2024SoK: A Systems Perspective on Compound AI Threats and Countermeasurescited by 1
- 2022Securing AI-based Healthcare Systems using Blockchain Technology: A State-of-the-Art Systematic Literature Review and Future Research Directionscited by 0
- 2022On the Evaluation of User Privacy in Deep Neural Networks using Timing Side Channelcited by 0
- 2023On the Adversarial Inversion of Deep Biometric Representationscited by 0
- 2024Stealing the Invisible: Unveiling Pre-Trained CNN Models through Adversarial Examples and Timing Side-Channelscited by 0
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distributioncited by 0
- 2025I Stolenly Swear That I Am Up to (No) Good: Design and Evaluation of Model Stealing Attackscited by 0
- 2026ALDEN: Boosting Private Data Extraction from Retrieval-Augmented Generation Systems via Active Learning and Distribution Estimationcited by 0
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Accesscited by 0
- 2026Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timingcited by 0
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocolscited by 0
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timing22 Jul 2026
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Access1 Jul 2026
- 2026Steal the Patch Size: Adversarially Manipulate Vision-Language Models30 Jun 2026
- 2026ALDEN: Boosting Private Data Extraction from Retrieval-Augmented Generation Systems via Active Learning and Distribution Estimation10 Apr 2026
- 2025Stealing AI Model Weights Through Covert Communication Channels30 Sep 2025
- 2025I Stolenly Swear That I Am Up to (No) Good: Design and Evaluation of Model Stealing Attacks29 Aug 2025
- 2025Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference11 Aug 2025
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distribution28 Jul 2025
- 2025Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels24 Mar 2025
- 2025Examining the Threat Landscape: Foundation Models and Model Stealing25 Feb 2025
- 2024SoK: A Systems Perspective on Compound AI Threats and Countermeasures20 Nov 2024
31 more
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024A Survey on Offensive AI Within Cybersecurity26 Sep 2024
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)20 Jul 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistants14 Mar 2024
- 2024Stealing the Invisible: Unveiling Pre-Trained CNN Models through Adversarial Examples and Timing Side-Channels19 Feb 2024
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attack26 Jan 2024
- 2023Like an Open Book? Read Neural Network Architecture with Simple Power Analysis on 32-bit Microcontrollers2 Nov 2023
- 2023Beyond Labeling Oracles: What does it mean to steal ML models?3 Oct 2023
- 2023Privacy Side Channels in Machine Learning Systems11 Sep 2023
- 2023The Adversarial Implications of Variable-Time Inference5 Sep 2023
- 2023On the Adversarial Inversion of Deep Biometric Representations12 Apr 2023
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Models4 Feb 2023
- 2022Unintended Memorization and Timing Attacks in Named Entity Recognition Models4 Nov 2022
- 2022Decompiling x86 Deep Neural Network Executables3 Oct 2022
- 2022PINCH: An Adversarial Extraction Attack Framework for Deep Learning Models13 Sep 2022
- 2022Privacy of Autonomous Vehicles: Risks, Protection Methods, and Future Directions8 Sep 2022
- 2022SSL-WM: A Black-Box Watermarking Approach for Encoders Pre-trained by Self-supervised Learning8 Sep 2022
- 2022On the Evaluation of User Privacy in Deep Neural Networks using Timing Side Channel1 Aug 2022
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defences16 Jun 2022
- 2022Securing AI-based Healthcare Systems using Blockchain Technology: A State-of-the-Art Systematic Literature Review and Future Research Directions30 May 2022
- 2022Learning to Reverse DNNs from AI Programs Automatically20 May 2022
- 2022The Security of Deep Learning Defences for Medical Imaging21 Jan 2022
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memories8 Nov 2021
- 2021Confidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspective5 Nov 2021
- 2021Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channel15 Sep 2021
- 2021Power-Based Attacks on Spatial DNN Accelerators28 Aug 2021
- 2021Good Artists Copy, Great Artists Steal: Model Extraction Attacks Against Image Translation Models26 Apr 2021
- 2021Ownership Verification of DNN Architectures via Hardware Cache Side Channels6 Feb 2021
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Ahead4 Jan 2021
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 46
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attackcited by 17
- 2021Ownership Verification of DNN Architectures via Hardware Cache Side Channelscited by 3
- 2022Unintended Memorization and Timing Attacks in Named Entity Recognition Modelscited by 2
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distributioncited by 0
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distribution28 Jul 2025
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)20 Jul 2024
- 2024MEA-Defender: A Robust Watermark against Model Extraction Attack26 Jan 2024
- 2022Unintended Memorization and Timing Attacks in Named Entity Recognition Models4 Nov 2022
- 2021Ownership Verification of DNN Architectures via Hardware Cache Side Channels6 Feb 2021
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 41
- 2023Privacy Side Channels in Machine Learning Systemscited by 40
- 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistantscited by 26
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2022Learning to Reverse DNNs from AI Programs Automaticallycited by 12
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2022SSL-WM: A Black-Box Watermarking Approach for Encoders Pre-trained by Self-supervised Learningcited by 9
- 2023AUTOLYCUS: Exploiting Explainable AI (XAI) for Model Extraction Attacks against Interpretable Modelscited by 9
- 2021Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channelcited by 8
- 2022Decompiling x86 Deep Neural Network Executablescited by 7
12 most cited of 34 All 34 (JSON)
- 2026JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols27 Aug 2026
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Access1 Jul 2026
- 2025Stealing AI Model Weights Through Covert Communication Channels30 Sep 2025
- 2025I Stolenly Swear That I Am Up to (No) Good: Design and Evaluation of Model Stealing Attacks29 Aug 2025
- 2025Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels24 Mar 2025
- 2025Examining the Threat Landscape: Foundation Models and Model Stealing25 Feb 2025
- 2024SoK: A Systems Perspective on Compound AI Threats and Countermeasures20 Nov 2024
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024A Survey on Offensive AI Within Cybersecurity26 Sep 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistants14 Mar 2024
12 newest of 34 All 34 (JSON)