DarkneTZ: Towards Model Privacy at the Edge using Trusted Execution Environments
Not on the map. Why?
Abstract (arXiv)
We present DarkneTZ, a framework that uses an edge device's Trusted Execution Environment (TEE) in conjunction with model partitioning to limit the attack surface against Deep Neural Networks (DNNs). Increasingly, edge devices (smartphones and consumer IoT devices) are equipped with pre-trained DNNs for a variety of applications. This trend comes with privacy risks as models can leak information about their training data through effective membership inference attacks (MIAs). We evaluate the performance of DarkneTZ, including CPU execution time, memory usage, and accurate power consumption, using two small and six large image classification models. Due to the limited memory of the edge device's TEE, we partition model layers into more sensitive layers (to be executed inside the device TEE), and a set of layers to be executed in the untrusted part of the operating system. Our results show that even if a single layer is hidden, we can provide reliable model privacy and defend against state of the art MIAs, with only 3% performance overhead. When fully utilizing the TEE, DarkneTZ provides model protections with up to 10% overhead.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 12; 2023: 13; 2024: 11; 2025: 3; 2026: 9.
57 papers.
Sort:
By area:
- 2021PPFL: Privacy-preserving Federated Learning with Trusted Execution Environmentscited by 93
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device MLcited by 21
- 2021It's always personal: Using Early Exits for Efficient On-Device CNN Personalisationcited by 18
- 2021Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputscited by 18
- 2021DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Devicecited by 17
- 2021Stealthy Backdoors as Compression Artifactscited by 17
- 2023FedBone: Towards Large-Scale Federated Multi-Task Learningcited by 14
- 2022DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardwarecited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
38 more
- 2022The Future of Consumer Edge-AI Computingcited by 12
- 2024TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deploymentcited by 11
- 2022Towards Battery-Free Machine Learning and Inference in Underwater Environmentscited by 9
- 2023ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learningcited by 9
- 2023A Survey of Secure Computation Using Trusted Execution Environmentscited by 8
- 2024A First Look At Efficient And Secure On-Device LLM Inference Against KV Leakagecited by 8
- 2024A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentialitycited by 8
- 2023When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protectioncited by 6
- 2022Shielding Federated Learning Systems against Inference Attacks with ARM TrustZonecited by 5
- 2024CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deploymentcited by 5
- 2021Confidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspectivecited by 4
- 2022RL-DistPrivacy: Privacy-Aware Distributed Deep Inference for low latency IoT systemscited by 4
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flowscited by 4
- 2022Edge Security: Challenges and Issuescited by 3
- 2023Privacy Threats in Stable Diffusion Modelscited by 3
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Modelscited by 3
- 2021Quantifying and Localizing Usable Information Leakage from Neural Network Gradientscited by 2
- 2021How to Reach Real-Time AI on Consumer Devices? Solutions for Programmable and Custom Architecturescited by 2
- 2023Mitigating Adversarial Attacks in Federated Learning with Trusted Execution Environmentscited by 2
- 2024TBNet: A Neural Architectural Defense Framework Facilitating DNN Model Protection in Trusted Execution Environmentscited by 2
- 2025SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deploymentcited by 2
- 2022Enhancing the Security & Privacy of Wearable Brain-Computer Interfacescited by 1
- 2023Pelta: Shielding Transformers to Mitigate Evasion Attacks in Federated Learningcited by 1
- 2024Dataset Condensation Driven Machine Unlearningcited by 1
- 2024Towards Secure and Private AI: A Framework for Decentralized Inferencecited by 1
- 2026FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolationcited by 1
- 2021Privacy and Integrity Preserving Training Using Trusted Hardwarecited by 0
- 2022Training privacy-preserving video analytics pipelines by suppressing features that reveal information about private attributescited by 0
- 2022Distributed data analyticscited by 0
- 2022MixNN: A design for protecting deep learning modelscited by 0
- 2023Edge Deep Learning Model Protection via Neuron Authorizationcited by 0
- 2023A Generative Framework for Low-Cost Result Validation of Machine Learning-as-a-Service Inferencecited by 0
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attackcited by 0
- 2024Memory-Efficient and Secure DNN Inference on TrustZone-enabled Consumer IoT Devicescited by 0
- 2024Protecting Confidentiality, Privacy and Integrity in Collaborative Learningcited by 0
- 2025Graph in the Vault: Protecting Edge GNN Inference with Trusted Execution Environmentcited by 0
- 2025DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edgecited by 0
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmapcited by 0
50 most cited of 57 All 57 (JSON)
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026SparSEEty: Extracting Tokens from Sparsity-Exploiting LLM Serving Systems via Deterministic Side Channels4 Aug 2026
- 2026Gecko: Fast Private Inference via Secure Public Encoder Offloading3 Aug 2026
- 2026SoK: Attack and Defense Landscape of Mobile On-device AI Systems1 Jul 2026
- 2026FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation22 Jun 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
- 2026When Agents Handle Secrets: A Survey of Confidential Computing for Agentic AI4 May 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation10 Mar 2026
- 2025SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment22 Oct 2025
- 2025DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge19 Oct 2025
- 2025Graph in the Vault: Protecting Edge GNN Inference with Trusted Execution Environment20 Feb 2025
38 more
- 2024Protecting Confidentiality, Privacy and Integrity in Collaborative Learning11 Dec 2024
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models15 Nov 2024
- 2024CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment16 Oct 2024
- 2024A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality15 Oct 2024
- 2024A First Look At Efficient And Secure On-Device LLM Inference Against KV Leakage6 Sep 2024
- 2024Towards Secure and Private AI: A Framework for Decentralized Inference28 Jul 2024
- 2024TBNet: A Neural Architectural Defense Framework Facilitating DNN Model Protection in Trusted Execution Environments7 May 2024
- 2024TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deployment17 Apr 2024
- 2024Memory-Efficient and Secure DNN Inference on TrustZone-enabled Consumer IoT Devices19 Mar 2024
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack14 Mar 2024
- 2024Dataset Condensation Driven Machine Unlearning31 Jan 2024
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flows5 Dec 2023
- 2023Privacy Threats in Stable Diffusion Models15 Nov 2023
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device ML11 Oct 2023
- 2023ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning8 Oct 2023
- 2023Mitigating Adversarial Attacks in Federated Learning with Trusted Execution Environments13 Sep 2023
- 2023Pelta: Shielding Transformers to Mitigate Evasion Attacks in Federated Learning8 Aug 2023
- 2023When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection7 Aug 2023
- 2023FedBone: Towards Large-Scale Federated Multi-Task Learning30 Jun 2023
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-off25 Jun 2023
- 2023A Generative Framework for Low-Cost Result Validation of Machine Learning-as-a-Service Inference31 Mar 2023
- 2023Edge Deep Learning Model Protection via Neuron Authorization22 Mar 2023
- 2023A Survey of Secure Computation Using Trusted Execution Environments23 Feb 2023
- 2023Recent Advances on Federated Learning: A Systematic Survey3 Jan 2023
- 2022The Future of Consumer Edge-AI Computing19 Oct 2022
- 2022RL-DistPrivacy: Privacy-Aware Distributed Deep Inference for low latency IoT systems27 Aug 2022
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledge22 Aug 2022
- 2022Shielding Federated Learning Systems against Inference Attacks with ARM TrustZone11 Aug 2022
- 2022DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardware30 Jun 2022
- 2022Edge Security: Challenges and Issues14 Jun 2022
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trends16 May 2022
- 2022MixNN: A design for protecting deep learning models28 Mar 2022
- 2022Distributed data analytics26 Mar 2022
- 2022Training privacy-preserving video analytics pipelines by suppressing features that reveal information about private attributes5 Mar 2022
- 2022Towards Battery-Free Machine Learning and Inference in Underwater Environments16 Feb 2022
- 2022Enhancing the Security & Privacy of Wearable Brain-Computer Interfaces19 Jan 2022
- 2021Confidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspective5 Nov 2021
- 2021How to Reach Real-Time AI on Consumer Devices? Solutions for Programmable and Custom Architectures21 Jun 2021
50 newest of 57 All 57 (JSON)
- 2023Privacy Threats in Stable Diffusion Modelscited by 3
- 2023Privacy Threats in Stable Diffusion Models15 Nov 2023
- 2024Dataset Condensation Driven Machine Unlearningcited by 1
- 2024Dataset Condensation Driven Machine Unlearning31 Jan 2024
- 2021PPFL: Privacy-preserving Federated Learning with Trusted Execution Environmentscited by 93
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device MLcited by 21
- 2021It's always personal: Using Early Exits for Efficient On-Device CNN Personalisationcited by 18
- 2021Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputscited by 18
- 2021DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Devicecited by 17
- 2021Stealthy Backdoors as Compression Artifactscited by 17
- 2023FedBone: Towards Large-Scale Federated Multi-Task Learningcited by 14
- 2022DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardwarecited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
12 most cited of 52 All 52 (JSON)
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026Gecko: Fast Private Inference via Secure Public Encoder Offloading3 Aug 2026
- 2026SoK: Attack and Defense Landscape of Mobile On-device AI Systems1 Jul 2026
- 2026FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation22 Jun 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2025SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment22 Oct 2025
- 2025DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge19 Oct 2025
- 2025Graph in the Vault: Protecting Edge GNN Inference with Trusted Execution Environment20 Feb 2025
- 2024Protecting Confidentiality, Privacy and Integrity in Collaborative Learning11 Dec 2024
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models15 Nov 2024
- 2024CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment16 Oct 2024
12 newest of 52 All 52 (JSON)