Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted Hardware
Not on the map. Why?
Abstract (arXiv)
As Machine Learning (ML) gets applied to security-critical or sensitive domains, there is a growing need for integrity and privacy for outsourced ML computations. A pragmatic solution comes from Trusted Execution Environments (TEEs), which use hardware and software protections to isolate sensitive computations from the untrusted software stack. However, these isolation guarantees come at a price in performance, compared to untrusted alternatives. This paper initiates the study of high performance execution of Deep Neural Networks (DNNs) in TEEs by efficiently partitioning DNN computations between trusted and untrusted devices. Building upon an efficient outsourcing scheme for matrix multiplication, we propose Slalom, a framework that securely delegates execution of all linear layers in a DNN from a TEE (e.g., Intel SGX or Sanctum) to a faster, yet untrusted, co-located processor. We evaluate Slalom by running DNNs in an Intel SGX enclave, which selectively delegates work to an untrusted GPU. For canonical DNNs (VGG16, MobileNet and ResNet variants) we obtain 6x to 20x increases in throughput for verifiable inference, and 4x to 11x for verifiable and private inference.
Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 18; 2023: 12; 2024: 14; 2025: 11; 2026: 21.
101 papers.
Sort:
By area:
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
- 2021PPFL: Privacy-preserving Federated Learning with Trusted Execution Environmentscited by 93
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2022Position: Considerations for Differentially Private Learning with Large-Scale Public Pretrainingcited by 86
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2022Federated Learning Enables Big Data for Rare Cancer Boundary Detectioncited by 83
- 2021Differential Privacy for Text Analytics via Natural Text Sanitizationcited by 74
- 2021Handcrafted Backdoors in Deep Neural Networkscited by 57
- 2021CryptGPU: Fast Privacy-Preserving Machine Learning on the GPUcited by 46
- 2021DeepPayload: Black-box Backdoor Attack on Deep Learning Models through Neural Payload Injectioncited by 42
- 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
38 more
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2022Verifiable and Provably Secure Machine Unlearningcited by 24
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device MLcited by 21
- 2021Defending against Reconstruction Attack in Vertical Federated Learningcited by 20
- 2021Circa: Stochastic ReLUs for Private Deep Learningcited by 16
- 2022Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realizationcited by 16
- 2023GrOVe: Ownership Verification of Graph Neural Networks using Embeddingscited by 16
- 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbotscited by 16
- 2021Citadel: Protecting Data Privacy and Model Confidentiality for Collaborative Learning with SGXcited by 14
- 2021Sisyphus: A Cautionary Tale of Using Low-Degree Polynomial Activations in Privacy-Preserving Deep Learningcited by 14
- 2022DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardwarecited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
- 2021secureTF: A Secure TensorFlow Frameworkcited by 12
- 2023BAFFLE: A Baseline of Backpropagation-Free Federated Learningcited by 12
- 2022Decentralized Stochastic Optimization with Inherent Privacy Protectioncited by 11
- 2024TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deploymentcited by 11
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipelinecited by 10
- 2023Blockchain-based Federated Learning with Secure Aggregation in Trusted Execution Environment for Internet-of-Thingscited by 10
- 2021SoK: Machine Learning Governancecited by 9
- 2022Can Foundation Models Help Us Achieve Perfect Secrecy?cited by 9
- 2021Separation of Powers in Federated Learningcited by 8
- 2023A Survey of Secure Computation Using Trusted Execution Environmentscited by 8
- 2024A Fast, Performant, Secure Distributed Training Framework For Large Language Modelcited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2022TEE-based decentralized recommender systems: The raw data sharing redemptioncited by 6
- 2023Samplable Anonymous Aggregation for Private Federated Data Analysiscited by 6
- 2021Forensicability of Deep Neural Network Inference Pipelinescited by 5
- 2021ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systemscited by 5
- 2022Shielding Federated Learning Systems against Inference Attacks with ARM TrustZonecited by 5
- 2024PristiQ: A Co-Design Framework for Preserving Data Security of Quantum Learning in the Cloudcited by 5
- 2024CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deploymentcited by 5
- 2025Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEscited by 5
- 2021Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learningcited by 4
- 2021Confidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspectivecited by 4
- 2022MPC-Pipe: an Efficient Pipeline Scheme for Secure Multi-party Machine Learning Inferencecited by 4
- 2022GAN-based Domain Inference Attackcited by 4
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flowscited by 4
- 2024Fortify Your Foundations: Practical Privacy and Security for Foundation Model Deployments In The Cloudcited by 4
50 most cited of 101 All 101 (JSON)
- 2026CipherGenome: Homomorphic Inference for Genomic Mixture-of-Experts27 Sep 2026
- 2026GenomeOcean Anywhere: Private WebGPU Inference for Genome MoEs27 Sep 2026
- 2026SpliTEE: Fast and Private LLM Inference by Coupling GPU-Assisted Trusted Execution Environments with Differential Privacy14 Sep 2026
- 2026Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation9 Sep 2026
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026Towards Computational Provenance: Carrying Causal-State Evidence in Generated Text17 Aug 2026
- 2026MOSAIC: Masked Outsourcing of Secure AI Computations31 Jul 2026
- 2026Integrity of peer-to-peer distributed LLM inference under malicious nodes21 Jul 2026
- 2026Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference15 Jun 2026
- 2026The Proxy Knows Too Much: Sealing LLM API Routers with Attested TEEs15 Jun 2026
- 2026Communication-Efficient Verifiable Attention for LLM Inference15 Jun 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
38 more
- 2026Token Inflation: How Dishonest Providers Can Overcharge for Large Language Model Usage28 May 2026
- 2026KBF: Knowledge Boundary as Fingerprint for Language Model and Black-Box API Auditing28 May 2026
- 2026When Agents Handle Secrets: A Survey of Confidential Computing for Agentic AI4 May 2026
- 2026Agentic Witnessing: Pragmatic and Scalable TEE-Enabled Privacy-Preserving Auditing27 Apr 2026
- 2026Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators25 Apr 2026
- 2026Meeting in the Middle: A Co-Design Paradigm for FHE and AI Inference20 Mar 2026
- 2026Proof-of-Guardrail in AI Agents and What (Not) to Trust from It6 Mar 2026
- 2026Towards Privacy-Preserving LLM Inference via Covariant Obfuscation (Technical Report)2 Mar 2026
- 2026Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving9 Feb 2026
- 2025Design and Evaluation of Cost-Aware PoQ for Decentralized LLM Inference18 Dec 2025
- 2025SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment22 Oct 2025
- 2025TAO: Tolerance-Aware Optimistic Verification for Floating-Point Neural Networks15 Oct 2025
- 2025Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs23 Sep 2025
- 2025Dstack: A Zero Trust Framework for Confidential Containers15 Sep 2025
- 2025Towards Confidential and Efficient LLM Inference with Dual Privacy Protection11 Sep 2025
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction6 Aug 2025
- 2025Securing Transformer-based AI Execution via Unified TEEs and Crypto-protected Accelerators4 Jul 2025
- 2025On the Inference (In-)Security of Vertical Federated Learning: Efficient Auditing against Inference Tampering Attack3 Jul 2025
- 2025ZKPROV: A Zero-Knowledge Approach to Dataset Provenance for Large Language Models26 Jun 2025
- 2025Onboard Optimization and Learning: A Survey7 May 2025
- 2024Protecting Confidentiality, Privacy and Integrity in Collaborative Learning11 Dec 2024
- 2024TEESlice: Protecting Sensitive Neural Network Models in Trusted Execution Environments When Attackers have Pre-Trained Models15 Nov 2024
- 2024CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment16 Oct 2024
- 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbots10 Oct 2024
- 2024Fortify Your Foundations: Practical Privacy and Security for Foundation Model Deployments In The Cloud8 Oct 2024
- 2024VeriSplit: Secure and Practical Offloading of Machine Learning Inferences across IoT Devices2 Jun 2024
- 2024LDPKiT: Superimposing Remote Queries for Privacy-Preserving Distillation25 May 2024
- 2024PristiQ: A Co-Design Framework for Preserving Data Security of Quantum Learning in the Cloud20 Apr 2024
- 2024TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deployment17 Apr 2024
- 2024Memory-Efficient and Secure DNN Inference on TrustZone-enabled Consumer IoT Devices19 Mar 2024
- 2024Edge Private Graph Neural Networks with Singular Value Perturbation16 Mar 2024
- 2024Tempo: Confidentiality Preservation in Cloud-Based Neural Network Training21 Jan 2024
- 2024A Fast, Performant, Secure Distributed Training Framework For Large Language Model18 Jan 2024
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security10 Jan 2024
- 2023All Rivers Run to the Sea: Private Learning with Asymmetric Flows5 Dec 2023
- 2023No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device ML11 Oct 2023
- 2023Integrating Homomorphic Encryption and Trusted Execution Technology for Autonomous and Confidential Model Refining in Cloud2 Aug 2023
- 2023Samplable Anonymous Aggregation for Private Federated Data Analysis27 Jul 2023
50 newest of 101 All 101 (JSON)
- 2021PPFL: Privacy-preserving Federated Learning with Trusted Execution Environmentscited by 93
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2022Position: Considerations for Differentially Private Learning with Large-Scale Public Pretrainingcited by 86
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2022Federated Learning Enables Big Data for Rare Cancer Boundary Detectioncited by 83
- 2021Differential Privacy for Text Analytics via Natural Text Sanitizationcited by 74
- 2021Handcrafted Backdoors in Deep Neural Networkscited by 57
- 2021CryptGPU: Fast Privacy-Preserving Machine Learning on the GPUcited by 46
- 2021DeepPayload: Black-box Backdoor Attack on Deep Learning Models through Neural Payload Injectioncited by 42
- 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
12 most cited of 93 All 93 (JSON)
- 2026SpliTEE: Fast and Private LLM Inference by Coupling GPU-Assisted Trusted Execution Environments with Differential Privacy14 Sep 2026
- 2026Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation9 Sep 2026
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026Towards Computational Provenance: Carrying Causal-State Evidence in Generated Text17 Aug 2026
- 2026MOSAIC: Masked Outsourcing of Secure AI Computations31 Jul 2026
- 2026Integrity of peer-to-peer distributed LLM inference under malicious nodes21 Jul 2026
- 2026Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference15 Jun 2026
- 2026The Proxy Knows Too Much: Sealing LLM API Routers with Attested TEEs15 Jun 2026
- 2026Communication-Efficient Verifiable Attention for LLM Inference15 Jun 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
- 2026Token Inflation: How Dishonest Providers Can Overcharge for Large Language Model Usage28 May 2026
- 2026KBF: Knowledge Boundary as Fingerprint for Language Model and Black-Box API Auditing28 May 2026
12 newest of 93 All 93 (JSON)