CrypTFlow: Secure TensorFlow Inference
Not on the map. Why?
Abstract (arXiv)
We present CrypTFlow, a first of its kind system that converts TensorFlow inference code into Secure Multi-party Computation (MPC) protocols at the push of a button. To do this, we build three components. Our first component, Athos, is an end-to-end compiler from TensorFlow to a variety of semi-honest MPC protocols. The second component, Porthos, is an improved semi-honest 3-party protocol that provides significant speedups for TensorFlow like applications. Finally, to provide malicious secure MPC protocols, our third component, Aramis, is a novel technique that uses hardware with integrity guarantees to convert any semi-honest MPC protocol into an MPC protocol that provides malicious security. The malicious security of the protocols output by Aramis relies on integrity of the hardware and semi-honest security of MPC. Moreover, our system matches the inference accuracy of plaintext TensorFlow. We experimentally demonstrate the power of our system by showing the secure inference of real-world neural networks such as ResNet50 and DenseNet121 over the ImageNet dataset with running times of about 30 seconds for semi-honest security and under two minutes for malicious security. Prior work in the area of secure inference has been limited to semi-honest security of small networks over tiny datasets such as MNIST or CIFAR. Even on MNIST/CIFAR, CrypTFlow outperforms prior work.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 12; 2023: 13; 2024: 10; 2025: 8; 2026: 3.
61 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2021CryptGPU: Fast Privacy-Preserving Machine Learning on the GPUcited by 46
- 2022Scaling up Trustless DNN Inference with Zero-Knowledge Proofscited by 30
- 2021SIRNN: A Math Library for Secure RNN Inferencecited by 28
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2022pvCNN: Privacy-Preserving and Verifiable Convolutional Neural Network Testingcited by 20
- 2022Exploiting Data Sparsity in Secure Cross-Platform Social Recommendationcited by 17
- 2022Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realizationcited by 16
- 2023Bytes Are All You Need: Transformers Operating Directly On File Bytescited by 16
- 2024Trustless Audits without Revealing Data or Modelscited by 14
- 2021secureTF: A Secure TensorFlow Frameworkcited by 12
38 more
- 2021Privacy-Preserving Feature Selection with Secure Multiparty Computationcited by 12
- 2023RRNet: Towards ReLU-Reduced Neural Network for Two-party Computation Based Private Inferencecited by 12
- 2021Privacy-Preserving Video Classification with Convolutional Neural Networkscited by 10
- 2022SecGNN: Privacy-Preserving Graph Neural Network Training and Inference as a Cloud Servicecited by 10
- 2023HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networkscited by 9
- 2025TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networkscited by 9
- 2023A Survey of Secure Computation Using Trusted Execution Environmentscited by 8
- 2021Enabling Homomorphically Encrypted Inference for Large DNN Modelscited by 6
- 2021Towards Secure and Practical Machine Learning via Secret Sharing and Random Permutationcited by 5
- 2022SafeNet: The Unreasonable Effectiveness of Ensembles in Private Collaborative Learningcited by 5
- 2023GPU-based Private Information Retrieval for On-Device Machine Learning Inferencecited by 5
- 2023Improving Heterogeneous Model Reuse by Density Estimationcited by 5
- 2023Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inferencecited by 5
- 2024MPC-Minimized Secure LLM Inferencecited by 5
- 2021Adam in Private: Secure and Fast Training of Deep Neural Networks with Adaptive Moment Estimationcited by 4
- 2022MPC-Pipe: an Efficient Pipeline Scheme for Secure Multi-party Machine Learning Inferencecited by 4
- 2024SSNet: A Lightweight Multi-Party Computation Scheme for Practical Privacy-Preserving Machine Learning Service in the Cloudcited by 3
- 2024CipherDM: Secure Three-Party Inference for Diffusion Model Samplingcited by 3
- 2025Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsitycited by 3
- 2021Fast Privacy-Preserving Text Classification based on Secure Multiparty Computationcited by 2
- 2021Perun: Secure Multi-Stakeholder Machine Learning Framework with GPU Supportcited by 2
- 2022Securing the Classification of COVID-19 in Chest X-ray Images: A Privacy-Preserving Deep Learning Approachcited by 2
- 2022Efficient ML Models for Practical Secure Inferencecited by 2
- 2022PolyMPCNet: Towards ReLU-free Neural Architecture Search in Two-party Computation Based Private Inferencecited by 2
- 2023Dash: Accelerating Distributed Private Convolutional Neural Network Inference with Arithmetic Garbled Circuitscited by 2
- 2023Approximating ReLU on a Reduced Ring for Efficient MPC-based Private Inferencecited by 2
- 2024HEQuant: Marrying Homomorphic Encryption and Quantization for Communication-Efficient Private Inferencecited by 2
- 2022Private Multiparty Perception for Navigationcited by 1
- 2023Securing Neural Networks with Knapsack Optimizationcited by 1
- 2023Towards Fast and Scalable Private Inferencecited by 1
- 2023Privacy Preserving Multi-Agent Reinforcement Learning in Supply Chainscited by 1
- 2024Secure Federated Learning Approaches to Diagnosing COVID-19cited by 1
- 2024Privacy-Preserving Hierarchical Model-Distributed Inferencecited by 1
- 2024PrivQuant: Communication-Efficient Private Inference with Quantized Network/Protocol Co-Optimizationcited by 1
- 2025Covert Attacks on Machine Learning Training in Passively Secure MPCcited by 1
- 2025Optimizing Privacy-Preserving Primitives to Support LLM-Scale Applicationscited by 1
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computationcited by 1
- 2026Fine-Tuning Integrity for Modern Neural Networks: Structured Drift Proofs via Norm, Rank, and Sparsity Certificatescited by 1
50 most cited of 61 All 61 (JSON)
- 2026Repurposing CLIP to Localize at Pixel Level6 Jul 2026
- 2026TL++: Accuracy and Privacy Preserving Traversal Learning for Distributed Intelligent Systems24 Jun 2026
- 2026Fine-Tuning Integrity for Modern Neural Networks: Structured Drift Proofs via Norm, Rank, and Sparsity Certificates6 Apr 2026
- 2025DeepShare: Sharing ReLU Across Channels and Layers for Efficient Private Inference19 Dec 2025
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computation24 Nov 2025
- 2025PrivGNN: High-Performance Secure Inference for Cryptographic Graph Neural Networks4 Nov 2025
- 2025Optimizing Privacy-Preserving Primitives to Support LLM-Scale Applications29 Sep 2025
- 2025CryptGNN: Enabling Secure Inference for Graph Neural Networks11 Sep 2025
- 2025Covert Attacks on Machine Learning Training in Passively Secure MPC21 May 2025
- 2025Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity12 May 2025
- 2025TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks27 Apr 2025
- 2024PrivQuant: Communication-Efficient Private Inference with Quantized Network/Protocol Co-Optimization12 Oct 2024
38 more
- 2024Secure Multiparty Generative AI27 Sep 2024
- 2024CipherDM: Secure Three-Party Inference for Diffusion Model Sampling9 Sep 2024
- 2024MPC-Minimized Secure LLM Inference7 Aug 2024
- 2024Privacy-Preserving Hierarchical Model-Distributed Inference25 Jul 2024
- 2024SSNet: A Lightweight Multi-Party Computation Scheme for Practical Privacy-Preserving Machine Learning Service in the Cloud4 Jun 2024
- 2024Amalgam: A Framework for Obfuscated Neural Network Training on the Cloud2 Jun 2024
- 2024Trustless Audits without Revealing Data or Models6 Apr 2024
- 2024HEQuant: Marrying Homomorphic Encryption and Quantization for Communication-Efficient Private Inference29 Jan 2024
- 2024Secure Federated Learning Approaches to Diagnosing COVID-1923 Jan 2024
- 2023Privacy Preserving Multi-Agent Reinforcement Learning in Supply Chains9 Dec 2023
- 2023Approximating ReLU on a Reduced Ring for Efficient MPC-based Private Inference9 Sep 2023
- 2023Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inference25 Aug 2023
- 2023Towards Fast and Scalable Private Inference9 Jul 2023
- 2023Bytes Are All You Need: Transformers Operating Directly On File Bytes31 May 2023
- 2023Improving Heterogeneous Model Reuse by Density Estimation23 May 2023
- 2023Securing Neural Networks with Knapsack Optimization20 Apr 2023
- 2023A Survey of Secure Computation Using Trusted Execution Environments23 Feb 2023
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacy21 Feb 2023
- 2023Dash: Accelerating Distributed Private Convolutional Neural Network Inference with Arithmetic Garbled Circuits13 Feb 2023
- 2023HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networks5 Feb 2023
- 2023RRNet: Towards ReLU-Reduced Neural Network for Two-party Computation Based Private Inference5 Feb 2023
- 2023GPU-based Private Information Retrieval for On-Device Machine Learning Inference26 Jan 2023
- 2022Private Multiparty Perception for Navigation2 Dec 2022
- 2022Scaling up Trustless DNN Inference with Zero-Knowledge Proofs17 Oct 2022
- 2022MPC-Pipe: an Efficient Pipeline Scheme for Secure Multi-party Machine Learning Inference27 Sep 2022
- 2022PolyMPCNet: Towards ReLU-free Neural Architecture Search in Two-party Computation Based Private Inference20 Sep 2022
- 2022SEEK: model extraction attack against hybrid secure inference protocols14 Sep 2022
- 2022Efficient ML Models for Practical Secure Inference26 Aug 2022
- 2022SafeNet: The Unreasonable Effectiveness of Ensembles in Private Collaborative Learning20 May 2022
- 2022Securing the Classification of COVID-19 in Chest X-ray Images: A Privacy-Preserving Deep Learning Approach15 Mar 2022
- 2022SecGNN: Privacy-Preserving Graph Neural Network Training and Inference as a Cloud Service16 Feb 2022
- 2022Exploiting Data Sparsity in Secure Cross-Platform Social Recommendation15 Feb 2022
- 2022Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realization4 Feb 2022
- 2022pvCNN: Privacy-Preserving and Verifiable Convolutional Neural Network Testing23 Jan 2022
- 2021Trustworthy AI: From Principles to Practices4 Oct 2021
- 2021Morse-STF: Improved Protocols for Privacy-Preserving Machine Learning24 Sep 2021
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learning2 Sep 2021
- 2021Towards Secure and Practical Machine Learning via Secret Sharing and Random Permutation17 Aug 2021
50 newest of 61 All 61 (JSON)
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2021CryptGPU: Fast Privacy-Preserving Machine Learning on the GPUcited by 46
- 2022Scaling up Trustless DNN Inference with Zero-Knowledge Proofscited by 30
- 2021SIRNN: A Math Library for Secure RNN Inferencecited by 28
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2022pvCNN: Privacy-Preserving and Verifiable Convolutional Neural Network Testingcited by 20
- 2022Exploiting Data Sparsity in Secure Cross-Platform Social Recommendationcited by 17
- 2022Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realizationcited by 16
- 2023Bytes Are All You Need: Transformers Operating Directly On File Bytescited by 16
- 2024Trustless Audits without Revealing Data or Modelscited by 14
- 2021secureTF: A Secure TensorFlow Frameworkcited by 12
12 most cited of 60 All 60 (JSON)
- 2026Repurposing CLIP to Localize at Pixel Level6 Jul 2026
- 2026TL++: Accuracy and Privacy Preserving Traversal Learning for Distributed Intelligent Systems24 Jun 2026
- 2026Fine-Tuning Integrity for Modern Neural Networks: Structured Drift Proofs via Norm, Rank, and Sparsity Certificates6 Apr 2026
- 2025DeepShare: Sharing ReLU Across Channels and Layers for Efficient Private Inference19 Dec 2025
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computation24 Nov 2025
- 2025PrivGNN: High-Performance Secure Inference for Cryptographic Graph Neural Networks4 Nov 2025
- 2025Optimizing Privacy-Preserving Primitives to Support LLM-Scale Applications29 Sep 2025
- 2025CryptGNN: Enabling Secure Inference for Graph Neural Networks11 Sep 2025
- 2025Covert Attacks on Machine Learning Training in Passively Secure MPC21 May 2025
- 2025Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity12 May 2025
- 2025TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks27 Apr 2025
- 2024PrivQuant: Communication-Efficient Private Inference with Quantized Network/Protocol Co-Optimization12 Oct 2024
12 newest of 60 All 60 (JSON)