Low Latency Privacy Preserving Inference
Not on the map. Why?
Abstract (arXiv)
When applying machine learning to sensitive data, one has to find a balance between accuracy, information security, and computational-complexity. Recent studies combined Homomorphic Encryption with neural networks to make inferences while protecting against information leakage. However, these methods are limited by the width and depth of neural networks that can be used (and hence the accuracy) and exhibit high latency even for relatively simple networks. In this study we provide two solutions that address these limitations. In the first solution, we present more than 10× improvement in latency and enable inference on wider networks compared to prior attempts with the same level of security. The improved performance is achieved by novel methods to represent the data during the computation. In the second solution, we apply the method of transfer learning to provide private inference services using deep networks with latency of ~0.16 seconds. We demonstrate the efficacy of our methods on several computer vision tasks.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 9; 2023: 10; 2024: 8; 2025: 9; 2026: 10.
57 papers.
Sort:
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2021Biometrics: Trust, but Verifycited by 39
- 2023AutoReP: Automatic ReLU Replacement for Fast Private Network Inferencecited by 29
- 2023LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inferencecited by 27
- 2024Nimbus: Secure and Efficient Two-Party Inference for Transformerscited by 16
- 2023AutoFHE: Automated Adaption of CNNs for Efficient Evaluation over FHEcited by 15
- 2022CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inferencecited by 10
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipelinecited by 10
- 2021Towards a Robust and Trustworthy Machine Learning System Development: An Engineering Perspectivecited by 9
- 2023HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networkscited by 9
- 2022Deploying Convolutional Networks on Untrusted Platforms Using 2D Holographic Reduced Representationscited by 7
- 2022Private and Reliable Neural Network Inferencecited by 7
38 more
- 2021Enabling Homomorphically Encrypted Inference for Large DNN Modelscited by 6
- 2022Volley Revolver: A Novel Matrix-Encoding Method for Privacy-Preserving Neural Networks (Inference)cited by 5
- 2022Cluster Based Secure Multi-Party Computation in Federated Learning for Histopathology Imagescited by 4
- 2022Audit and Improve Robustness of Private Neural Networks on Encrypted Datacited by 4
- 2023TT-TFHE: a Torus Fully Homomorphic Encryption-Friendly Neural Network Architecturecited by 4
- 2021SoK: Privacy-preserving Deep Learning with Homomorphic Encryptioncited by 3
- 2025Leveraging ASIC AI Chips for Homomorphic Encryptioncited by 3
- 2025A Training Framework for Optimal and Stable Training of Polynomial Neural Networkscited by 3
- 2021Application of Homomorphic Encryption in Medical Imagingcited by 2
- 2023Hyperdimensional Computing as a Rescue for Efficient Privacy-Preserving Machine Learning-as-a-Servicecited by 2
- 2025CryptoFace: End-to-End Encrypted Face Recognitioncited by 2
- 2021Efficient CNN Building Blocks for Encrypted Datacited by 1
- 2021FFConv: Fast Factorized Convolutional Neural Network Inference on Encrypted Datacited by 1
- 2021Efficient Encrypted Inference on Ensembles of Decision Treescited by 1
- 2021Enabling Inference Privacy with Adaptive Noise Injectioncited by 1
- 2023On Achieving Privacy-Preserving State-of-the-Art Edge Intelligencecited by 1
- 2023HE-MAN -- Homomorphically Encrypted MAchine learning with oNnx modelscited by 1
- 2024Bi-CryptoNets: Leveraging Different-Level Privacy for Encrypted Inferencecited by 1
- 2024Privacy-Preserving Hierarchical Model-Distributed Inferencecited by 1
- 2024DCT-CryptoNets: Scaling Private Inference in the Frequency Domaincited by 1
- 2024Privacy-Preserving Graph-Based Machine Learning with Fully Homomorphic Encryption for Collaborative Anti-Money Launderingcited by 1
- 2025SoK: Data Minimization in Machine Learningcited by 1
- 2026Manipulation-Proof Oblivious Audits against Deceptive Model Providerscited by 1
- 2021Efficient privacy-preserving inference for convolutional neural networkscited by 0
- 2022SEEK: model extraction attack against hybrid secure inference protocolscited by 0
- 2022Privacy-Preserving Credit Card Fraud Detection using Homomorphic Encryptioncited by 0
- 2023High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertextscited by 0
- 2023Artemis: HE-Aware Training for Efficient Privacy-Preserving Machine Learningcited by 0
- 2024Speed-up of Data Analysis with Kernel Trick in Encrypted Domaincited by 0
- 2024Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryptioncited by 0
- 2024Privacy-Preserving Verifiable Neural Network Inference Servicecited by 0
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Modelscited by 0
- 2025Securing Transfer-Learned Networks with Reverse Homomorphic Encryptioncited by 0
- 2025Practical and Private Hybrid ML Inference with Fully Homomorphic Encryptioncited by 0
- 2025EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inferencecited by 0
- 2025FastFHE: Packing-Scalable and Depthwise-Separable CNN Inference Over FHEcited by 0
- 2026RobPI: Robust Private Inference against Malicious Clientcited by 0
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learningcited by 0
50 most cited of 57 All 57 (JSON)
- 2026Encrypt What Matters: When Selective Homomorphic Inference Is Efficient8 Sep 2026
- 2026Manipulation-Proof Oblivious Audits against Deceptive Model Providers5 Aug 2026
- 2026Gecko: Fast Private Inference via Secure Public Encoder Offloading3 Aug 2026
- 2026Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference15 Jun 2026
- 2026FEnc2: Unifying Data Packing for Efficient Private Inference via Convolution and Architecture-Aware Fragment Encoding15 Jun 2026
- 2026Decision-Aware Quadratic ReLU Replacement for HE-Friendly Inference21 May 2026
- 2026Towards Deep Encrypted Training: Low-Latency, Memory-Efficient, and High-Throughput Inference for Privacy-Preserving Neural Networks18 Apr 2026
- 2026Meeting in the Middle: A Co-Design Paradigm for FHE and AI Inference20 Mar 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026RobPI: Robust Private Inference against Malicious Client23 Feb 2026
- 2025FastFHE: Packing-Scalable and Depthwise-Separable CNN Inference Over FHE27 Nov 2025
- 2025EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inference1 Nov 2025
38 more
- 2025Practical and Private Hybrid ML Inference with Fully Homomorphic Encryption1 Sep 2025
- 2025CryptoFace: End-to-End Encrypted Face Recognition30 Aug 2025
- 2025SoK: Data Minimization in Machine Learning14 Aug 2025
- 2025Securing Transfer-Learned Networks with Reverse Homomorphic Encryption20 May 2025
- 2025A Training Framework for Optimal and Stable Training of Polynomial Neural Networks16 May 2025
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models2 Feb 2025
- 2025Leveraging ASIC AI Chips for Homomorphic Encryption13 Jan 2025
- 2024Nimbus: Secure and Efficient Two-Party Inference for Transformers24 Nov 2024
- 2024Privacy-Preserving Verifiable Neural Network Inference Service12 Nov 2024
- 2024Privacy-Preserving Graph-Based Machine Learning with Fully Homomorphic Encryption for Collaborative Anti-Money Laundering5 Nov 2024
- 2024Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryption12 Sep 2024
- 2024DCT-CryptoNets: Scaling Private Inference in the Frequency Domain27 Aug 2024
- 2024Privacy-Preserving Hierarchical Model-Distributed Inference25 Jul 2024
- 2024Speed-up of Data Analysis with Kernel Trick in Encrypted Domain14 Jun 2024
- 2024Bi-CryptoNets: Leveraging Different-Level Privacy for Encrypted Inference2 Feb 2024
- 2023AutoFHE: Automated Adaption of CNNs for Efficient Evaluation over FHE12 Oct 2023
- 2023Artemis: HE-Aware Training for Efficient Privacy-Preserving Machine Learning2 Oct 2023
- 2023LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inference25 Sep 2023
- 2023AutoReP: Automatic ReLU Replacement for Fast Private Network Inference20 Aug 2023
- 2023Hyperdimensional Computing as a Rescue for Efficient Privacy-Preserving Machine Learning-as-a-Service17 Aug 2023
- 2023High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts15 Jun 2023
- 2023HE-MAN -- Homomorphically Encrypted MAchine learning with oNnx models16 Feb 2023
- 2023On Achieving Privacy-Preserving State-of-the-Art Edge Intelligence10 Feb 2023
- 2023HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networks5 Feb 2023
- 2023TT-TFHE: a Torus Fully Homomorphic Encryption-Friendly Neural Network Architecture3 Feb 2023
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipeline11 Dec 2022
- 2022Privacy-Preserving Credit Card Fraud Detection using Homomorphic Encryption12 Nov 2022
- 2022Private and Reliable Neural Network Inference27 Oct 2022
- 2022CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inference24 Sep 2022
- 2022Audit and Improve Robustness of Private Neural Networks on Encrypted Data20 Sep 2022
- 2022SEEK: model extraction attack against hybrid secure inference protocols14 Sep 2022
- 2022Cluster Based Secure Multi-Party Computation in Federated Learning for Histopathology Images21 Aug 2022
- 2022Deploying Convolutional Networks on Untrusted Platforms Using 2D Holographic Reduced Representations13 Jun 2022
- 2022Volley Revolver: A Novel Matrix-Encoding Method for Privacy-Preserving Neural Networks (Inference)29 Jan 2022
- 2021SoK: Privacy-preserving Deep Learning with Homomorphic Encryption23 Dec 2021
- 2021Efficient privacy-preserving inference for convolutional neural networks15 Oct 2021
- 2021Application of Homomorphic Encryption in Medical Imaging12 Oct 2021
- 2021Biometrics: Trust, but Verify14 May 2021
50 newest of 57 All 57 (JSON)
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2021Biometrics: Trust, but Verifycited by 39
- 2023AutoReP: Automatic ReLU Replacement for Fast Private Network Inferencecited by 29
- 2023LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inferencecited by 27
- 2024Nimbus: Secure and Efficient Two-Party Inference for Transformerscited by 16
- 2023AutoFHE: Automated Adaption of CNNs for Efficient Evaluation over FHEcited by 15
- 2022CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inferencecited by 10
- 2022ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipelinecited by 10
- 2021Towards a Robust and Trustworthy Machine Learning System Development: An Engineering Perspectivecited by 9
- 2023HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networkscited by 9
- 2022Deploying Convolutional Networks on Untrusted Platforms Using 2D Holographic Reduced Representationscited by 7
- 2022Private and Reliable Neural Network Inferencecited by 7
12 most cited of 57 All 57 (JSON)
- 2026Encrypt What Matters: When Selective Homomorphic Inference Is Efficient8 Sep 2026
- 2026Manipulation-Proof Oblivious Audits against Deceptive Model Providers5 Aug 2026
- 2026Gecko: Fast Private Inference via Secure Public Encoder Offloading3 Aug 2026
- 2026Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference15 Jun 2026
- 2026FEnc2: Unifying Data Packing for Efficient Private Inference via Convolution and Architecture-Aware Fragment Encoding15 Jun 2026
- 2026Decision-Aware Quadratic ReLU Replacement for HE-Friendly Inference21 May 2026
- 2026Towards Deep Encrypted Training: Low-Latency, Memory-Efficient, and High-Throughput Inference for Privacy-Preserving Neural Networks18 Apr 2026
- 2026Meeting in the Middle: A Co-Design Paradigm for FHE and AI Inference20 Mar 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026RobPI: Robust Private Inference against Malicious Client23 Feb 2026
- 2025FastFHE: Packing-Scalable and Depthwise-Separable CNN Inference Over FHE27 Nov 2025
- 2025EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inference1 Nov 2025
12 newest of 57 All 57 (JSON)