QUOTIENT: Two-Party Secure Neural Network Training and Prediction
Not on the map. Why?
Abstract (arXiv)
Recently, there has been a wealth of effort devoted to the design of secure protocols for machine learning tasks. Much of this is aimed at enabling secure prediction from highly-accurate Deep Neural Networks (DNNs). However, as DNNs are trained on data, a key question is how such models can be also trained securely. The few prior works on secure DNN training have focused either on designing custom protocols for existing training algorithms, or on developing tailored training algorithms and then applying generic secure protocols. In this work, we investigate the advantages of designing training algorithms alongside a novel secure protocol, incorporating optimizations on both fronts. We present QUOTIENT, a new method for discretized training of DNNs, along with a customized secure two-party protocol for it. QUOTIENT incorporates key components of state-of-the-art DNN training such as layer normalization and adaptive gradient methods, and improves upon the state-of-the-art in DNN training in two-party computation. Compared to prior work, we obtain an improvement of 50X in WAN time and 6% in absolute accuracy.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 6; 2023: 3; 2024: 11; 2025: 3; 2026: 1.
41 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakagecited by 72
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2021SIRNN: A Math Library for Secure RNN Inferencecited by 28
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2021Defending against Reconstruction Attack in Vertical Federated Learningcited by 20
- 2021Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputscited by 18
- 2021Secure Quantized Training for Deep Learningcited by 15
- 2022AESPA: Accuracy Preserving Low-degree Polynomial Activation for Fast Private Inferencecited by 14
- 2021Privacy-Preserving Feature Selection with Secure Multiparty Computationcited by 12
29 more
- 2021Privacy-Preserving Video Classification with Convolutional Neural Networkscited by 10
- 2024Ditto: Quantization-aware Secure Inference of Transformers upon MPCcited by 7
- 2024Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learningcited by 6
- 2021Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Surveycited by 4
- 2021Adam in Private: Secure and Fast Training of Deep Neural Networks with Adaptive Moment Estimationcited by 4
- 2022PrivFair: a Library for Privacy-Preserving Fairness Auditingcited by 4
- 2022Federated Zero-Shot Learning for Visual Recognitioncited by 4
- 2021PRECAD: Privacy-Preserving and Robust Federated Learning via Crypto-Aided Differential Privacycited by 3
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectivescited by 3
- 2024CryptoTrain: Fast Secure Training on Encrypted Datasetcited by 3
- 2021Fast Privacy-Preserving Text Classification based on Secure Multiparty Computationcited by 2
- 2024Wildest Dreams: Reproducible Research in Privacy-preserving Neural Network Trainingcited by 2
- 2021MPC-Friendly Commitments for Publicly Verifiable Covert Securitycited by 1
- 2022Towards Privacy-Preserving Neural Architecture Searchcited by 1
- 2023SelectFormer: Private and Practical Data Selection for Transformerscited by 1
- 2023Edge AI for Internet of Energy: Challenges and Perspectivescited by 1
- 2024Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumptioncited by 1
- 2024Privacy-Preserving Hierarchical Model-Distributed Inferencecited by 1
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computationcited by 1
- 2021Round and Communication Balanced Protocols for Oblivious Evaluation of Finite State Machinescited by 0
- 2021PolyDNN: Polynomial Representation of NN for Communication-less SMPC Inferencecited by 0
- 2022Adversarial Representation Sharing: A Quantitative and Secure Collaborative Learning Frameworkcited by 0
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attackcited by 0
- 2024Amalgam: A Framework for Obfuscated Neural Network Training on the Cloudcited by 0
- 2024Efficiently Achieving Secure Model Training and Secure Aggregation to Ensure Bidirectional Privacy-Preservation in Federated Learningcited by 0
- 2024CBNN: 3-Party Secure Framework for Customized Binary Neural Networks Inferencecited by 0
- 2025DRAGD: A Federated Unlearning Data Reconstruction Attack Based on Gradient Differencescited by 0
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecturecited by 0
- 2026UFO: Unlocking Ultra-Efficient Quantized Private Inference with Protocol and Algorithm Co-Optimizationcited by 0
- 2026UFO: Unlocking Ultra-Efficient Quantized Private Inference with Protocol and Algorithm Co-Optimization21 Feb 2026
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computation24 Nov 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025DRAGD: A Federated Unlearning Data Reconstruction Attack Based on Gradient Differences13 Jul 2025
- 2024CBNN: 3-Party Secure Framework for Customized Binary Neural Networks Inference21 Dec 2024
- 2024Efficiently Achieving Secure Model Training and Secure Aggregation to Ensure Bidirectional Privacy-Preservation in Federated Learning16 Dec 2024
- 2024CryptoTrain: Fast Secure Training on Encrypted Dataset25 Sep 2024
- 2024Privacy-Preserving Hierarchical Model-Distributed Inference25 Jul 2024
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives16 Jun 2024
- 2024Amalgam: A Framework for Obfuscated Neural Network Training on the Cloud2 Jun 2024
- 2024Ditto: Quantization-aware Secure Inference of Transformers upon MPC9 May 2024
- 2024Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learning14 Apr 2024
29 more
- 2024Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumption17 Mar 2024
- 2024Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack14 Mar 2024
- 2024Wildest Dreams: Reproducible Research in Privacy-preserving Neural Network Training6 Mar 2024
- 2023Edge AI for Internet of Energy: Challenges and Perspectives28 Nov 2023
- 2023SelectFormer: Private and Practical Data Selection for Transformers3 Oct 2023
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacy21 Feb 2023
- 2022Federated Zero-Shot Learning for Visual Recognition5 Sep 2022
- 2022Towards Privacy-Preserving Neural Architecture Search22 Apr 2022
- 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage29 Mar 2022
- 2022Adversarial Representation Sharing: A Quantitative and Secure Collaborative Learning Framework27 Mar 2022
- 2022PrivFair: a Library for Privacy-Preserving Fairness Auditing8 Feb 2022
- 2022AESPA: Accuracy Preserving Low-degree Polynomial Activation for Fast Private Inference18 Jan 2022
- 2021PRECAD: Privacy-Preserving and Robust Federated Learning via Crypto-Aided Differential Privacy22 Oct 2021
- 2021Trustworthy AI: From Principles to Practices4 Oct 2021
- 2021MPC-Friendly Commitments for Publicly Verifiable Covert Security15 Sep 2021
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directions10 Aug 2021
- 2021Defending against Reconstruction Attack in Vertical Federated Learning21 Jul 2021
- 2021Trustworthy AI: A Computational Perspective12 Jul 2021
- 2021Secure Quantized Training for Deep Learning1 Jul 2021
- 2021Adam in Private: Secure and Fast Training of Deep Neural Networks with Adaptive Moment Estimation4 Jun 2021
- 2021Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs25 May 2021
- 2021Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Survey13 May 2021
- 2021SIRNN: A Math Library for Secure RNN Inference10 May 2021
- 2021PolyDNN: Polynomial Representation of NN for Communication-less SMPC Inference2 Apr 2021
- 2021Round and Communication Balanced Protocols for Oblivious Evaluation of Finite State Machines20 Mar 2021
- 2021Label Leakage and Protection in Two-party Split Learning17 Feb 2021
- 2021Privacy-Preserving Feature Selection with Secure Multiparty Computation6 Feb 2021
- 2021Privacy-Preserving Video Classification with Convolutional Neural Networks6 Feb 2021
- 2021Fast Privacy-Preserving Text Classification based on Secure Multiparty Computation18 Jan 2021
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2022Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakagecited by 72
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2021SIRNN: A Math Library for Secure RNN Inferencecited by 28
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2021Defending against Reconstruction Attack in Vertical Federated Learningcited by 20
- 2021Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputscited by 18
- 2021Secure Quantized Training for Deep Learningcited by 15
- 2022AESPA: Accuracy Preserving Low-degree Polynomial Activation for Fast Private Inferencecited by 14
- 2021Privacy-Preserving Feature Selection with Secure Multiparty Computationcited by 12
12 most cited of 39 All 39 (JSON)
- 2026UFO: Unlocking Ultra-Efficient Quantized Private Inference with Protocol and Algorithm Co-Optimization21 Feb 2026
- 2025CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computation24 Nov 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2024CBNN: 3-Party Secure Framework for Customized Binary Neural Networks Inference21 Dec 2024
- 2024Efficiently Achieving Secure Model Training and Secure Aggregation to Ensure Bidirectional Privacy-Preservation in Federated Learning16 Dec 2024
- 2024CryptoTrain: Fast Secure Training on Encrypted Dataset25 Sep 2024
- 2024Privacy-Preserving Hierarchical Model-Distributed Inference25 Jul 2024
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives16 Jun 2024
- 2024Amalgam: A Framework for Obfuscated Neural Network Training on the Cloud2 Jun 2024
- 2024Ditto: Quantization-aware Secure Inference of Transformers upon MPC9 May 2024
- 2024Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learning14 Apr 2024
- 2024Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumption17 Mar 2024
12 newest of 39 All 39 (JSON)