Three Tools for Practical Differential Privacy
Not on the map. Why?
Abstract (arXiv)
Differentially private learning on real-world data poses challenges for standard machine learning practice: privacy guarantees are difficult to interpret, hyperparameter tuning on private data reduces the privacy budget, and ad-hoc privacy attacks are often required to test model privacy. We introduce three tools to make differentially private machine learning more practical: (1) simple sanity checks which can be carried out in a centralized manner before training, (2) an adaptive clipping bound to reduce the effective number of tuneable privacy parameters, and (3) we show that large-batch training improves model performance.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 5; 2024: 3; 2025: 2.
20 papers.
Sort:
By area:
- 2022Mixed Differential Privacy in Computer Visioncited by 53
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2022Differentially Private Learning with Per-Sample Adaptive Clippingcited by 21
- 2023Practical Differentially Private Hyperparameter Tuning with Subsamplingcited by 19
- 2021Gradient Leakage Attack Resilient Deep Learningcited by 17
- 2022Adap DP-FL: Differentially Private Federated Learning with Adaptive Noisecited by 12
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Releasecited by 9
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Designcited by 6
- 2021Efficient Hyperparameter Optimization for Differentially Private Deep Learningcited by 5
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMscited by 5
- 2022On the Importance of Architecture and Feature Selection in Differentially Private Machine Learningcited by 3
- 2023Batch Clipping and Adaptive Layerwise Clipping for Differential Private Stochastic Gradient Descentcited by 3
8 more
- 2023Coupling public and private gradient provably helps optimizationcited by 3
- 2025Empirical Privacy Variancecited by 3
- 2022How Much User Context Do We Need? Privacy by Design in Mental Health NLP Applicationcited by 2
- 2024R+R:Understanding Hyperparameter Effects in DP-SGDcited by 1
- 2024Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weightcited by 1
- 2021NanoBatch Privacy: Enabling fast Differentially Private learning on the IPUcited by 0
- 2023Exploring Machine Learning Privacy/Utility trade-off from a hyperparameters Lenscited by 0
- 2025Towards Reliable and Generalizable Differentially Private Machine Learning (Extended Version)cited by 0
- 2025Towards Reliable and Generalizable Differentially Private Machine Learning (Extended Version)21 Aug 2025
- 2025Empirical Privacy Variance16 Mar 2025
- 2024Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight5 Nov 2024
- 2024R+R:Understanding Hyperparameter Effects in DP-SGD4 Nov 2024
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMs30 Jul 2024
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release23 Nov 2023
- 2023Coupling public and private gradient provably helps optimization2 Oct 2023
- 2023Batch Clipping and Adaptive Layerwise Clipping for Differential Private Stochastic Gradient Descent21 Jul 2023
- 2023Exploring Machine Learning Privacy/Utility trade-off from a hyperparameters Lens3 Mar 2023
- 2023Practical Differentially Private Hyperparameter Tuning with Subsampling27 Jan 2023
- 2022Differentially Private Learning with Per-Sample Adaptive Clipping1 Dec 2022
- 2022Adap DP-FL: Differentially Private Federated Learning with Adaptive Noise29 Nov 2022
8 more
- 2022How Much User Context Do We Need? Privacy by Design in Mental Health NLP Application5 Sep 2022
- 2022On Privacy and Personalization in Cross-Silo Federated Learning16 Jun 2022
- 2022On the Importance of Architecture and Feature Selection in Differentially Private Machine Learning13 May 2022
- 2022Mixed Differential Privacy in Computer Vision22 Mar 2022
- 2021Gradient Leakage Attack Resilient Deep Learning25 Dec 2021
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Design29 Nov 2021
- 2021NanoBatch Privacy: Enabling fast Differentially Private learning on the IPU24 Sep 2021
- 2021Efficient Hyperparameter Optimization for Differentially Private Deep Learning9 Aug 2021
- 2022Mixed Differential Privacy in Computer Visioncited by 53
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2022Differentially Private Learning with Per-Sample Adaptive Clippingcited by 21
- 2023Practical Differentially Private Hyperparameter Tuning with Subsamplingcited by 19
- 2021Gradient Leakage Attack Resilient Deep Learningcited by 17
- 2022Adap DP-FL: Differentially Private Federated Learning with Adaptive Noisecited by 12
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Designcited by 6
- 2021Efficient Hyperparameter Optimization for Differentially Private Deep Learningcited by 5
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMscited by 5
- 2022On the Importance of Architecture and Feature Selection in Differentially Private Machine Learningcited by 3
- 2023Batch Clipping and Adaptive Layerwise Clipping for Differential Private Stochastic Gradient Descentcited by 3
- 2023Coupling public and private gradient provably helps optimizationcited by 3
12 most cited of 19 All 19 (JSON)
- 2025Towards Reliable and Generalizable Differentially Private Machine Learning (Extended Version)21 Aug 2025
- 2025Empirical Privacy Variance16 Mar 2025
- 2024Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight5 Nov 2024
- 2024R+R:Understanding Hyperparameter Effects in DP-SGD4 Nov 2024
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMs30 Jul 2024
- 2023Coupling public and private gradient provably helps optimization2 Oct 2023
- 2023Batch Clipping and Adaptive Layerwise Clipping for Differential Private Stochastic Gradient Descent21 Jul 2023
- 2023Exploring Machine Learning Privacy/Utility trade-off from a hyperparameters Lens3 Mar 2023
- 2023Practical Differentially Private Hyperparameter Tuning with Subsampling27 Jan 2023
- 2022Differentially Private Learning with Per-Sample Adaptive Clipping1 Dec 2022
- 2022Adap DP-FL: Differentially Private Federated Learning with Adaptive Noise29 Nov 2022
- 2022How Much User Context Do We Need? Privacy by Design in Mental Health NLP Application5 Sep 2022
12 newest of 19 All 19 (JSON)