Adaptive Laplace Mechanism: Differential Privacy Preservation in Deep Learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we focus on developing a novel mechanism to preserve differential privacy in deep neural networks, such that: (1) The privacy budget consumption is totally independent of the number of training steps; (2) It has the ability to adaptively inject noise into features based on the contribution of each to the output; and (3) It could be applied in a variety of different deep neural networks. To achieve this, we figure out a way to perturb affine transformations of neurons, and loss functions used in deep neural networks. In addition, our mechanism intentionally adds "more noise" into features which are "less relevant" to the model output, and vice-versa. Our theoretical analysis further derives the sensitivities and error bounds of our mechanism. Rigorous experiments conducted on MNIST and CIFAR-10 datasets show that our mechanism is highly effective and outperforms existing solutions.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 6; 2024: 4; 2025: 3; 2026: 5.
34 papers.
Sort:
By area:
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022FederatedScope: A Flexible Federated Learning Platform for Heterogeneitycited by 53
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 51
- 2024LLM-PBE: Assessing Data Privacy in Large Language Modelscited by 41
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 36
- 2021On the Convergence and Calibration of Deep Learning with Differential Privacycited by 36
- 2021Gradient Leakage Attack Resilient Deep Learningcited by 18
- 2022Differentially Private Counterfactuals via Functional Mechanismcited by 13
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Releasecited by 10
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliabilitycited by 6
22 more
- 2021Continual Learning with Differential Privacycited by 6
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Designcited by 6
- 2021Task-aware Privacy Preservation for Multi-dimensional Datacited by 5
- 2024Unlearnable Examples For Time Seriescited by 5
- 2022ConfounderGAN: Protecting Image Data Privacy with Causal Confoundercited by 4
- 2023FairDP: Certified Fairness with Differential Privacycited by 4
- 2021Multi-Party Dual Learningcited by 3
- 2023Adversarial Robustness in Unsupervised Machine Learning: A Systematic Reviewcited by 3
- 2022Lifelong DP: Consistently Bounded Differential Privacy in Lifelong Machine Learningcited by 2
- 2022DPSNN: A Differentially Private Spiking Neural Network with Temporal Enhanced Poolingcited by 1
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systemscited by 1
- 2025Safeguarding connected autonomous vehicle communication: Protocols, intra- and inter-vehicular attacks and defensescited by 1
- 2021Partial sensitivity analysis in differential privacycited by 0
- 2023Differential Privacy May Have a Potential Optimization Effect on Some Swarm Intelligence Algorithms besides Privacy-preservingcited by 0
- 2024Effectiveness of L2 Regularization in Privacy-Preserving Machine Learningcited by 0
- 2025PPFL-RDSN: Privacy-Preserving Federated Learning-based Residual Dense Spatial Networks for Encrypted Lossy Image Reconstructioncited by 0
- 2025Differential Privacy in Federated Learning: Mitigating Inference Attacks with Randomized Responsecited by 0
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacycited by 0
- 2026An exponential mechanism based on quadratic approximations for fine-tuning machine learning models with privacy guaranteescited by 0
- 2026Revisiting Privacy Amplification by Subsampling in Selective Release DPSGDcited by 0
- 2026Auditing Privacy Risks in LLM-Enhanced Graph Neural Networkscited by 0
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocolscited by 0
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocols7 Sep 2026
- 2026Auditing Privacy Risks in LLM-Enhanced Graph Neural Networks26 Aug 2026
- 2026Revisiting Privacy Amplification by Subsampling in Selective Release DPSGD3 Jun 2026
- 2026An exponential mechanism based on quadratic approximations for fine-tuning machine learning models with privacy guarantees19 May 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2025Differential Privacy in Federated Learning: Mitigating Inference Attacks with Randomized Response17 Sep 2025
- 2025PPFL-RDSN: Privacy-Preserving Federated Learning-based Residual Dense Spatial Networks for Encrypted Lossy Image Reconstruction30 Jun 2025
- 2025Safeguarding connected autonomous vehicle communication: Protocols, intra- and inter-vehicular attacks and defenses6 Feb 2025
- 2024Effectiveness of L2 Regularization in Privacy-Preserving Machine Learning2 Dec 2024
- 2024LLM-PBE: Assessing Data Privacy in Large Language Models23 Aug 2024
- 2024Unlearnable Examples For Time Series3 Feb 2024
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems3 Jan 2024
22 more
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release23 Nov 2023
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Survey28 Sep 2023
- 2023Differential Privacy May Have a Potential Optimization Effect on Some Swarm Intelligence Algorithms besides Privacy-preserving30 Jun 2023
- 2023Adversarial Robustness in Unsupervised Machine Learning: A Systematic Review1 Jun 2023
- 2023FairDP: Certified Fairness with Differential Privacy25 May 2023
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy10 May 2023
- 2022ConfounderGAN: Protecting Image Data Privacy with Causal Confounder4 Dec 2022
- 2022Differentially Private Counterfactuals via Functional Mechanism4 Aug 2022
- 2022Lifelong DP: Consistently Bounded Differential Privacy in Lifelong Machine Learning26 Jul 2022
- 2022DPSNN: A Differentially Private Spiking Neural Network with Temporal Enhanced Pooling24 May 2022
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trends16 May 2022
- 2022FederatedScope: A Flexible Federated Learning Platform for Heterogeneity11 Apr 2022
- 2021Gradient Leakage Attack Resilient Deep Learning25 Dec 2021
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Design29 Nov 2021
- 2021Continual Learning with Differential Privacy11 Oct 2021
- 2021Task-aware Privacy Preservation for Multi-dimensional Data5 Oct 2021
- 2021Partial sensitivity analysis in differential privacy22 Sep 2021
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliability18 Jul 2021
- 2021On the Convergence and Calibration of Deep Learning with Differential Privacy15 Jun 2021
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learning2 May 2021
- 2021Multi-Party Dual Learning14 Apr 2021
- 2021Unlearnable Examples: Making Personal Data Unexploitable13 Jan 2021
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 51
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Releasecited by 10
- 2024Effectiveness of L2 Regularization in Privacy-Preserving Machine Learningcited by 0
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocolscited by 0
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocols7 Sep 2026
- 2024Effectiveness of L2 Regularization in Privacy-Preserving Machine Learning2 Dec 2024
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release23 Nov 2023
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy10 May 2023
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022FederatedScope: A Flexible Federated Learning Platform for Heterogeneitycited by 53
- 2024LLM-PBE: Assessing Data Privacy in Large Language Modelscited by 41
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 36
- 2021On the Convergence and Calibration of Deep Learning with Differential Privacycited by 36
- 2021Gradient Leakage Attack Resilient Deep Learningcited by 18
- 2022Differentially Private Counterfactuals via Functional Mechanismcited by 13
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliabilitycited by 6
- 2021Continual Learning with Differential Privacycited by 6
- 2021Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Designcited by 6
12 most cited of 30 All 30 (JSON)
- 2026Auditing Privacy Risks in LLM-Enhanced Graph Neural Networks26 Aug 2026
- 2026Revisiting Privacy Amplification by Subsampling in Selective Release DPSGD3 Jun 2026
- 2026An exponential mechanism based on quadratic approximations for fine-tuning machine learning models with privacy guarantees19 May 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2025Differential Privacy in Federated Learning: Mitigating Inference Attacks with Randomized Response17 Sep 2025
- 2025PPFL-RDSN: Privacy-Preserving Federated Learning-based Residual Dense Spatial Networks for Encrypted Lossy Image Reconstruction30 Jun 2025
- 2025Safeguarding connected autonomous vehicle communication: Protocols, intra- and inter-vehicular attacks and defenses6 Feb 2025
- 2024LLM-PBE: Assessing Data Privacy in Large Language Models23 Aug 2024
- 2024Unlearnable Examples For Time Series3 Feb 2024
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems3 Jan 2024
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Survey28 Sep 2023
- 2023Differential Privacy May Have a Potential Optimization Effect on Some Swarm Intelligence Algorithms besides Privacy-preserving30 Jun 2023
12 newest of 30 All 30 (JSON)