Dynamic Probabilistic Noise Injection for Membership Inference Defense
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Membership Inference Attacks (MIAs) expose privacy risks by determining whether a specific sample was part of a model's training set. These threats are especially serious in sensitive domains such as healthcare and finance. Traditional mitigation techniques, such as static differential privacy, rely on injecting a fixed amount of noise during training or inference. However, this often leads to a detrimental trade-off: the noise may be insufficient to counter sophisticated attacks or, when increased, can substantially degrade model accuracy. To address this limitation, we propose DynaNoise, an adaptive inference-time defense that modulates injected noise based on per-query sensitivity. DynaNoise estimates risk using measures such as Shannon entropy and scales the noise variance accordingly, followed by a smoothing step that re-normalizes the perturbed outputs to preserve predictive utility. We further introduce MIDPUT (Membership Inference Defense Privacy-Utility Trade-off), a scalar metric that captures both privacy gains and accuracy retention. Our evaluation on several benchmark datasets demonstrates that DynaNoise substantially lowers attack success rates while maintaining competitive accuracy, achieving strong overall MIDPUT scores compared to state-of-the-art defenses.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 18 of its 39 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
18 of 39 references.
Closest ancestors · 4
Same direction, newest first
- 2023Overconfidence is a Dangerous Thing: Mitigating Membership Inference Attacks by Enforcing Less Confident Prediction4 Jul
- 2022RelaxLoss: Defending Membership Inference Attacks without Losing Utility12 Jul
- 2021Membership Inference Attacks From First Principles7 Dec
- 2021Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble Architecture15 Oct
Other references · 14
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2016Deep Learning with Differential Privacycited by 2,728
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 498
- 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 293
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
- 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 197
- 2018Sensitivity and Generalization in Neural Networks: an Empirical Studycited by 189
- 2018Machine Learning with Membership Privacy using Adversarial Regularizationcited by 186
- 2018Deep Learning in Mobile and Wireless Networking: A Surveycited by 118
- 2024Rethinking LLM Memorization through the Lens of Adversarial Compressioncited by 94
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating the Dynamics of Membership Privacy in Deep Learning
- 2025AdaMixup: A Dynamic Defense Framework for Membership Inference Attack Mitigation
- 2026A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning
- 2024Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning
- 2023Low-Cost High-Power Membership Inference Attacks
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble
- 2022One Parameter Defense -- Defending against Data Inference Attacks via Differential Privacy
- 2022MIAShield: Defending Membership Inference Attacks via Preemptive Exclusion of Members