mlsanityData to 14 Oct 2026

Unifying Re-Identification, Attribute Inference, and Data Reconstruction Risks in Differential Privacy

arXiv 2507.06969 ↗First posted 9 Jul 2025cs.LG cs.AI cs.CRcited by 15

Not on the map. Why?

Abstract (arXiv)

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction -- are both overly pessimistic and inconsistent. In this work, we use the hypothesis-testing interpretation of DP (f-DP), and determine that bounds on attack success can take the same unified form across re-identification, attribute inference, and data reconstruction risks. Our unified bounds are (1) consistent across a multitude of attack settings, and (2) tunable, enabling practitioners to evaluate risk with respect to arbitrary, including worst-case, levels of baseline risk. Empirically, our results are tighter than prior methods using varepsilon-DP, R'enyi DP, and concentrated DP. As a result, calibrating noise using our bounds can reduce the required noise by 20% at the same risk level, which yields, e.g., an accuracy increase from 52% to 70% in a text classification task. Overall, this unifying perspective provides a principled framework for interpreting and calibrating the degree of protection in DP against specific levels of re-identification, attribute inference, or data reconstruction risk.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 47 of its 82 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

47 of 82 references.

References · 47

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  3. 2016Deep Learning with Differential Privacycited by 2,728
  4. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  5. 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 460
  6. 2021Differentially Private Fine-tuning of Language Modelscited by 400
  7. 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
  8. 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
  9. 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
  10. 2013The Composition Theorem for Differential Privacycited by 297
  11. 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 242
  12. 2020Differentially Private Learning Needs Better Features (or Much More Data)cited by 235
35 more
  1. 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
  2. 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
  3. 2021Numerical Composition of Differential Privacycited by 180
  4. 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 175
  5. 2021Counterfactual Memorization in Neural Language Modelscited by 156
  6. 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
  7. 2022Reconstructing Training Data with Informed Adversariescited by 148
  8. 2016Concentrated Differential Privacycited by 144
  9. 2020Revisiting Membership Inference Under Realistic Assumptionscited by 112
  10. 2015Algorithmic Stability for Adaptive Data Analysiscited by 88
  11. 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
  12. 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
  13. 2023Bounding Training Data Reconstruction in DP-SGDcited by 46
  14. 2016Differential Privacy as a Mutual Information Constraintcited by 45
  15. 2022Geographic Spines in the 2020 Census Disclosure Avoidance Systemcited by 44
  16. 2019Disparate Vulnerability to Membership Inference Attackscited by 35
  17. 2020Investigating Membership Inference Attacks under Data Dependenciescited by 32
  18. 2019Towards Formalizing the GDPR's Notion of Singling Outcited by 26
  19. 2023Gaussian Membership Inference Privacycited by 21
  20. 2023Arbitrary Decisions are a Hidden Cost of Differentially Private Trainingcited by 19
  21. 2022Analyzing Privacy Leakage in Machine Learning via Multiple Hypothesis Testing: A Lesson From Fanocited by 17
  22. 2023Bounding data reconstruction attacks with the hypothesis testing interpretation of differential privacycited by 15
  23. 2023What Are the Chances? Explaining the Epsilon Parameter in Differential Privacycited by 14
  24. 2022What You See is What You Get: Principled Deep Learning via Distributional Generalizationcited by 11
  25. 2024Beyond the Calibration Point: Mechanism Comparison in Differential Privacycited by 9
  26. 2022Bayesian and Frequentist Semantics for Common Variations of Differential Privacy: Applications to the 2020 Censuscited by 8
  27. 2024Attack-Aware Noise Calibration for Differential Privacycited by 8
  28. 2024A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theoremcited by 8
  29. 2024Data Reconstruction: When You See It and When You Don'tcited by 7
  30. 2020Bayes Security: A Not So Average Metriccited by 6
  31. 2022The Saddle-Point Accountant for Differential Privacycited by 5
  32. 2022"Am I Private and If So, how Many?" - Communicating Privacy Guarantees of Differential Privacy with Risk Communication Formatscited by 4
  33. 2024ATTAXONOMY: Unpacking Differential Privacy Guarantees Against Practical Adversariescited by 4
  34. 2024The 2020 US Decennial Census is more private than you (might) thinkcited by 4
  35. 2023Prior-itizing Privacy: A Bayesian Approach to Setting the Privacy Budget in Differential Privacycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 14.

15 papers.

Sort:

By area: