Unifying Re-Identification, Attribute Inference, and Data Reconstruction Risks in Differential Privacy
Not on the map. Why?
Abstract (arXiv)
Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction -- are both overly pessimistic and inconsistent. In this work, we use the hypothesis-testing interpretation of DP (f-DP), and determine that bounds on attack success can take the same unified form across re-identification, attribute inference, and data reconstruction risks. Our unified bounds are (1) consistent across a multitude of attack settings, and (2) tunable, enabling practitioners to evaluate risk with respect to arbitrary, including worst-case, levels of baseline risk. Empirically, our results are tighter than prior methods using varepsilon-DP, R'enyi DP, and concentrated DP. As a result, calibrating noise using our bounds can reduce the required noise by 20% at the same risk level, which yields, e.g., an accuracy increase from 52% to 70% in a text classification task. Overall, this unifying perspective provides a principled framework for interpreting and calibrating the degree of protection in DP against specific levels of re-identification, attribute inference, or data reconstruction risk.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 47 of its 82 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
47 of 82 references.
References · 47
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2016Deep Learning with Differential Privacycited by 2,728
- 2022Quantifying Memorization Across Neural Language Modelscited by 763
- 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 460
- 2021Differentially Private Fine-tuning of Language Modelscited by 400
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
- 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2013The Composition Theorem for Differential Privacycited by 297
- 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 242
- 2020Differentially Private Learning Needs Better Features (or Much More Data)cited by 235
35 more
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
- 2021Numerical Composition of Differential Privacycited by 180
- 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 175
- 2021Counterfactual Memorization in Neural Language Modelscited by 156
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
- 2022Reconstructing Training Data with Informed Adversariescited by 148
- 2016Concentrated Differential Privacycited by 144
- 2020Revisiting Membership Inference Under Realistic Assumptionscited by 112
- 2015Algorithmic Stability for Adaptive Data Analysiscited by 88
- 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2023Bounding Training Data Reconstruction in DP-SGDcited by 46
- 2016Differential Privacy as a Mutual Information Constraintcited by 45
- 2022Geographic Spines in the 2020 Census Disclosure Avoidance Systemcited by 44
- 2019Disparate Vulnerability to Membership Inference Attackscited by 35
- 2020Investigating Membership Inference Attacks under Data Dependenciescited by 32
- 2019Towards Formalizing the GDPR's Notion of Singling Outcited by 26
- 2023Gaussian Membership Inference Privacycited by 21
- 2023Arbitrary Decisions are a Hidden Cost of Differentially Private Trainingcited by 19
- 2022Analyzing Privacy Leakage in Machine Learning via Multiple Hypothesis Testing: A Lesson From Fanocited by 17
- 2023Bounding data reconstruction attacks with the hypothesis testing interpretation of differential privacycited by 15
- 2023What Are the Chances? Explaining the Epsilon Parameter in Differential Privacycited by 14
- 2022What You See is What You Get: Principled Deep Learning via Distributional Generalizationcited by 11
- 2024Beyond the Calibration Point: Mechanism Comparison in Differential Privacycited by 9
- 2022Bayesian and Frequentist Semantics for Common Variations of Differential Privacy: Applications to the 2020 Censuscited by 8
- 2024Attack-Aware Noise Calibration for Differential Privacycited by 8
- 2024A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theoremcited by 8
- 2024Data Reconstruction: When You See It and When You Don'tcited by 7
- 2020Bayes Security: A Not So Average Metriccited by 6
- 2022The Saddle-Point Accountant for Differential Privacycited by 5
- 2022"Am I Private and If So, how Many?" - Communicating Privacy Guarantees of Differential Privacy with Risk Communication Formatscited by 4
- 2024ATTAXONOMY: Unpacking Differential Privacy Guarantees Against Practical Adversariescited by 4
- 2024The 2020 US Decennial Census is more private than you (might) thinkcited by 4
- 2023Prior-itizing Privacy: A Bayesian Approach to Setting the Privacy Budget in Differential Privacycited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 14.
15 papers.
Sort:
By area:
- 2026Information-Theoretic Privacy Control for Sequential Multi-Agent LLM Systemscited by 8
- 2026Is your algorithm unlearning or untraining?cited by 4
- 2026Unintended Memorization of Sensitive Information in Fine-Tuned Language Modelscited by 3
- 2025A Unified Framework for Adversary-Aware Differential Privacy Boundscited by 2
- 2026Your Privacy Depends on Others: Collusion Vulnerabilities in Individual Differential Privacycited by 1
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspectivecited by 1
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentationcited by 0
- 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearningcited by 0
- 2026A Sieve-Accelerated Quadrature Method for Exact Privacy Accounting in the 2020 U.S. Decennial Censuscited by 0
- 2026Plausible Deniability Guarantees for Whistleblowerscited by 0
- 2026Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spotscited by 0
- 2026A Sharp Transition in Data Reconstruction under Differential Privacycited by 0
3 more
- 2026Protecting Sensitive Data in Image Synthesis via PAC-Private Adaptation for Diffusion Modelscited by 0
- 2026From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Boundscited by 0
- 2026Tight End-to-End Accounting for Differentially Private Synthetic Datacited by 0
- 2026Tight End-to-End Accounting for Differentially Private Synthetic Data12 Oct 2026
- 2026From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds9 Oct 2026
- 2026Protecting Sensitive Data in Image Synthesis via PAC-Private Adaptation for Diffusion Models2 Oct 2026
- 2026A Sharp Transition in Data Reconstruction under Differential Privacy29 Sep 2026
- 2026Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spots27 Aug 2026
- 2026Plausible Deniability Guarantees for Whistleblowers15 Jul 2026
- 2026A Sieve-Accelerated Quadrature Method for Exact Privacy Accounting in the 2020 U.S. Decennial Census29 Jun 2026
- 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearning12 Jun 2026
- 2026Is your algorithm unlearning or untraining?9 Apr 2026
- 2026Information-Theoretic Privacy Control for Sequential Multi-Agent LLM Systems13 Feb 2026
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation3 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2026Unintended Memorization of Sensitive Information in Fine-Tuned Language Modelscited by 3
- 2026Your Privacy Depends on Others: Collusion Vulnerabilities in Individual Differential Privacycited by 1
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspectivecited by 1
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentationcited by 0
- 2026A Sieve-Accelerated Quadrature Method for Exact Privacy Accounting in the 2020 U.S. Decennial Censuscited by 0
- 2026Plausible Deniability Guarantees for Whistleblowerscited by 0
- 2026Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spotscited by 0
- 2026A Sharp Transition in Data Reconstruction under Differential Privacycited by 0
- 2026From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Boundscited by 0
- 2026Tight End-to-End Accounting for Differentially Private Synthetic Datacited by 0
- 2026Tight End-to-End Accounting for Differentially Private Synthetic Data12 Oct 2026
- 2026From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds9 Oct 2026
- 2026A Sharp Transition in Data Reconstruction under Differential Privacy29 Sep 2026
- 2026Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spots27 Aug 2026
- 2026Plausible Deniability Guarantees for Whistleblowers15 Jul 2026
- 2026A Sieve-Accelerated Quadrature Method for Exact Privacy Accounting in the 2020 U.S. Decennial Census29 Jun 2026
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation3 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2026Unintended Memorization of Sensitive Information in Fine-Tuned Language Models24 Jan 2026
- 2026Your Privacy Depends on Others: Collusion Vulnerabilities in Individual Differential Privacy19 Jan 2026