A Unified Framework for Adversary-Aware Differential Privacy Bounds
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Differential Privacy (DP) bounds the privacy leakage of a mechanism against worst-case membership inference, but the precise tradeoff between complex adversarial models and DP protections remains poorly understood. In this paper, we present a unified framework that generalizes the patchwork of existing bounds across membership inference, attribute inference, and data reconstruction attacks. Crucially, our framework is the first to evaluate attacks that target multiple individuals simultaneously and measure success beyond exact matches under a single cohesive bound. Our bounds capture this broad family of previously unexplored attack settings by relying solely on the privacy parameters and the adversary's baseline success rate (i.e. its prior without access to the mechanism's output). To illustrate this, we compare our high-probability guarantees to empirical attacks in two novel settings: extracting multiple non-uniform secrets (passwords and PII) from DP-finetuned language models, and reconstructing tabular data from noisy marginals. Ultimately, this framework provides a rigorous theoretical foundation to investigate the risk landscape of DP algorithms in new adversarial settings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. First posted on arXiv 10 Jul 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025Observational Auditing of Label Privacycited by 0
- 2026A Sharp Transition in Data Reconstruction under Differential Privacycited by 0
- 2026A Sharp Transition in Data Reconstruction under Differential Privacy29 Sep 2026
- 2025Observational Auditing of Label Privacy18 Nov 2025