Performative Privacy: When Differential Privacy Maximizes Utility
Not on the map. Why?
Abstract (arXiv)
Privacy-preserving learning is often motivated by the idea that protecting users' data can preserve trust and thus participation, improving utility in the long term. However, this claim has not been formalized so far. In parallel, performative learning provides a framework for studying learning systems whose deployment affects the data they later observe. In this work, we bring these two perspectives together and introduce performative privacy, where data leakage reduces future participation. We study a simple model where agents repeatedly contribute data for mean estimation but may leave the system when their data is leaked. Privacy is implemented through differentially private mechanisms, creating a trade-off between estimation noise and future participation. We show, through a theoretical study of the dynamics and numerical experiments, that a finite privacy budget can outperform non-private estimation in the long term when the feedback loop between leakage and participation is sufficiently strong. This provides first evidence that differential privacy can be optimal not only as a protection mechanism, but also from the perspective of long-term utility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
44 of 73 references.
References · 44
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2021Membership Inference Attacks From First Principlescited by 878
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
- 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
- 2020Performative Predictioncited by 327
- 2013The Composition Theorem for Differential Privacycited by 297
- 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 271
- 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
- 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 218
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
- 2017Runaway Feedback Loops in Predictive Policingcited by 97
32 more
- 2020Stochastic Optimization for Performative Predictioncited by 93
- 2020Performative Prediction in a Stateful Worldcited by 90
- 2013Fingerprinting Codes and the Price of Approximate Differential Privacycited by 82
- 2020CoinPress: Practical Private Mean and Covariance Estimationcited by 74
- 2020Model-sharing Games: Analyzing Federated Learning Under Voluntary Participationcited by 60
- 2022Data Feedback Loops: Model-driven Amplification of Dataset Biasescited by 60
- 2020Individual Privacy Accounting via a Renyi Filtercited by 59
- 2023Performative Prediction: Past and Futurecited by 53
- 2022Performative Powercited by 43
- 2021One for One, or All for All: Equilibria and Optimality of Collaboration in Federated Learningcited by 39
- 2022Mechanisms that Incentivize Data Sharing in Federated Learningcited by 39
- 2019Group Retention when Using Machine Learning in Sequential Decision Making: the Interplay between User Dynamics and Fairnesscited by 38
- 2024Evaluations of Machine Learning Privacy Defenses are Misleadingcited by 36
- 2014Differential Privacy: An Economic Method for Choosing Epsiloncited by 35
- 2023Algorithmic Collective Action in Machine Learningcited by 31
- 2022Optimal and Differentially Private Data Acquisition: Central and Local Mechanismscited by 24
- 2017Accuracy First: Selecting a Differential Privacy Level for Accuracy-Constrained ERMcited by 20
- 2022Individual Privacy Accounting for Differentially Private Stochastic Gradient Descentcited by 20
- 2022Individual Privacy Accounting with Gaussian Differential Privacycited by 20
- 2021"I need a better description'': An Investigation Into User Expectations For Differential Privacycited by 17
- 2022Bounding Membership Inferencecited by 15
- 2022Optimal Data Acquisition with Privacy-Aware Agentscited by 13
- 2024Optimal Classification under Performative Distribution Shiftcited by 10
- 2020Towards Effective Differential Privacy Communication for Users' Data Sharing Decision and Comprehensioncited by 9
- 2023Mean Estimation Under Heterogeneous Privacy Demandscited by 6
- 2024Algorithmic Fairness in Performative Policy Learning: Escaping the Impossibility of Group Fairnesscited by 6
- 2013Privacy and Mechanism Designcited by 4
- 2025The Sample Complexity of Membership Inference and Privacy Auditingcited by 4
- 2024Some Targets Are Harder to Identify than Others: Quantifying the Target-dependent Membership Leakagecited by 3
- 2025Look-Ahead Reasoning on Learning Platformscited by 2
- 2026Causal Evaluation of Membership Inference Attackscited by 2
- 2026Sequential Membership Inference Attackscited by 1
Built on by
Not cited yet.