mlsanityData to 14 Oct 2026

Performative Privacy: When Differential Privacy Maximizes Utility

arXiv 2608.28198 ↗First posted 28 Aug 2026cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Privacy-preserving learning is often motivated by the idea that protecting users' data can preserve trust and thus participation, improving utility in the long term. However, this claim has not been formalized so far. In parallel, performative learning provides a framework for studying learning systems whose deployment affects the data they later observe. In this work, we bring these two perspectives together and introduce performative privacy, where data leakage reduces future participation. We study a simple model where agents repeatedly contribute data for mean estimation but may leave the system when their data is leaked. Privacy is implemented through differentially private mechanisms, creating a trade-off between estimation noise and future participation. We show, through a theoretical study of the dynamics and numerical experiments, that a finite privacy budget can outperform non-private estimation in the long term when the feedback loop between leakage and participation is sufficiently strong. This provides first evidence that differential privacy can be optimal not only as a protection mechanism, but also from the perspective of long-term utility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

44 of 73 references.

References · 44

  1. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  2. 2021Membership Inference Attacks From First Principlescited by 878
  3. 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
  4. 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
  5. 2020Performative Predictioncited by 327
  6. 2013The Composition Theorem for Differential Privacycited by 297
  7. 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 271
  8. 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
  9. 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 218
  10. 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
  11. 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 153
  12. 2017Runaway Feedback Loops in Predictive Policingcited by 97
32 more
  1. 2020Stochastic Optimization for Performative Predictioncited by 93
  2. 2020Performative Prediction in a Stateful Worldcited by 90
  3. 2013Fingerprinting Codes and the Price of Approximate Differential Privacycited by 82
  4. 2020CoinPress: Practical Private Mean and Covariance Estimationcited by 74
  5. 2020Model-sharing Games: Analyzing Federated Learning Under Voluntary Participationcited by 60
  6. 2022Data Feedback Loops: Model-driven Amplification of Dataset Biasescited by 60
  7. 2020Individual Privacy Accounting via a Renyi Filtercited by 59
  8. 2023Performative Prediction: Past and Futurecited by 53
  9. 2022Performative Powercited by 43
  10. 2021One for One, or All for All: Equilibria and Optimality of Collaboration in Federated Learningcited by 39
  11. 2022Mechanisms that Incentivize Data Sharing in Federated Learningcited by 39
  12. 2019Group Retention when Using Machine Learning in Sequential Decision Making: the Interplay between User Dynamics and Fairnesscited by 38
  13. 2024Evaluations of Machine Learning Privacy Defenses are Misleadingcited by 36
  14. 2014Differential Privacy: An Economic Method for Choosing Epsiloncited by 35
  15. 2023Algorithmic Collective Action in Machine Learningcited by 31
  16. 2022Optimal and Differentially Private Data Acquisition: Central and Local Mechanismscited by 24
  17. 2017Accuracy First: Selecting a Differential Privacy Level for Accuracy-Constrained ERMcited by 20
  18. 2022Individual Privacy Accounting for Differentially Private Stochastic Gradient Descentcited by 20
  19. 2022Individual Privacy Accounting with Gaussian Differential Privacycited by 20
  20. 2021"I need a better description'': An Investigation Into User Expectations For Differential Privacycited by 17
  21. 2022Bounding Membership Inferencecited by 15
  22. 2022Optimal Data Acquisition with Privacy-Aware Agentscited by 13
  23. 2024Optimal Classification under Performative Distribution Shiftcited by 10
  24. 2020Towards Effective Differential Privacy Communication for Users' Data Sharing Decision and Comprehensioncited by 9
  25. 2023Mean Estimation Under Heterogeneous Privacy Demandscited by 6
  26. 2024Algorithmic Fairness in Performative Policy Learning: Escaping the Impossibility of Group Fairnesscited by 6
  27. 2013Privacy and Mechanism Designcited by 4
  28. 2025The Sample Complexity of Membership Inference and Privacy Auditingcited by 4
  29. 2024Some Targets Are Harder to Identify than Others: Quantifying the Target-dependent Membership Leakagecited by 3
  30. 2025Look-Ahead Reasoning on Learning Platformscited by 2
  31. 2026Causal Evaluation of Membership Inference Attackscited by 2
  32. 2026Sequential Membership Inference Attackscited by 1

Built on by

Not cited yet.