mlsanityData to 7 Oct 2026

Optimal Classification under Performative Distribution Shift

arXiv 2411.02023 ↗First posted 4 Nov 2024cs.LG stat.MLcited by 9

Not on the map. Why?

Abstract (arXiv)

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these performative effects are modelled as push-forward measures. This general framework encompasses existing models and enables novel performative gradient estimation methods, leading to more efficient and scalable learning strategies. For distribution shifts, unlike previous models which require full specification of the data distribution, we only assume knowledge of the shift operator that represents the performative changes. This approach can also be integrated into various change-of-variablebased models, such as VAEs or normalizing flows. Focusing on classification with a linear-in-parameters performative effect, we prove the convexity of the performative risk under a new set of assumptions. Notably, we do not limit the strength of performative effects but rather their direction, requiring only that classification becomes harder when deploying more accurate models. In this case, we also establish a connection with adversarially robust classification by reformulating the minimization of the performative risk as a min-max variational problem. Finally, we illustrate our approach on synthetic and real datasets.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 10 of its 22 references that are in the map. First posted on arXiv 4 Nov 2024.

Builds on

10 of 22 references.

References · 10

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  4. 2020Performative Predictioncited by 318
  5. 2019Monte Carlo Gradient Estimation in Machine Learningcited by 281
  6. 2016Automatic Differentiation Variational Inferencecited by 159
  7. 2021Outside the Echo Chamber: Optimizing the Performative Riskcited by 95
  8. 2020Stochastic optimization with decision-dependent distributionscited by 65
  9. 2021How to Learn when Data Gradually Reacts to Your Modelcited by 29
  10. 2023Regularization properties of adversarially-trained linear regressioncited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 4.

9 papers.