mlsanityData to 7 Oct 2026

Algorithmic Collective Action in Machine Learning

arXiv 2302.04262 ↗First posted 8 Feb 2023cs.LG cs.GT stat.MLcited by 30

Not on the map. Why?

Abstract (arXiv)

We initiate a principled study of algorithmic collective action on digital platforms that deploy machine learning algorithms. We propose a simple theoretical model of a collective interacting with a firm's learning algorithm. The collective pools the data of participating individuals and executes an algorithmic strategy by instructing participants how to modify their own data to achieve a collective goal. We investigate the consequences of this model in three fundamental learning-theoretic settings: the case of a nonparametric optimal learning algorithm, a parametric risk minimizer, and gradient-based optimization. In each setting, we come up with coordinated algorithmic strategies and characterize natural success criteria as a function of the collective's size. Complementing our theory, we conduct systematic experiments on a skill classification task involving tens of thousands of resumes from a gig platform for freelancers. Through more than two thousand model training runs of a BERT-like language model, we see a striking correspondence emerge between our empirical observations and the predictions made by our theory. Taken together, our theory and experiments broadly support the conclusion that algorithmic collectives of exceedingly small fractional size can exert significant control over a platform's learning algorithm.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 18 of its 56 references that are in the map. First posted on arXiv 8 Feb 2023.

Builds on

18 of 56 references.

References · 18

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  3. 2015Strategic Classificationcited by 256
  4. 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 156
  5. 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 92
  6. 2022Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protectioncited by 80
  7. 2021Who Leads and Who Follows in Strategic Classification?cited by 53
  8. 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defencescited by 41
  9. 2018POTs: Protective Optimization Technologiescited by 28
  10. 2020Data Leverage: A Framework for Empowering the Public in its Relationship with Technology Companiescited by 25
  11. 2021Excess Capacity and Backdoor Poisoningcited by 24
  12. 2022An Equivalence Between Data Poisoning and Byzantine Gradient Attackscited by 16
6 more
  1. 2020Politics of Adversarial Machine Learningcited by 12
  2. 2020Backdoor Smoothing: Demystifying Backdoor Attacks on Deep Neural Networkscited by 5
  3. 2021Backdoor Learning Curves: Explaining Backdoor Poisoning Beyond Influence Functionscited by 5
  4. 2021Adversarial for Good? How the Adversarial ML Community's Values Impede Socially Beneficial Uses of Attackscited by 5
  5. 2022Adversarial Scrutiny of Evidentiary Statistical Softwarecited by 5
  6. 2014Exploiting Social Navigationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 8; 2025: 10; 2026: 7.

30 papers.

Sort:

By area:

  1. 2023Performative Prediction: Past and Futurecited by 52
  2. 2024Corrective Machine Unlearningcited by 26
  3. 2024Mapping Social Choice Theory to RLHFcited by 26
  4. 2023Fine-Tuning Games: Bargaining and Adaptation for General-Purpose Modelscited by 17
  5. 2023A Classification of Feedback Loops and Their Relation to Biases in Automated Decision-Making Systemscited by 12
  6. 2024The Role of Learning Algorithms in Collective Actioncited by 8
  7. 2024Feature Responsiveness Scores: Model-Agnostic Explanations for Recoursecited by 8
  8. 2024Algorithmic Collective Action in Recommender Systems: Promoting Songs by Reordering Playlistscited by 7
  9. 2024Performative Prediction on Games and Mechanism Designcited by 7
  10. 2025Algorithmic Collective Action with Two Collectivescited by 7
  11. 2025Statistical Collusion by Collectives on Learning Platformscited by 6
  12. 2023Prediction without Preclusion: Recourse Verification with Reachable Setscited by 4
18 more
  1. 2025Crowding Out The Noise: Algorithmic Collective Action Under Differential Privacycited by 4
  2. 2024Understanding Model Selection For Learning In Strategic Environmentscited by 3
  3. 2025Minority Collective Action for User-Side Fairnesscited by 3
  4. 2023Insights From Insurance for Fair Machine Learningcited by 2
  5. 2024Inverting Gradient Attacks Makes Powerful Data Poisoningcited by 2
  6. 2025Algorithmic Collective Action with Multiple Collectivescited by 2
  7. 2025Look-Ahead Reasoning on Learning Platformscited by 2
  8. 2026Dissecting Performative Prediction: A Comprehensive Surveycited by 2
  9. 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systemscited by 2
  10. 2026Partially Performative Predictioncited by 2
  11. 2025Understanding Fixed Predictions via Confined Regionscited by 1
  12. 2025AI Workers, Geopolitics, and Algorithmic Collective Actioncited by 1
  13. 2025Strategically Deceptive Model Deployment in Performative Predictioncited by 0
  14. 2025Observation-Free Attacks on Online Learning to Rankcited by 0
  15. 2026A Statistical Framework for Algorithmic Collective Action with Multiple Collectivescited by 0
  16. 2026Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harmscited by 0
  17. 2026Sequential Data Poisoning in LLM Post-Trainingcited by 0
  18. 2026Performative Privacy: When Differential Privacy Maximizes Utilitycited by 0