mlsanityData to 7 Oct 2026

Joint Scoring Rules: Zero-Sum Competition Avoids Performative Prediction

arXiv 2412.20732 ↗First posted 30 Dec 2024cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In a decision-making scenario, a principal could use conditional predictions from an expert agent to inform their choice. However, this approach would introduce a fundamental conflict of interest. An agent optimizing for predictive accuracy is incentivized to manipulate their principal towards more predictable actions, which prevents that principal from being able to deterministically select their true preference. We demonstrate that this impossibility result can be overcome through the joint evaluation of multiple agents. When agents are made to engage in zero-sum competition, their incentive to influence the action taken is eliminated, and the principal can identify and take the action they most prefer. We further prove that this zero-sum setup is unique, efficiently implementable, and applicable under stochastic choice. Experiments in a toy environment demonstrate that training on a zero-sum objective significantly enhances both predictive accuracy and principal utility, and can eliminate previously learned manipulative behavior.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

12 of 30 references.

References · 12

  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2020Performative Predictioncited by 318
  3. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
  4. 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 120
  5. 2019Optimal Policies Tend to Seek Powercited by 115
  6. 2020Hidden Incentives for Auto-Induced Distributional Shiftcited by 42
  7. 2023On Second-Order Scoring Rules for Epistemic Uncertainty Quantificationcited by 38
  8. 2023Natural Selection Favors AIs over Humanscited by 24
  9. 2017Good and safe uses of AI Oraclescited by 13
  10. 2023Conditioning Predictive Models: Risks and Strategiescited by 11
  11. 2023Incentivizing honest performative predictions with proper scoring rulescited by 9
  12. 2022Scoring Rules for Performative Binary Predictioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.