mlsanityData to 14 Oct 2026

The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting

arXiv 2605.07671 ↗First posted 8 May 2026cs.GT cs.AI cs.MAcited by 2

Not on the map. Why?

Abstract (arXiv)

An agent's probability report is paid for twice: by a strictly proper scoring rule, and by an approval rule for the decision it triggers. In this classical decision-coupled setting, non-affine approval is known to defeat truthful reporting. We show the conflict is endogenous: when feasible, the welfare-maximizing approval rule is never affine. The distortion, however, is predictable and can be designed around. There is a reserve report at which pretending to be the marginal type costs exactly the approval prize. Approving at or above the reserve screens types perfectly under every strictly proper score, and the reserve does not depend on the type distribution. A Lipschitz rule with a single kink attains first-best exactly; under strict feasibility no continuously differentiable rule does. The binding constraint is steepness, not smoothness. First-best is attainable within a slope budget if and only if the budget is at least the critical slope: the steepest chord of the pretending cost up to the reserve. Below it the welfare loss is cubic in the shortfall. Where the pretending cost is convex up to the reserve, as for Brier, log and power scores, the critical slope is closed-form. The instances are AI-agent oversight and marketplace operation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 81 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

11 of 81 references.

References · 11

  1. 2017Deep reinforcement learning from human preferencescited by 3,912
  2. 2018AI safety via debatecited by 400
  3. 2018Categorizing Variants of Goodhart's Lawcited by 149
  4. 2020Optimization of Scoring Rulescited by 28
  5. 2020Binary Scoring Rules that Incentivize Precisioncited by 12
  6. 2022Contracts with Information Acquisition, via Scoring Rulescited by 8
  7. 2024Data-Driven Mechanism Design: Jointly Eliciting Preferences and Informationcited by 7
  8. 2020Credible, Truthful, and Two-Round (Optimal) Auctions via Cryptographic Commitmentscited by 2
  9. 2026Honest Reporting in Scored Oversight: True-KL0 Property via the Prekopa Principlecited by 2
  10. 2023Proxy Forecasting to Avoid Stochastic Decision Rules in Decision Marketscited by 1
  11. 2024Joint Scoring Rules: Zero-Sum Competition Avoids Performative Predictioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.