mlsanityData to 14 Oct 2026

The Delegation Blind Spot: Auditing Product Decisions from Agent Choices

arXiv 2609.26642 ↗First posted 22 Sep 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Successful agent execution need not identify which future product improvement its user would value. We present a decision-specific audit that maps a declared observation channel and product-value contrast to compatible intervals and witness populations. Its foundations are established identification and decision theory; the contribution is an executable measurement workflow and a controlled study of its limits. A frozen experiment makes 4,800 requests to two pinned model snapshots on shared synthetic tasks. All 36 conservative primary intervals remain unresolved despite different execution accuracy. An exploratory 2,400-call follow-up records supplied preferences and resolves three of nine comparisons per model. A deterministic extractor resolves seven of nine without model calls or calibration observations, exposing unnecessary uncertainty introduced by model-generated reports. A further 14,400 controlled multinomial simulations distinguish structural ambiguity from weak identification and finite calibration precision. We propose a source-labeled decision receipt and provide an offline viewer for inspecting the audit. These results motivate preserving decision-relevant structured input and diagnosing why a decision is unresolved before collecting more telemetry. The study contains no human participants or real customer outcomes. Full proofs, raw model provenance, controlled experiments, and reproducible analyses accompany the report.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 13 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

8 of 13 references.

References · 8

  1. 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 366
  2. 2023Prediction-Powered Inferencecited by 220
  3. 2024Active Statistical Inferencecited by 50
  4. 2023Linear Partial Monitoring for Sequential Decision-Making: Algorithms, Regret Bounds and Applicationscited by 12
  5. 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experimentscited by 12
  6. 2020Partial Identifiability in Discrete Data With Measurement Errorcited by 10
  7. 2025Robust Sampling for Active Statistical Inferencecited by 6
  8. 2026A Revealed Preference Framework for AI Alignmentcited by 1

Built on by

Not cited yet.