mlsanityData to 7 Oct 2026

Coarsening Latent-Class Probabilities: Directional Distortion and Coverage Loss

arXiv 2608.11784 ↗First posted 12 Aug 2026econ.EM stat.ME stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Outcomes are regressed on a calibrated probability vector for unobserved class membership. Under a structural conditional mean excluding the score and conditional calibration, the observed-data model reduces to a partially linear regression. The probability vector is a Berkson-type surrogate for membership, so the effect vector τ is identified without attenuation. In practice the vector is often coarsened to a hard label - an argmax, a confidence threshold - and that label need not retain the Berkson property. For any coarsening the plug-in estimator converges to Aτ, where A-I is determined by the regression of the discarded part of the score on the retained part. Coarsening therefore leaves τ undistorted exactly when that regression vanishes, and otherwise distorts some contrasts far more than others. The same operator determines the bias that drives coverage loss. Where that bias is of the order of the standard error, the Wald interval has limiting coverage Phi(z-nu)-Phi(-z-nu), with nu their ratio. A fixed bias sends coverage to zero. Operator, standard error, and - through the uncoarsened estimator - the bias are estimable from observed data, so the implied coverage can be approximated before the interval is reported. Simulations show severe coverage loss after argmax coarsening. Three real-data audits exhibit the direction-specific distortion.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 43 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

11 of 43 references.

References · 11

  1. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  2. 2023Prediction-Powered Inferencecited by 214
  3. 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
  4. 2019Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combinationcited by 79
  5. 2023Assumption-Lean and Data-Adaptive Post-Prediction Inferencecited by 25
  6. 2024Inference for Regression with Variables Generated by AI or Machine Learningcited by 10
  7. 2023Estimating Racial Disparities When Race is Not Observedcited by 4
  8. 2024Addressing Discretization-Induced Bias in Demographic Predictioncited by 4
  9. 2018Sensitivity Analysis using Approximate Moment Condition Modelscited by 3
  10. 2026Identification of Latent Group Effects under Conditional Calibrationcited by 2
  11. 2026When to Trust Confidence Thresholding: Calibration Diagnostics for Pseudo-Labelled Regressioncited by 1

Built on by

Not cited yet.