mlsanityData to 14 Oct 2026

Reaching the Tail: Calibration Diversity Drives Conformal Coverage under Data Scarcity

arXiv 2608.21591 ↗First posted 21 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-horizon rare-event forecasting is hard under long macroeconomic series' data constraints: labeled events are scarce, and standard uncertainty quantification assumes an exchangeability that autocorrelation violates. A controlled ablation shows an apparent rare-event threshold for Adaptive Conformal Inference instead reflects calibration-set size. Across 200 random calibration sets, support width of the nonconformity-score distribution explains up to 85% of coverage variance versus 2% for rare-event count; the same, not the same magnitude, replicates across synthetic conditions and five countries (five-country Spearman ρ 0.45-0.66 vs. 0.02-0.23). A diversity-maximizing selector built on this is the only strategy tested that improves long-horizon coverage (67.8% to 81.4% at six months); Mondrian, shift-robust, and extreme-value alternatives fail to close it. Mondrian even worsens coverage under oracle labels. A compact proposition explains why: coverage deficit reflects how closely the calibration set's upper quantile reaches the test distribution's. Diversity is necessary, not sufficient. Demonstrated on a two-stage U.S. recession-forecasting framework with RegressorChain, whether six-month coverage reaches 90% under honest scoring remains open, a question this paper quantifies rather than resolves.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 18 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

9 of 18 references.

References · 9

  1. 2019Conformal Prediction Under Covariate Shiftcited by 519
  2. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  3. 2022Conformal prediction beyond exchangeabilitycited by 355
  4. 2022Adaptive Conformal Predictions for Time Seriescited by 161
  5. 2023Conformal PID Control for Time Series Predictioncited by 88
  6. 2019Classifier Chains: A Review and Perspectivescited by 23
  7. 2024Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibrationcited by 19
  8. 2025Predictive inference for time series: why is split conformal effective despite temporal dependence?cited by 10
  9. 2025Extreme Conformal Prediction: Reliable Intervals for High-Impact Eventscited by 5

Built on by

Not cited yet.