Reaching the Tail: Calibration Diversity Drives Conformal Coverage under Data Scarcity
Not on the map. Why?
Abstract (arXiv)
Multi-horizon rare-event forecasting is hard under long macroeconomic series' data constraints: labeled events are scarce, and standard uncertainty quantification assumes an exchangeability that autocorrelation violates. A controlled ablation shows an apparent rare-event threshold for Adaptive Conformal Inference instead reflects calibration-set size. Across 200 random calibration sets, support width of the nonconformity-score distribution explains up to 85% of coverage variance versus 2% for rare-event count; the same, not the same magnitude, replicates across synthetic conditions and five countries (five-country Spearman ρ 0.45-0.66 vs. 0.02-0.23). A diversity-maximizing selector built on this is the only strategy tested that improves long-horizon coverage (67.8% to 81.4% at six months); Mondrian, shift-robust, and extreme-value alternatives fail to close it. Mondrian even worsens coverage under oracle labels. A compact proposition explains why: coverage deficit reflects how closely the calibration set's upper quantile reaches the test distribution's. Diversity is necessary, not sufficient. Demonstrated on a two-stage U.S. recession-forecasting framework with RegressorChain, whether six-month coverage reaches 90% under honest scoring remains open, a question this paper quantifies rather than resolves.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 18 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
9 of 18 references.
References · 9
- 2019Conformal Prediction Under Covariate Shiftcited by 519
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
- 2022Conformal prediction beyond exchangeabilitycited by 355
- 2022Adaptive Conformal Predictions for Time Seriescited by 161
- 2023Conformal PID Control for Time Series Predictioncited by 88
- 2019Classifier Chains: A Review and Perspectivescited by 23
- 2024Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibrationcited by 19
- 2025Predictive inference for time series: why is split conformal effective despite temporal dependence?cited by 10
- 2025Extreme Conformal Prediction: Reliable Intervals for High-Impact Eventscited by 5
Built on by
Not cited yet.