Self-Organized Conformal Prediction: Reducing Regional Coverage Gaps with Unsupervised Group Discovery
Not on the map. Why?
Abstract (arXiv)
Conformal prediction guarantees marginal coverage, but a pooled calibration quantile can hide systematic undercoverage across heterogeneous regions of the feature space. We introduce Self-Organized Conformal Prediction (SOCP), a calibration scheme that discovers input-space groups with an unsupervised Self-Organizing Map (SOM) trained without calibration labels. At prediction time, the query's best-matching unit (BMU) draws a calibration buffer from one cell, a fixed grid neighborhood, or a prototype-based enlargement. When fixed neighborhoods are too sparse, Regime 3 adds cells by prototype distance, using a global budget selected from training-cell occupancies and the planned calibration size before any calibration score is observed. The predictor and nonconformity score remain unchanged. Cell-only retrieval has exact cell-conditional validity, and each fixed union of cells has exact retrieved-set validity. Interpreting a neighborhood threshold at its central cell incurs an explicit Kolmogorov-Smirnov (KS) bias term. Across ten regression and classification benchmarks, SOCP reduces the weighted coverage gap relative to pooled split conformal prediction on nine datasets. The mean relative change is -14.3%, at a mean output-size change of +3.0%. Under fixed-neighborhood retrieval, SO composition lowers the ten-seed mean WCovGap in 43 of the 50 dataset-score comparisons, while SO-SCP lowers it on average over paired seeds for every dataset at all three tested external partition granularities. These results provide a concise route to group-local calibration without supervised partitions or predictor retraining with a diagnostic toolkit, while keeping the cost and limits of locality explicit.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
22 of 41 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2016Distribution-Free Predictive Inference For Regressioncited by 657
- 2019Conformalized Quantile Regressioncited by 620
- 2020Classification with Valid and Adaptive Coveragecited by 390
- 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 365
- 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 270
- 2023Conformal Prediction With Conditional Guaranteescited by 146
- 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 112
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
10 more
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2023Conformal Prediction for Deep Classifier via Label Rankingcited by 52
- 2023Conformal prediction with local weights: randomization enables local guaranteescited by 47
- 2022Split Localized Conformal Predictioncited by 20
- 2025Rectifying Conformity Scores for Better Conditional Coveragecited by 17
- 2024Group-Weighted Conformal Predictioncited by 14
- 2025Kandinsky Conformal Prediction: Beyond Class- and Covariate-Conditional Coveragecited by 12
- 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
- 2025Conformal Prediction Sets with Improved Conditional Coverage using Trust Scorescited by 4
- 2025torchsom: The Reference PyTorch Library for Self-Organizing Mapscited by 1
Built on by
Not cited yet.