mlsanityData to 7 Oct 2026

Self-Organized Conformal Prediction: Reducing Regional Coverage Gaps with Unsupervised Group Discovery

arXiv 2606.29403 ↗First posted 28 Jun 2026stat.ML cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Conformal prediction guarantees marginal coverage, but a pooled calibration quantile can hide systematic undercoverage across heterogeneous regions of the feature space. We introduce Self-Organized Conformal Prediction (SOCP), a calibration scheme that discovers input-space groups with an unsupervised Self-Organizing Map (SOM) trained without calibration labels. At prediction time, the query's best-matching unit (BMU) draws a calibration buffer from one cell, a fixed grid neighborhood, or a prototype-based enlargement. When fixed neighborhoods are too sparse, Regime 3 adds cells by prototype distance, using a global budget selected from training-cell occupancies and the planned calibration size before any calibration score is observed. The predictor and nonconformity score remain unchanged. Cell-only retrieval has exact cell-conditional validity, and each fixed union of cells has exact retrieved-set validity. Interpreting a neighborhood threshold at its central cell incurs an explicit Kolmogorov-Smirnov (KS) bias term. Across ten regression and classification benchmarks, SOCP reduces the weighted coverage gap relative to pooled split conformal prediction on nine datasets. The mean relative change is -14.3%, at a mean output-size change of +3.0%. Under fixed-neighborhood retrieval, SO composition lowers the ten-seed mean WCovGap in 43 of the 50 dataset-score comparisons, while SO-SCP lowers it on average over paired seeds for every dataset at all three tested external partition granularities. These results provide a concise route to group-local calibration without supervised partitions or predictor retraining with a diagnostic toolkit, while keeping the cost and limits of locality explicit.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

22 of 41 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  5. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  6. 2019Conformalized Quantile Regressioncited by 620
  7. 2020Classification with Valid and Adaptive Coveragecited by 390
  8. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 365
  9. 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 270
  10. 2023Conformal Prediction With Conditional Guaranteescited by 146
  11. 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 112
  12. 2023Class-Conditional Conformal Prediction with Many Classescited by 109
10 more
  1. 2021Conformal Prediction using Conditional Histogramscited by 77
  2. 2023Conformal Prediction for Deep Classifier via Label Rankingcited by 52
  3. 2023Conformal prediction with local weights: randomization enables local guaranteescited by 47
  4. 2022Split Localized Conformal Predictioncited by 20
  5. 2025Rectifying Conformity Scores for Better Conditional Coveragecited by 17
  6. 2024Group-Weighted Conformal Predictioncited by 14
  7. 2025Kandinsky Conformal Prediction: Beyond Class- and Covariate-Conditional Coveragecited by 12
  8. 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
  9. 2025Conformal Prediction Sets with Improved Conditional Coverage using Trust Scorescited by 4
  10. 2025torchsom: The Reference PyTorch Library for Self-Organizing Mapscited by 1

Built on by

Not cited yet.