# Sample-Efficient Generative Conformal Prediction

arXiv: https://arxiv.org/abs/2610.11349 · HTML: https://mlsanity.com/paper/2610.11349/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 55 references that are in the map.
- First posted on arXiv 8 Oct 2026.

## Builds on (most cited first, 11 of 11)

- [Self-Consistency Improves Chain of Thought Reasoning in Language Models](https://mlsanity.com/paper/2203.11171/) (2022)
- [Qwen2.5-VL Technical Report](https://mlsanity.com/paper/2502.13923/) (2025)
- [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://mlsanity.com/paper/2408.03314/) (2024)
- [Adaptive Computation Time for Recurrent Neural Networks](https://mlsanity.com/paper/1603.08983/) (2016)
- [Distributional conformal prediction](https://mlsanity.com/paper/1909.07889/) (2019)
- [Rectifying Conformity Scores for Better Conditional Coverage](https://mlsanity.com/paper/2502.16336/) (2025)
- [Generative Conformal Prediction with Optimized Coverage Allocation](https://mlsanity.com/paper/2410.13735/) (2024)
- [Locally Adaptive Conformal Inference for Operator Models](https://mlsanity.com/paper/2507.20975/) (2025)
- [Conformal Prediction for Generative Models via Adaptive Cluster-Based Density Estimation](https://mlsanity.com/paper/2601.22298/) (2026)
- [Flow-Based Conformal Predictive Distributions](https://mlsanity.com/paper/2602.07633/) (2026)
- [Beyond Prediction: Conformal Inference for Latent Distributional Parameters](https://mlsanity.com/paper/2608.03607/) (2026)

## Abstract (arXiv)

Generative conformal prediction builds uncertainty sets from samples of a conditional generator, which are efficient only when the samples represent the response distribution well. This can require many samples, each of which can be costly, as in large diffusion models and scientific simulators, so the sampling budget must be used efficiently. Existing methods draw the same number of samples at every input, wasting samples where the response distribution is simple and undersampling where it is complex, which inflates sets and leaves those inputs under-covered. We propose CASA (Conformal Adaptive Sample Allocation), which characterizes the marginal value of an additional sample and allocates samples across inputs to minimize the expected set size subject to marginal coverage and an average sampling budget. Theoretical analysis shows that adaptive allocation yields smaller sets than a fixed count at the same budget: a missed mode forces a radius that spans the gap between modes, and even oracle radius cannot compensate for it. On synthetic and real tasks, CASA produces substantially smaller sets at the same budget, often improves conditional coverage, and complements existing radius-adaptive methods.
