Multi-Condition Conformal Selection
On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods
Abstract (arXiv)
Selecting high-quality candidates from large-scale datasets is critically important in resource-constrained applications such as drug discovery, precision medicine, and the alignment of large language models. While conformal selection methods offer a rigorous solution with False Discovery Rate (FDR) control, their applicability is confined to single-threshold scenarios (i.e., y > c) and overlooks practical needs for multi-condition selection, such as conjunctive or disjunctive conditions. In this work, we propose the Multi-Condition Conformal Selection (MCCS) algorithm, which extends conformal selection to scenarios with multiple conditions. In particular, we introduce a novel nonconformity score with regional monotonicity for conjunctive conditions and a global Benjamini-Hochberg (BH) procedure for disjunctive conditions, thereby establishing finite-sample FDR control with theoretical guarantees. The integration of these components enables the proposed method to achieve rigorous FDR-controlled selection in various multi-condition environments. Extensive experiments validate the superiority of MCCS over baselines, its generalizability across diverse condition combinations, different real-world modalities, and multi-task scalability.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 21 of its 38 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
21 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2025Multivariate Conformal Selection1 May
- 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees16 May
Other references · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2024Large language model validity via enhanced conformal prediction methodscited by 91
- 2022Selection by Prediction with Conformal p-valuescited by 66
- 2025Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agentscited by 37
- 2023Model-free selective inference under covariate shift via weighted conformal p-valuescited by 26
- 2024Conformal Prediction with Learned Featurescited by 23
- 2024Conformal Prediction for Causal Effects of Continuous Treatmentscited by 19
7 more
- 2024Optimized Conformal Selection: Powerful Selective Inference After Conformity Score Optimizationcited by 11
- 2025Conformal Prediction as Bayesian Quadraturecited by 6
- 2025Selection from Hierarchical Data with Conformal e-valuescited by 5
- 2024Optimal Aggregation of Prediction Intervals under Unsupervised Domain Shiftcited by 4
- 2025Diversifying Conformal Selectionscited by 4
- 2025One Sample is Enough to Make Conformal Prediction Robustcited by 4
- 2025Revamping Conformal Selection With Optimal Power: A Neyman--Pearson Perspectivecited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Provable Training Data Identification for Large Language Modelscited by 1
- 2026Beyond Fixed False Discovery Rates: Post-Hoc Conformal Selection with E-Variablescited by 1
- 2026Provable Joint Decontamination for Benchmarking Multiple Large Language Modelscited by 0
- 2026Null-Calibrated Conformal Selection via Target-Membership Scorescited by 0
- 2026Null-Calibrated Conformal Selection via Target-Membership Scores21 Jun 2026
- 2026Provable Joint Decontamination for Benchmarking Multiple Large Language Models20 May 2026
- 2026Beyond Fixed False Discovery Rates: Post-Hoc Conformal Selection with E-Variables13 Apr 2026
- 2025Provable Training Data Identification for Large Language Models10 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Robust Conformalized Selection with Noisy Responses
- 2025Conformal P-Value in Multiple-Choice Question Answering Tasks with Provable Risk Control
- 2024Rethinking Data Selection at Scale: Random Selection is Almost All You Need
- 2025Monte Carlo Tree Diffusion with Multiple Experts for Protein Design
- 2025Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
- 2026Conditional Factuality Controlled LLMs with Generalization Certificates via Conformal Sampling
- 2026Aligning the Query Space: Greedy Information Projection for Language Model Data Selection
- 2026Ranking-Aware Prompt Optimization for Multimodal Clinical Diagnosis