mlsanityData to 7 Oct 2026

Multi-Condition Conformal Selection

arXiv 2510.08075 ↗First posted 9 Oct 2025cs.AIcited by 4

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Selecting high-quality candidates from large-scale datasets is critically important in resource-constrained applications such as drug discovery, precision medicine, and the alignment of large language models. While conformal selection methods offer a rigorous solution with False Discovery Rate (FDR) control, their applicability is confined to single-threshold scenarios (i.e., y > c) and overlooks practical needs for multi-condition selection, such as conjunctive or disjunctive conditions. In this work, we propose the Multi-Condition Conformal Selection (MCCS) algorithm, which extends conformal selection to scenarios with multiple conditions. In particular, we introduce a novel nonconformity score with regional monotonicity for conjunctive conditions and a global Benjamini-Hochberg (BH) procedure for disjunctive conditions, thereby establishing finite-sample FDR control with theoretical guarantees. The integration of these components enables the proposed method to achieve rigorous FDR-controlled selection in various multi-condition environments. Extensive experiments validate the superiority of MCCS over baselines, its generalizability across diverse condition combinations, different real-world modalities, and multi-task scalability.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 21 of its 38 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

21 of 38 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Multivariate Conformal Selection1 May
  2. 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees16 May

Other references · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  5. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  6. 2021Testing for Outliers with Conformal p-valuescited by 133
  7. 2024Large language model validity via enhanced conformal prediction methodscited by 91
  8. 2022Selection by Prediction with Conformal p-valuescited by 66
  9. 2025Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agentscited by 37
  10. 2023Model-free selective inference under covariate shift via weighted conformal p-valuescited by 26
  11. 2024Conformal Prediction with Learned Featurescited by 23
  12. 2024Conformal Prediction for Causal Effects of Continuous Treatmentscited by 19
7 more
  1. 2024Optimized Conformal Selection: Powerful Selective Inference After Conformity Score Optimizationcited by 11
  2. 2025Conformal Prediction as Bayesian Quadraturecited by 6
  3. 2025Selection from Hierarchical Data with Conformal e-valuescited by 5
  4. 2024Optimal Aggregation of Prediction Intervals under Unsupervised Domain Shiftcited by 4
  5. 2025Diversifying Conformal Selectionscited by 4
  6. 2025One Sample is Enough to Make Conformal Prediction Robustcited by 4
  7. 2025Revamping Conformal Selection With Optimal Power: A Neyman--Pearson Perspectivecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Robust Conformalized Selection with Noisy Responses
  2. 2025Conformal P-Value in Multiple-Choice Question Answering Tasks with Provable Risk Control
  3. 2024Rethinking Data Selection at Scale: Random Selection is Almost All You Need
  4. 2025Monte Carlo Tree Diffusion with Multiple Experts for Protein Design
  5. 2025Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
  6. 2026Conditional Factuality Controlled LLMs with Generalization Certificates via Conformal Sampling
  7. 2026Aligning the Query Space: Greedy Information Projection for Language Model Data Selection
  8. 2026Ranking-Aware Prompt Optimization for Multimodal Clinical Diagnosis