mlsanityData to 7 Oct 2026

Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling

arXiv 2608.15565 ↗First posted 16 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Agents that learn from experience improve at optimization modeling by storing solved trajectories and reusing them as skills. A wrong trajectory that enters the library can be retrieved again and again, and on a stream of new problems there is no ground-truth answer to decide with. Existing learners admit trajectories by matching known optima or labels, and label-free substitutes such as execution success or agreement at one instance can admit wrong models. We introduce ADMITOR, a label-free admission gate. It generates models from three model families, runs each on the stated problem and on instances with resampled parameters, keeps the largest group of models whose optimal values agree on every instance across families, and applies a threshold fitted on solver-verified problems to accept, abstain, or escalate, with a finite-sample bound on the false-discovery rate among accepted values. Inside a state-of-the-art skill learner, ADMITOR raises candidate-level admission precision to 0.927, against 0.871 for majority vote over the host's own samples and 0.726 for execution success, and its library, the smallest of the four, reaches the highest macro accuracy over five public benchmarks, 58.4 against 54.8 for majority vote. An ablation on the same records shows that the gain comes from the accepted value being external to the learner and unanimous across families; on this stream, resampling never changed an accepted value and only reduced coverage. The false-discovery bound holds on the calibration set but not on the benchmark stream: an audit of every false certificate traces most of them to benchmark texts that omit or round the numbers needed to reproduce the labeled answer, and a label-free check of the extracted numbers against the text flags most of these cases.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

27 of 32 references.

References · 27

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  4. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  5. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
  6. 2023Universal Self-Consistency for Large Language Model Generationcited by 198
  7. 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 111
  8. 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 105
  9. 2022Selection by Prediction with Conformal p-valuescited by 66
  10. 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
  11. 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
  12. 2024Smoothie: Label Free Language Model Routingcited by 31
15 more
  1. 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
  2. 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 12
  3. 2026Large-Scale Optimization Model Auto-Formulation: Harnessing LLM Flexibility via Structured Workflowcited by 11
  4. 2025SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modelingcited by 8
  5. 2026ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimizationcited by 8
  6. 2026More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judgescited by 6
  7. 2026Opt-Verifier: Unleashing the Power of LLMs for Optimization Modeling via Dual-Side Verificationcited by 5
  8. 2026Routing with Generated Data: Annotation-Free LLM Skill Estimation and Expert Selectioncited by 4
  9. 2026From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modelingcited by 3
  10. 2026OptArgus: A Multi-Agent System to Detect Hallucinations in LLM-based Optimization Modelingcited by 3
  11. 2026OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillationcited by 2
  12. 2026LLMs as a Jury: Cross-Model Consensus Can Outperform Process Reward Models for LLM Reasoningcited by 2
  13. 2026VeriSimpl: Robust Optimization Modeling from Natural Language using Simplification-based Verificationcited by 2
  14. 2026Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limitscited by 1
  15. 2026OptGraph: Large Language Models Enhanced Evolutionary Optimization Via Graph Retrieval-Augmented Generationcited by 1

Built on by

Not cited yet.