SemOPT: Fixing Semantic Errors in LLM-based Optimization Modeling via Reward-Guided Search
On the map: LLM alignment / RLHF / preference optimisation → Process reward models for reasoning
Abstract (arXiv)
Operations research supports decision-making in domains such as energy, economics, and healthcare. Solving operations research problems typically begins with optimization modeling, which translates a natural-language problem description into executable solver code. LLMs offer a promising way to automate this process, but they remain prone to errors. In practice, these errors can be divided into two categories: syntactic errors refer to solver code that fails to run successfully or is judged infeasible by the solver; semantic errors refer to solver code that successfully returns an objective value but violates the intent of the original problem. Since semantic errors do not trigger runtime failures, they are difficult to detect and rectify. To address this problem, we introduce SemOPT, a semantic-guided framework for correcting LLM-based optimization models. SemOPT combines a semantic reward model that distinguishes faithful math models from plausible but incorrect ones with an adaptive correction system that applies hierarchical reward-guided search over the modeling space. Experiments on seven optimization modeling benchmarks show that SemOPT establishes a new state of the art and achieves an average 7.6% accuracy improvement over the strongest baseline on complex datasets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Process reward models for reasoning, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 19 of its 34 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
19 of 34 references.
Closest ancestors · 1
Same direction, newest first
- 2024SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction11 Oct
Other references · 18
- 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 223
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 68
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 45
- 2025Dynamic Parallel Tree Search for Efficient LLM Reasoningcited by 42
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
- 2025SolverLLM: Leveraging Test-Time Scaling for Optimization Problem via LLM-Guided Searchcited by 10
6 more
- 2025MITS: Enhanced Tree Search Reasoning for LLMs via Pointwise Mutual Informationcited by 8
- 2025SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modelingcited by 8
- 2024Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairscited by 4
- 2026OptiVerse: A Comprehensive Benchmark towards Optimization Problem Solvingcited by 3
- 2025A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generationcited by 2
- 2025SemGuard: Real-Time Semantic Evaluator for Correcting LLM-Generated Codecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
- 2026OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling
- 2026ConstraintBench: Benchmarking LLM Constraint Reasoning on Direct Optimization
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library
- 2025OptiMind: Teaching LLMs to Think Like Optimization Experts
- 2026Step-by-Step Optimization-like Reasoning in LLMs over Expanding Search Spaces
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modeling