SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modeling
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have opened new paradigms in optimization modeling by enabling the generation of executable solver code from natural language descriptions. Despite this promise, existing approaches typically remain solver-driven: they rely on single-pass forward generation and apply limited post-hoc fixes based on solver error messages, leaving undetected semantic errors that silently produce syntactically correct but logically flawed models. To address this challenge, we propose SAC-Opt, a backward-guided correction framework that grounds optimization modeling in problem semantics rather than solver feedback. At each step, SAC-Opt aligns the original semantic anchors with those reconstructed from the generated code and selectively corrects only the mismatched components, driving convergence toward a semantically faithful model. This anchor-driven correction enables fine-grained refinement of constraint and objective logic, enhancing both fidelity and robustness without requiring additional training or supervision. Empirical results on seven public datasets demonstrate that SAC-Opt improves average modeling accuracy by 7.7%, with gains of up to 21.9% on the ComplexLP dataset. These findings highlight the importance of semantic-anchored correction in LLM-based optimization workflows to ensure faithful translation from problem intent to solver-executable code.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
29 of 43 references.
References · 29
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 105
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2020Evolution of Semantic Similarity -- A Surveycited by 83
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
17 more
- 2023Large Language Models for Supply Chain Optimizationcited by 61
- 2024Can You Trust LLM Judgments? Reliability of LLM-as-a-Judgecited by 52
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
- 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
- 2024A Theoretical Understanding of Self-Correction through In-context Alignmentcited by 43
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
- 2024Towards Foundation Models for Mixed Integer Linear Programmingcited by 30
- 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
- 2023Holy Grail 2.0: From Natural Language to Constraint Modelscited by 24
- 2024When Large Language Model Meets Optimizationcited by 22
- 2024Solving General Natural-Language-Description Optimization Problems with Large Language Modelscited by 22
- 2024To the Globe (TTG): Towards Language-Driven Guaranteed Travel Planningcited by 21
- 2022Cardinal Optimizer (COPT) User Guidecited by 16
- 2025Decision Information Meets Large Language Models: The Future of Explainable Operations Researchcited by 9
- 2025Self-Correction Makes LLMs Better Parserscited by 4
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimizationcited by 8
- 2026TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modelingcited by 2
- 2026StarOR: Synergizing Tree Search and Test-Time Reinforcement Learning for Optimization Modelingcited by 0
- 2026Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontierscited by 0
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modelingcited by 0
- 2026IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulationcited by 0
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modelingcited by 0
- 2026SemOPT: Fixing Semantic Errors in LLM-based Optimization Modeling via Reward-Guided Searchcited by 0
- 2026SemOPT: Fixing Semantic Errors in LLM-based Optimization Modeling via Reward-Guided Search29 Sep 2026
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling16 Aug 2026
- 2026IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation31 Jul 2026
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling25 Jun 2026
- 2026StarOR: Synergizing Tree Search and Test-Time Reinforcement Learning for Optimization Modeling13 Jun 2026
- 2026TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling12 May 2026
- 2026Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontiers9 Apr 2026
- 2026ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimization17 Feb 2026