Beyond Objective Equivalence: Constraint Injection for LLM-Based Optimization Modeling on Vehicle Routing Problems
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) can generate executable solver code from natural-language descriptions of optimization problems. However, existing verification signals focus on whether the generated formulation produces the correct objective value. Such signals can overlook constraint-level errors: incorrect formulations may still produce the same optimum when extra or missing constraints do not affect the tested instance. We propose constraint injection, a verification method that directly tests whether the generated code implements the intended constraints. We use feasible solutions to detect incorrectly added constraints and one-constraint-violating solutions to detect omissions. Together with the optimal value check, these tests verify both the objective and the constraint set. We evaluate this approach on vehicle routing problems (VRPs), which provide a challenging testbed with diverse, tightly coupled operational constraints. We develop VRPCoder, an 8B model for generating Gurobi code from natural-language VRP descriptions, and VRPBench, an expert-verified benchmark spanning 21 VRP variants across four subsets. The verifier serves as a rejection-sampling criterion for synthetic data construction and as a rollout-level reward for reinforcement learning (RL). On VRPBench, VRPCoder-RL reaches 93% overall Pass@1, outperforms Gemini-3.1-Pro Preview on three subsets, exceeds Claude-Sonnet-4.5 by 28 percentage points, and exceeds the strongest prior OR-LLM by 78 percentage points.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
15 of 38 references.
References · 15
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2025Large Language Models as End-to-end Combinatorial Optimization Solverscited by 27
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
3 more
- 2025OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learningcited by 16
- 2025OptiMind: Teaching LLMs to Think Like Optimization Expertscited by 9
- 2026Reasoning in a Combinatorial and Constrained World: Benchmarking LLMs on Natural-Language Combinatorial Optimizationcited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ConstraintBench: Benchmarking LLM Constraint Reasoning on Direct Optimization
- 2025An Agentic Framework with LLMs for Solving Complex Vehicle Routing Problems
- 2026Improving Constraint Models with LLM Agents
- 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
- 2025A Large Language Model-Enhanced Q-learning for Capacitated Vehicle Routing Problem with Time Windows
- 2025ACCORD: Autoregressive Constraint-satisfying Generation for COmbinatorial Optimization with Routing and Dynamic attention