IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) can translate natural-language optimization problems into solver-ready formulations, but direct code generation is brittle: schema, indexing, and semantic errors can cause compilation failures, infeasible models, or incorrect objectives, while iterative repair, search, and multi-agent workflows increase inference cost. We present IR2Solve, an intermediate-representation-first autoformulation pipeline that uses a single semantic LLM call to produce a schema-constrained ModelIR, followed by two deterministic stages: verification and IR-to-solver compilation. ModelIR explicitly represents sets, parameters, variables, objectives, and constraints using restricted Python-like expression strings. A concrete scalar-constraint convention represents finite per-index constraint families as individual entries, reducing free-index and implicit-quantification errors while simplifying downstream verification and compilation. Across six cleaned optimization benchmarks, IR2Solve achieves strong objective correctness and remains competitive with recent optimization-modeling systems. A controlled ablation on 153 IndustryOR and ComplexLP instances shows sequential gains from the structured IR interface, the scalar-constraint instruction, and deterministic verification. On a matched ten-instance cost panel, IR2Solve uses one semantic call per instance, whereas Chain-of-Experts and SAC-Opt use 8 and 39 calls per instance and consume 3.3 and 22.9 times the token volume of IR2Solve, respectively. These results show that structured intermediate representations, combined with deterministic post-generation processing, provide a practical accuracy-cost trade-off for LLM-based optimization autoformulation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
14 of 22 references.
References · 14
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
- 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
- 2025SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modelingcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation
- 2026AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modeling
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
- 2025LLMize: A Framework for Large Language Model-Based Numerical Optimization
- 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving