mlsanityData to 7 Oct 2026

IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation

arXiv 2608.02641 ↗First posted 31 Jul 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) can translate natural-language optimization problems into solver-ready formulations, but direct code generation is brittle: schema, indexing, and semantic errors can cause compilation failures, infeasible models, or incorrect objectives, while iterative repair, search, and multi-agent workflows increase inference cost. We present IR2Solve, an intermediate-representation-first autoformulation pipeline that uses a single semantic LLM call to produce a schema-constrained ModelIR, followed by two deterministic stages: verification and IR-to-solver compilation. ModelIR explicitly represents sets, parameters, variables, objectives, and constraints using restricted Python-like expression strings. A concrete scalar-constraint convention represents finite per-index constraint families as individual entries, reducing free-index and implicit-quantification errors while simplifying downstream verification and compilation. Across six cleaned optimization benchmarks, IR2Solve achieves strong objective correctness and remains competitive with recent optimization-modeling systems. A controlled ablation on 153 IndustryOR and ComplexLP instances shows sequential gains from the structured IR interface, the scalar-constraint instruction, and deterministic verification. On a matched ten-instance cost panel, IR2Solve uses one semantic call per instance, whereas Chain-of-Experts and SAC-Opt use 8 and 39 calls per instance and consume 3.3 and 22.9 times the token volume of IR2Solve, respectively. These results show that structured intermediate representations, combined with deterministic post-generation processing, provide a practical accuracy-cost trade-off for LLM-based optimization autoformulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

14 of 22 references.

References · 14

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  3. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  4. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
  5. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
  6. 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
  7. 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
  8. 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
  9. 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
  10. 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
  11. 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
  12. 2025SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modelingcited by 8
2 more
  1. 2024City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimizationcited by 5
  2. 2026NEMO: Execution-Aware Optimization Modeling via Autonomous Coding Agentscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation
  2. 2026AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
  3. 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modeling
  4. 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
  5. 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
  6. 2025LLMize: A Framework for Large Language Model-Based Numerical Optimization
  7. 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
  8. 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving