Canonical Intermediate Representation for LLM-based optimization problem formulation and code generation
Not on the map. Why?
Abstract (arXiv)
Automatically formulating optimization models from natural language descriptions is a growing focus in operations research, yet current LLM-based approaches struggle with the composite constraints and appropriate modeling paradigms required by complex operational rules. To address this, we introduce the Canonical Intermediate Representation (CIR): a schema that LLMs explicitly generate between problem descriptions and optimization models. CIR encodes the semantics of operational rules through constraint archetypes and candidate modeling paradigms, thereby decoupling rule logic from its mathematical instantiation. Upon a newly generated CIR knowledge base, we develop the rule-to-constraint (R2C) framework, a multi-agent pipeline that parses problem texts, synthesizes CIR implementations by retrieving domain knowledge, and instantiates optimization models. To systematically evaluate rule-to-constraint reasoning, we test R2C on our newly constructed benchmark featuring rich operational rules, and benchmarks from prior work. Extensive experiments show that R2C achieves state-of-the-art accuracy on the proposed benchmark (47.2% Accuracy Rate). On established benchmarks from the literature, R2C delivers highly competitive results, approaching the performance of proprietary models (e.g., GPT-5). Moreover, with a reflection mechanism, R2C achieves further gains and sets new best-reported results on some benchmarks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 53 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
24 of 53 references.
References · 24
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2021Retrieval Augmented Code Generation and Summarizationcited by 148
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
12 more
- 2022ReACC: A Retrieval-Augmented Code Completion Frameworkcited by 117
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2020Entities as Experts: Sparse Memory Access with Entity Supervisioncited by 100
- 2022Repair Is Nearly Generation: Multilingual Program Repair with LLMscited by 68
- 2023Large Language Models for Supply Chain Optimizationcited by 61
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2023Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preferencecited by 37
- 2025Auto-Formulating Dynamic Programming Problems with Large Language Modelscited by 15
- 2024AutoSAT: Automatically Optimize SAT Solvers via Large Language Modelscited by 14
- 2024Robust and Adaptive Optimization under a Large Language Model Lenscited by 8
- 2025OptiChat: Bridging Optimization Models and Practitioners with Large Language Modelscited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.