Large-Scale Optimization Model Auto-Formulation: Harnessing LLM Flexibility via Structured Workflow
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large-scale optimization is a key backbone of modern business decision-making. However, building these models is often labor-intensive and time-consuming. We address this by proposing LEAN-LLM-OPT, a LightwEight AgeNtic workflow construction framework for LLM-assisted large-scale OPTimization auto-formulation. LEAN-LLM-OPT takes as input a problem description together with associated datasets and orchestrates a team of LLM agents to produce an optimization formulation. Specifically, upon receiving a query, two upstream LLM agents dynamically construct a workflow that specifies, step-by-step, how optimization models for similar problems can be formulated. A downstream LLM agent then follows this workflow to generate the final output. The agentic workflow leverages common modeling practices to structure the modeling process into a sequence of sub-tasks, offloading mechanical data-handling operations to auxiliary tools. This reduces the LLM's burden in planning and data handling, allowing us to exploit its flexibility to address unstructured components. Extensive simulations show that LEAN-LLM-OPT, instantiated with GPT-4.1 and the open source gpt-oss-20B, achieves strong performance on large-scale optimization modeling tasks and is competitive with state-of-the-art approaches. In addition, in a Singapore Airlines choice-based revenue management use case, LEAN-LLM-OPT demonstrates practical value by achieving leading performance across a range of scenarios. Along the way, we introduce Large-Scale-OR and Air-NRM, the first comprehensive benchmarks for large-scale optimization auto-formulation. The code and data of this work is available at https://github.com/CoraLiang01/lean-llm-opt.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. First posted on arXiv 14 Jan 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026OptiRepair: Closed-Loop Diagnosis and Repair of Supply Chain Optimization Models with LLM Agentscited by 4
- 2026FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimizationcited by 4
- 2026Let's Have a Conversation: Designing and Evaluating LLM Agents for Interactive Optimizationcited by 2
- 2026OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillationcited by 2
- 2026Automated Reformulation of Robust Optimization via Memory-Augmented Large Language Modelscited by 1
- 2026Text2Model: Modeling Copilots for Text-to-Model Translationcited by 0
- 2026Learn2Zinc: Fine-tuning Small Language Models for Text-to-Model Translation in MiniZinccited by 0
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modelingcited by 0
- 2026Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimizationcited by 0
- 2026OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modelingcited by 0
- 2026OR for AI That Does OR: Routing LLMs up the Escalator inside the OSCAR Frameworkcited by 0
- 2026OR for AI That Does OR: Routing LLMs up the Escalator inside the OSCAR Framework1 Oct 2026
- 2026OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling19 Sep 2026
- 2026Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization4 Sep 2026
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling16 Aug 2026
- 2026OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation28 May 2026
- 2026FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization24 May 2026
- 2026Learn2Zinc: Fine-tuning Small Language Models for Text-to-Model Translation in MiniZinc14 May 2026
- 2026Automated Reformulation of Robust Optimization via Memory-Augmented Large Language Models12 May 2026
- 2026Text2Model: Modeling Copilots for Text-to-Model Translation14 Apr 2026
- 2026Let's Have a Conversation: Designing and Evaluating LLM Agents for Interactive Optimization3 Apr 2026
- 2026OptiRepair: Closed-Loop Diagnosis and Repair of Supply Chain Optimization Models with LLM Agents23 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Opti-Agent-Bench: Benchmarking End-to-End Optimization R&D Agents on Real-World Business Problems
- 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
- 2026Democratizing Large-Scale Re-Optimization with LLM-Guided Model Patches
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agents
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2025Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows
- 2026ORPilot: A Production-Oriented Agentic LLM-for-OR Tool for Optimization Modeling