mlsanityData to 7 Oct 2026

OptiMUS: Optimization Modeling Using MIP Solvers and large language models

arXiv 2310.06116 ↗First posted 9 Oct 2023cs.AIcited by 39

Not on the map. Why?

Abstract (arXiv)

Optimization problems are pervasive across various sectors, from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers, as the expertise required to formulate and solve these problems limits the widespread adoption of optimization tools and techniques. We introduce OptiMUS, a Large Language Model (LLM)-based agent designed to formulate and solve MILP problems from their natural language descriptions. OptiMUS is capable of developing mathematical models, writing and debugging solver code, developing tests, and checking the validity of generated solutions. To benchmark our agent, we present NLP4LP, a novel dataset of linear programming (LP) and mixed integer linear programming (MILP) problems. Our experiments demonstrate that OptiMUS solves nearly twice as many problems as a basic LLM prompting strategy. OptiMUS code and NLP4LP dataset are available at hrefhttps://github.com/teshnizi/OptiMUShttps://github.com/teshnizi/OptiMUS

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 19 of its 46 references that are in the map. First posted on arXiv 9 Oct 2023.

Builds on

19 of 46 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  7. 2021Convex optimizationcited by 2,479
  8. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  9. 2023Large Language Models as Optimizerscited by 830
  10. 2022PAL: Program-aided Language Modelscited by 635
  11. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  12. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
7 more
  1. 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
  2. 2023Mathematical Capabilities of ChatGPTcited by 263
  3. 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
  4. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  5. 2023How well do Large Language Models perform in Arithmetic tasks?cited by 130
  6. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  7. 2023Diagnosing Infeasible Optimization Problems Using Large Language Modelscited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 16; 2026: 13.

39 papers.

Sort:

By area:

  1. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
  2. 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunitiescited by 83
  3. 2024LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generationcited by 45
  4. 2024Large Language Model-Based Evolutionary Optimizer: Reasoning with elitismcited by 27
  5. 2026Automated Optimization Modeling via a Localizable Error-Driven Perspectivecited by 14
  6. 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
  7. 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 12
  8. 2024From Large Language Models and Optimization to Decision Optimization CoPilot: A Research Manifestocited by 11
  9. 2024Leveraging Large Language Models for Solving Rare MIP Challengescited by 10
  10. 2025SolverLLM: Leveraging Test-Time Scaling for Optimization Problem via LLM-Guided Searchcited by 10
  11. 2025OptiChat: Bridging Optimization Models and Practitioners with Large Language Modelscited by 8
  12. 2025LLM-OptiRA: LLM-Driven Optimization of Resource Allocation for Non-Convex Problems in Wireless Communicationscited by 8
27 more
  1. 2025MoE2: Optimizing Collaborative Inference for Edge Large Language Modelscited by 6
  2. 2024City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimizationcited by 5
  3. 2025Large Language Models in Operations Research: Methods, Applications, and Challengescited by 4
  4. 2025CHORUS: Zero-shot Hierarchical Retrieval and Orchestration for Generating Linear Programming Codecited by 3
  5. 2025Ask, Clarify, Optimize: Human-LLM Agent Collaboration for Smarter Inventory Controlcited by 3
  6. 2025Gala: Global LLM Agents for Text-to-Model Translationcited by 2
  7. 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
  8. 2025LISTEN to Your Preferences: An LLM Framework for Multi-Objective Selectioncited by 2
  9. 2026Let's Have a Conversation: Designing and Evaluating LLM Agents for Interactive Optimizationcited by 2
  10. 2026ORPilot: A Production-Oriented Agentic LLM-for-OR Tool for Optimization Modelingcited by 2
  11. 2024Automated Conversion of Static to Dynamic Scheduler via Natural Languagecited by 1
  12. 2024AutoRNet: Automatically Optimizing Heuristics for Robust Network Design via Large Language Modelscited by 1
  13. 2025REMoH: A Reflective Evolution of Multi-objective Heuristics approach via Large Language Modelscited by 1
  14. 2026ModelLens: Finding the Best for Your Task from Myriads of Modelscited by 1
  15. 2026Agentic MIP Research: Accelerated Constraint Handler Generationcited by 1
  16. 2025Leveraging LLM Agents for Automated Optimization Modeling for SASP Problems: A Graph-RAG based Approachcited by 0
  17. 2025Optimization Problem Solving Can Transition to Evolutionary Agentic Workflowscited by 0
  18. 2025LM4Opt-RA: A Multi-Candidate LLM Framework with Structured Ranking for Automating Network Resource Allocationcited by 0
  19. 2025A-LAMP: Agentic LLM-Based Framework for Automated MDP Modeling and Policy Generationcited by 0
  20. 2026EvoOpt-LLM: Evolving industrial optimization models with large language modelscited by 0
  21. 2026Infeasibility Aware Large Language Models for Combinatorial Optimizationcited by 0
  22. 2026Relation Reasoning with LLMs in Expensive Optimizationcited by 0
  23. 2026A2utoLPBench: An Auto-Generated, Agent-Friendly LP Benchmark via Inverse-KKT Constructioncited by 0
  24. 2026LLM-Guided Transportation Hub Capacity Planning with Textual Business Inputscited by 0
  25. 2026Constrained Path Reasoning: Measuring When Committed Stages Earn Their Costcited by 0
  26. 2026Optimization and Constraint Modeling using LLMs with a Retrieval Augmented Generation Processcited by 0
  27. 2026Language-Guided Terrain-Adaptive Neural MPC for Autonomous Traversal of Articulated Tracked Robotscited by 0