From Large Language Models and Optimization to Decision Optimization CoPilot: A Research Manifesto
Not on the map. Why?
Abstract (arXiv)
Significantly simplifying the creation of optimization models for real-world business problems has long been a major goal in applying mathematical optimization more widely to important business and societal decisions. The recent capabilities of Large Language Models (LLMs) present a timely opportunity to achieve this goal. Therefore, we propose research at the intersection of LLMs and optimization to create a Decision Optimization CoPilot (DOCP) - an AI tool designed to assist any decision maker, interacting in natural language to grasp the business problem, subsequently formulating and solving the corresponding optimization model. This paper outlines our DOCP vision and identifies several fundamental requirements for its implementation. We describe the state of the art through a literature survey and experiments using ChatGPT. We show that a) LLMs already provide substantial novel capabilities relevant to a DOCP, and b) major research challenges remain to be addressed. We also propose possible research directions to overcome these gaps. We also see this work as a call to action to bring together the LLM and optimization communities to pursue our vision, thereby enabling much more widespread improved decision-making.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 26 Feb 2024.
Builds on
41 of 52 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
29 more
- 2020Learning to summarize from human feedbackcited by 2,562
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2024Mixtral of Expertscited by 1,785
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Large Language Models as Optimizerscited by 830
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
- 2022Autoformalization with Large Language Modelscited by 252
- 2023Large Language Model Guided Tree-of-Thoughtcited by 218
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2023Large Language Models for Supply Chain Optimizationcited by 61
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 48
- 2023OptiMUS: Optimization Modeling Using MIP Solvers and large language modelscited by 39
- 2018The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solverscited by 31
- 2023Diagnosing Infeasible Optimization Problems Using Large Language Modelscited by 27
- 2022Lookback for Learning to Branchcited by 26
- 2023Holy Grail 2.0: From Natural Language to Constraint Modelscited by 24
- 2022A Deep Reinforcement Learning Framework For Column Generationcited by 21
- 2023Synthesizing mixed-integer linear programming models from natural language descriptionscited by 18
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
- 2022A Survey in Mathematical Language Processingcited by 9
- 2022Highlighting Named Entities in Input for Auto-Formulation of Optimization Problemscited by 8
- 2023A Novel Approach for Auto-Formulation of Optimization Problemscited by 7
- 2022Tag Embedding and Well-defined Intermediate Representation improve Auto-Formulation of Problem Descriptioncited by 5
- 2023Towards an Automatic Optimisation Model Generator Assisted with Generative Pre-trained Transformercited by 5
- 2023Language Models for Business Optimisation with a Real World Case Study in Production Schedulingcited by 4
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 3.
11 papers.
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
- 2025EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulationscited by 9
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solvingcited by 9
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimizationcited by 8
- 2026DRAGON: LLM-Driven Decomposition and Reconstruction Agents for Large-Scale Combinatorial Optimizationcited by 3
- 2026ORPilot: A Production-Oriented Agentic LLM-for-OR Tool for Optimization Modelingcited by 2
- 2025Teaching LLMs to Think Mathematically: A Critical Study of Decision-Making via Optimizationcited by 1
- 2025Hierarchical Optimization via LLM-Guided Objective Evolution for Mobility-on-Demand Systemscited by 1
- 2025SOLID: a Framework of Synergizing Optimization and LLMs for Intelligent Decision-Makingcited by 1
- 2026Learning to Optimize through Solver-Grounded Self-Playcited by 0
- 2026Learning to Optimize through Solver-Grounded Self-Play28 Sep 2026
- 2026ORPilot: A Production-Oriented Agentic LLM-for-OR Tool for Optimization Modeling4 May 2026
- 2026DRAGON: LLM-Driven Decomposition and Reconstruction Agents for Large-Scale Combinatorial Optimization10 Jan 2026
- 2025SOLID: a Framework of Synergizing Optimization and LLMs for Intelligent Decision-Making19 Nov 2025
- 2025Hierarchical Optimization via LLM-Guided Objective Evolution for Mobility-on-Demand Systems12 Oct 2025
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving10 Sep 2025
- 2025Teaching LLMs to Think Mathematically: A Critical Study of Decision-Making via Optimization25 Aug 2025
- 2025EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulations20 Feb 2025
- 2024A Systematic Survey on Large Language Models for Algorithm Design11 Oct 2024
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimization22 Aug 2024
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scale29 Jul 2024