mlsanityData to 7 Oct 2026

From Large Language Models and Optimization to Decision Optimization CoPilot: A Research Manifesto

arXiv 2402.16269 ↗First posted 26 Feb 2024cs.AI cs.LG math.OCcited by 11

Not on the map. Why?

Abstract (arXiv)

Significantly simplifying the creation of optimization models for real-world business problems has long been a major goal in applying mathematical optimization more widely to important business and societal decisions. The recent capabilities of Large Language Models (LLMs) present a timely opportunity to achieve this goal. Therefore, we propose research at the intersection of LLMs and optimization to create a Decision Optimization CoPilot (DOCP) - an AI tool designed to assist any decision maker, interacting in natural language to grasp the business problem, subsequently formulating and solving the corresponding optimization model. This paper outlines our DOCP vision and identifies several fundamental requirements for its implementation. We describe the state of the art through a literature survey and experiments using ChatGPT. We show that a) LLMs already provide substantial novel capabilities relevant to a DOCP, and b) major research challenges remain to be addressed. We also propose possible research directions to overcome these gaps. We also see this work as a call to action to bring together the LLM and optimization communities to pursue our vision, thereby enabling much more widespread improved decision-making.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

41 of 52 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2023Let's Verify Step by Stepcited by 3,598
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  11. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  12. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
29 more
  1. 2020Learning to summarize from human feedbackcited by 2,562
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  3. 2024Mixtral of Expertscited by 1,785
  4. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  5. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  6. 2023Large Language Models as Optimizerscited by 830
  7. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  8. 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
  9. 2022Autoformalization with Large Language Modelscited by 252
  10. 2023Large Language Model Guided Tree-of-Thoughtcited by 218
  11. 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
  12. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
  13. 2023Large Language Models for Supply Chain Optimizationcited by 61
  14. 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
  15. 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 48
  16. 2023OptiMUS: Optimization Modeling Using MIP Solvers and large language modelscited by 39
  17. 2018The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solverscited by 31
  18. 2023Diagnosing Infeasible Optimization Problems Using Large Language Modelscited by 27
  19. 2022Lookback for Learning to Branchcited by 26
  20. 2023Holy Grail 2.0: From Natural Language to Constraint Modelscited by 24
  21. 2022A Deep Reinforcement Learning Framework For Column Generationcited by 21
  22. 2023Synthesizing mixed-integer linear programming models from natural language descriptionscited by 18
  23. 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
  24. 2022A Survey in Mathematical Language Processingcited by 9
  25. 2022Highlighting Named Entities in Input for Auto-Formulation of Optimization Problemscited by 8
  26. 2023A Novel Approach for Auto-Formulation of Optimization Problemscited by 7
  27. 2022Tag Embedding and Well-defined Intermediate Representation improve Auto-Formulation of Problem Descriptioncited by 5
  28. 2023Towards an Automatic Optimisation Model Generator Assisted with Generative Pre-trained Transformercited by 5
  29. 2023Language Models for Business Optimisation with a Real World Case Study in Production Schedulingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 3.

11 papers.