A Novel Approach for Auto-Formulation of Optimization Problems
Not on the map. Why?
Abstract (arXiv)
In the Natural Language for Optimization (NL4Opt) NeurIPS 2022 competition, competitors focus on improving the accessibility and usability of optimization solvers, with the aim of subtask 1: recognizing the semantic entities that correspond to the components of the optimization problem; subtask 2: generating formulations for the optimization problem. In this paper, we present the solution of our team. First, we treat subtask 1 as a named entity recognition (NER) problem with the solution pipeline including pre-processing methods, adversarial training, post-processing methods and ensemble learning. Besides, we treat subtask 2 as a generation problem with the solution pipeline including specially designed prompts, adversarial training, post-processing methods and ensemble learning. Our proposed methods have achieved the F1-score of 0.931 in subtask 1 and the accuracy of 0.867 in subtask 2, which won the fourth and third places respectively in this competition. Our code is available at https://github.com/bigdata-ustc/nl4opt.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 9 Feb 2023.
Builds on
7 of 14 references.
References · 7
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2023Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-trainingcited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 3.
7 papers.
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2023Holy Grail 2.0: From Natural Language to Constraint Modelscited by 24
- 2024From Large Language Models and Optimization to Decision Optimization CoPilot: A Research Manifestocited by 11
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solvingcited by 9
- 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Taskscited by 8
- 2025Optimization Problem Solving Can Transition to Evolutionary Agentic Workflowscited by 0
- 2025CP-Model-Zoo: A Natural Language Query System for Constraint Programming Modelscited by 0
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving10 Sep 2025
- 2025CP-Model-Zoo: A Natural Language Query System for Constraint Programming Models9 Sep 2025
- 2025Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows7 May 2025
- 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Tasks29 Oct 2024
- 2024From Large Language Models and Optimization to Decision Optimization CoPilot: A Research Manifesto26 Feb 2024
- 2023Holy Grail 2.0: From Natural Language to Constraint Models3 Aug 2023
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptions14 Mar 2023