OptiVerse: A Comprehensive Benchmark towards Optimization Problem Solving
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
While Large Language Models (LLMs) demonstrate remarkable reasoning, complex optimization tasks remain challenging, requiring domain knowledge and robust implementation. However, existing benchmarks focus narrowly on Mathematical Programming and Combinatorial Optimization, hindering comprehensive evaluation. To address this, we introduce OptiVerse, a comprehensive benchmark of 1,000 curated problems spanning neglected domains, including Stochastic Optimization, Dynamic Optimization, Game Optimization, and Optimal Control, across three difficulty levels: Easy, Medium, and Hard. The experiments with 22 LLMs of different sizes reveal sharp performance degradation on hard problems, where even advanced models like GPT-5.2 and Gemini-3 struggle to exceed 27% accuracy. Through error analysis, we identify that modeling & logic errors remain the primary bottleneck. Consequently, we propose a Dual-View Auditor Agent that improves the accuracy of the LLM modeling process without introducing significant time overhead. OptiVerse will serve as a foundational platform for advancing LLMs in solving complex optimization challenges.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 16 of its 40 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
16 of 40 references.
Closest ancestors · 2
Same direction, newest first
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modeling25 Oct
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modeling13 Jul
Other references · 14
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2021Convex optimizationcited by 2,515
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 59
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 57
- 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 49
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 45
2 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modeling
- 2026ConstraintBench: Benchmarking LLM Constraint Reasoning on Direct Optimization
- 2025OptiMind: Teaching LLMs to Think Like Optimization Experts
- 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
- 2026Opti-Agent-Bench: Benchmarking End-to-End Optimization R&D Agents on Real-World Business Problems
- 2026FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization