mlsanityData to 14 Oct 2026

EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling

arXiv 2606.26578 ↗First posted 25 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automating optimization modeling from natural language with large language models (LLMs) faces two key challenges. First, training corpora lack structural diversity. Second, data generation pipelines remain static and decoupled from model learning. To address these challenges, we propose EvoOptiGraph, a novel framework where data and model co-evolve, driven by model weaknesses. EvoOptiGraph represents each mixed-integer linear program (MILP) as an attributed bipartite graph and applies validity-preserving evolutionary operators to generate structurally diverse instances. The evolved graphs are converted into solver code and natural language via deterministic compilation and verified back-translation. Training proceeds in two stages: supervised fine-tuning (SFT) on an initial dataset, followed by reinforcement learning with verifiable rewards (RLVR), where graph-derived weakness signals guide the generation of new instances targeting the model's failures. This forms a closed loop that continuously updates the training distribution. Empirical results on six public datasets show that EvoOptiGraph significantly outperforms larger generalist models, agentic methods, and specialized baselines in accuracy, executability, and generalization. These results demonstrate that targeted data-model coevolution is an effective strategy for improving LLMs on optimization modeling tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

29 of 51 references.

References · 29

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  8. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
  9. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
  10. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
  11. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
  12. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
17 more
  1. 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 109
  2. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
  3. 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
  4. 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 49
  5. 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
  6. 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 45
  7. 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38
  8. 2024Towards Foundation Models for Mixed Integer Linear Programmingcited by 31
  9. 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 31
  10. 2024Process Supervision-Guided Policy Optimization for Code Generationcited by 26
  11. 2025Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoningcited by 23
  12. 2023A Deep Instance Generative Framework for MILP Solvers Under Limited Data Availabilitycited by 21
  13. 2024MILP-StuDio: MILP Instance Generation via Block Structure Decompositioncited by 17
  14. 2026Constructing Industrial-Scale Optimization Modeling Benchmarkcited by 12
  15. 2025SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modelingcited by 8
  16. 2026From Verifiable Dot to Reward Chain: Harnessing Verifiable Reference-based Rewards for Reinforcement Learning of Open-ended Generationcited by 6
  17. 2025Are Your Generated Instances Truly Useful? GenBench-MILP: A Benchmark Suite for MILP Instance Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OptGraph: Large Language Models Enhanced Evolutionary Optimization Via Graph Retrieval-Augmented Generation
  2. 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
  3. 2025CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Design
  4. 2026What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search
  5. 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
  6. 2026Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling
  7. 2026Large Language Model-Powered Evolutionary Code Optimization on a Phylogenetic Tree
  8. 2026GraphSkillEvo: Evolutionary Optimization of Graph-Structured Agent Skills