OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling
Not on the map. Why?
Abstract (arXiv)
Automated operations research (OR) modeling requires LLMs to translate natural-language decision problems into correct mathematical programs. Existing methods can improve individual formulations, but they often solve problems in isolation, retaining little reusable experience and repeating similar formulation errors. Prior memory-based approaches store examples, thoughts, or insights as references, while OR modeling requires reusable formulation skills that transfer across problem narratives and guide concrete modeling decisions. We propose OptiSkill, a skill-augmented framework that builds a hierarchical and evolving SkillBank for LLM-based OR modeling. SkillBank stores solver-verified experience as reusable skills, with Global Strategies for problem-level formulation skeletons and Step Experiences for local error-prevention rules. It is further refined through stable batch-level test-time evolution, where candidate skills are incorporated only after validation. Experiments on eight OR modeling benchmarks show that OptiSkill improves formulation accuracy across LLM backbones, outperforms strong agentic baselines, and gains further by expanding SkillBank coverage and reliability. Code and data are available at https://github.com/rachhhhing/OptiSkill
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 24 of its 57 references that are in the map. First posted on arXiv 19 Sep 2026.
Builds on
24 of 57 references.
References · 24
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 961
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 842
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 186
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 185
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 180
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 134
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 111
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
- 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 51
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
12 more
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2025Contextual Experience Replay for Self-Improvement of Language Agentscited by 47
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2024Investigate-Consolidate-Exploit: A General Strategy for Inter-Task Agent Self-Evolutioncited by 28
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
- 2025OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learningcited by 17
- 2024BPP-Search: Enhancing Tree of Thought Reasoning for Mathematical Modeling Problem Solvingcited by 15
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 13
- 2026Large-Scale Optimization Model Auto-Formulation: Harnessing LLM Flexibility via Structured Workflowcited by 11
- 2026ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimizationcited by 8
- 2026MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Researchcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025OptiMind: Teaching LLMs to Think Like Optimization Experts
- 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
- 2025Step-Opt: Boosting Optimization Modeling in LLMs through Iterative Data Synthesis and Structured Validation
- 2025OR-LLM-Agent: Automating Modeling and Solving of Operations Research Optimization Problems with Reasoning LLM
- 2026SemOPT: Fixing Semantic Errors in LLM-based Optimization Modeling via Reward-Guided Search
- 2026From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modeling
- 2026ConstraintBench: Benchmarking LLM Constraint Reasoning on Direct Optimization
- 2026COOPA: A Modular LLM Agent Architecture for Operations Research Problems