OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation
Not on the map. Why?
Abstract (arXiv)
Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimization. However, existing methods still exhibit limited generalization: they are sensitive to superficial narrative variations, reuse experience mainly at the case level, and struggle to adapt to shifted or emerging problem types. We propose OptSkills, an archetype-centric skill learning and reasoning agent system for optimization modeling and solving. To improve robust generalization, our system clusters problems by their underlying archetypes rather than surface narratives. To improve in-distribution generalization, it explores diverse modeling paradigms and solver configurations within each cluster, then distills successful trajectories into reusable workflow-level skills. To improve out-of-distribution generalization, it refines existing skills or expands the skill library using newly obtained trajectories. Our system achieves a state-of-the-art micro-averaged accuracy of 68.27% on datasets encompassing diverse problem types and scenarios. In addition, on MIPLIB-NL, a highly challenging large-scale and high-dimensional benchmark, it achieves 26.91% accuracy, outperforming DeepSeek-V3.2-Thinking by 4.53%. After skill learning on Nano-CO, it reaches 72.79% on the OOD NLCO benchmark. Code and skills are available at https://github.com/fujiwaranoM0kou/OptSkills.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 101 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
23 of 101 references.
References · 23
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2026Memento-Skills: Let Agents Design Agentscited by 56
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
- 2024LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generationcited by 45
11 more
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2025OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learningcited by 16
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 12
- 2026Large-Scale Optimization Model Auto-Formulation: Harnessing LLM Flexibility via Structured Workflowcited by 11
- 2025ORMind: A Cognitive-Inspired End-to-End Reasoning Framework for Operations Researchcited by 10
- 2025ConstraintLLM: A Neuro-Symbolic Framework for Industrial-Level Constraint Programmingcited by 10
- 2026Constructing Industrial-Scale Optimization Modeling Benchmarkcited by 10
- 2026Reasoning in a Combinatorial and Constrained World: Benchmarking LLMs on Natural-Language Combinatorial Optimizationcited by 9
- 2025ORThought: Benchmarking and Automating Logistics Optimization Modelingcited by 4
- 2026MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Researchcited by 2
- 2026AutoOR: Scalably Post-training LLMs to Autoformulate Operations Research Problemscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.