CALM Before the STORM: Unlocking Native Reasoning for Optimization Modeling
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for earlier instruction-tuned models, often fail to exploit the advanced reasoning patterns of modern LRMs -- In particular, we show that direct fine-tuning on traditional textitnon-reflective datasets leads to limited gains. To fully leverage LRMs' inherent reasoning abilities, we propose CALM (textitCorrective Adaptation with Lightweight Modification), a framework that progressively refines LRMs within their native reasoning modes for optimization modeling tasks. In CALM, an expert intervener identifies reasoning flaws and provides concise corrective hints, which the LRM incorporates to produce improved reasoning trajectories. These interventions modify fewer than 2.6% of generated tokens, but generate high-quality data for soft adaptation through supervised fine-tuning. The adapted model is then further improved through reinforcement learning. Building on CALM, we develop STORM (textitSmart Thinking Optimization Reasoning Model), a 4B-parameter LRM that achieves a new state-of-the-art average accuracy of 68.9% across five popular optimization modeling benchmarks, matching the performance of a 671B LRM. These results demonstrate that dynamic, hint-based data synthesis both preserves and amplifies the native reasoning patterns of modern LRMs, offering a more effective and scalable path towards expert-level performance on challenging optimization modeling tasks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 20 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
15 of 20 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024OpenAI o1 System Cardcited by 1,244
- 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 109
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 49
2 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Researchcited by 2
- 2026PEARL: Solver-in-the-Loop Interactive Optimization Modeling from Natural Languagecited by 1
- 2026LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimizationcited by 0
- 2026LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization28 Sep 2026
- 2026PEARL: Solver-in-the-Loop Interactive Optimization Modeling from Natural Language14 May 2026
- 2026MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Research3 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Entropy-Gradient Inversion: Moving Toward Internal Mechanism of Large Reasoning Models
- 2026Stable Adaptive Thinking via Advantage Shaping and Length-Aware Gradient Regulation
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2025Beyond SFT: Reinforcement Learning for Safer Large Reasoning Models with Better Reasoning Ability
- 2026On-Policy Supervised Fine-Tuning for Efficient Reasoning
- 2026Efficiently Learning To Reason or Not to Reason: Root-token Policy Optimization for Adaptive Thinking
- 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library