mlsanityData to 14 Oct 2026

CALM Before the STORM: Unlocking Native Reasoning for Optimization Modeling

arXiv 2510.04204 ↗First posted 5 Oct 2025cs.CL cs.AI cs.CEcited by 3

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for earlier instruction-tuned models, often fail to exploit the advanced reasoning patterns of modern LRMs -- In particular, we show that direct fine-tuning on traditional textitnon-reflective datasets leads to limited gains. To fully leverage LRMs' inherent reasoning abilities, we propose CALM (textitCorrective Adaptation with Lightweight Modification), a framework that progressively refines LRMs within their native reasoning modes for optimization modeling tasks. In CALM, an expert intervener identifies reasoning flaws and provides concise corrective hints, which the LRM incorporates to produce improved reasoning trajectories. These interventions modify fewer than 2.6% of generated tokens, but generate high-quality data for soft adaptation through supervised fine-tuning. The adapted model is then further improved through reinforcement learning. Building on CALM, we develop STORM (textitSmart Thinking Optimization Reasoning Model), a 4B-parameter LRM that achieves a new state-of-the-art average accuracy of 68.9% across five popular optimization modeling benchmarks, matching the performance of a 671B LRM. These results demonstrate that dynamic, hint-based data synthesis both preserves and amplifies the native reasoning patterns of modern LRMs, offering a more effective and scalable path towards expert-level performance on challenging optimization modeling tasks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 20 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

15 of 20 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025START: Self-taught Reasoner with Tools6 Mar

Other references · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  7. 2024OpenAI o1 System Cardcited by 1,244
  8. 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 109
  9. 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
  10. 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
  11. 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
  12. 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 49
2 more
  1. 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 45
  2. 2025CoRT: Code-integrated Reasoning within Thinkingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Entropy-Gradient Inversion: Moving Toward Internal Mechanism of Large Reasoning Models
  2. 2026Stable Adaptive Thinking via Advantage Shaping and Length-Aware Gradient Regulation
  3. 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
  4. 2025Beyond SFT: Reinforcement Learning for Safer Large Reasoning Models with Better Reasoning Ability
  5. 2026On-Policy Supervised Fine-Tuning for Efficient Reasoning
  6. 2026Efficiently Learning To Reason or Not to Reason: Root-token Policy Optimization for Adaptive Thinking
  7. 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
  8. 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library