Automated Reformulation of Robust Optimization via Memory-Augmented Large Language Models
Not on the map. Why?
Abstract (arXiv)
Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its practical use is often limited by the need to manually reformulate uncertain optimization models into tractable deterministic counterparts. Recent large language models (LLMs) have been shown promising for automating optimization formulation, yet RO reformulation remains challenging because it requires precise multi-step reasoning and mathematically consistent transformations. To facilitate systematic evaluation of LLM-based reformulation, for which no dedicated benchmark currently exists, we develop AutoRO-Bench, a benchmark featuring an automated data generation pipeline for the core RO reformulation task and a curated dataset for the RO application task. To address the reformulation challenge, we propose Automated Reformulation with Experience Memory (AutoREM), a tuning-free memory-augmented framework that autonomously builds a structured textual experience memory by reflecting on past failed trajectories through a tailored offline adaptation procedure. AutoREM requires neither domain-specific expert knowledge nor parameter updates, and the resulting memory readily transfers across different base LLMs. Experimental results show that AutoREM consistently improves the accuracy and efficiency of RO reformulation across in-distribution datasets, out-of-distribution datasets, and diverse base LLMs.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 66 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
50 of 66 references.
References · 50
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
38 more
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2025Memory in the Age of AI Agentscited by 285
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
- 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 199
- 2025Deep Think with Confidencecited by 199
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
- 2024Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solverscited by 137
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 105
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 84
- 2025Outcome-based Exploration for LLM Reasoningcited by 79
- 2025Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpeningcited by 78
- 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agentscited by 69
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2025Contextual Experience Replay for Self-Improvement of Language Agentscited by 46
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
- 2023PREFER: Prompt Ensemble Learning via Feedback-Reflect-Refinecited by 28
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2025MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problemcited by 24
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
- 2024Solving General Natural-Language-Description Optimization Problems with Large Language Modelscited by 22
- 2026REMem: Reasoning with Episodic Memory in Language Agentcited by 20
- 2025System Prompt Optimization with Meta-Learningcited by 18
- 2025OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learningcited by 16
- 2024BPP-Search: Enhancing Tree of Thought Reasoning for Mathematical Modeling Problem Solvingcited by 15
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 12
- 2026Large-Scale Optimization Model Auto-Formulation: Harnessing LLM Flexibility via Structured Workflowcited by 11
- 2025ORMind: A Cognitive-Inspired End-to-End Reasoning Framework for Operations Researchcited by 10
- 2025SolverLLM: Leveraging Test-Time Scaling for Optimization Problem via LLM-Guided Searchcited by 10
- 2025Decision Information Meets Large Language Models: The Future of Explainable Operations Researchcited by 9
- 2024Robust and Adaptive Optimization under a Large Language Model Lenscited by 8
- 2025Evolving Prompts In-Context: An Open-ended, Self-replicating Perspectivecited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.