Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Large Language Models (LLMs) often struggle with structural ambiguity in optimization problems, where a single problem admits multiple related but conflicting modeling paradigms, hindering effective solution generation. To address this, we propose Dual-Cluster Memory Agent (DCM-Agent) to enhance performance by leveraging historical solutions in a training-free manner. Central to this is Dual-Cluster Memory Construction. This agent assigns historical solutions to modeling and coding clusters, then distills each cluster's content into three structured types: Approach, Checklist, and Pitfall. This process derives generalizable guidance knowledge. Furthermore, this agent introduces Memory-augmented Inference to dynamically navigate solution paths, detect and repair errors, and adaptively switch reasoning paths with structured knowledge. The experiments across seven optimization benchmarks demonstrate that DCM-Agent achieves an average performance improvement of 11%- 21%. Notably, our analysis reveals a ``knowledge inheritance'' phenomenon: memory constructed by larger models can guide smaller models toward superior performance, highlighting the framework's scalability and efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 18 of its 41 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
18 of 41 references.
References · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modelingcited by 66
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 58
- 2024Autoformulation of Mathematical Optimization Models Using LLMscited by 48
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 46
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2025Large Language Models as End-to-end Combinatorial Optimization Solverscited by 27
6 more
- 2025MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problemcited by 24
- 2025OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modelingcited by 23
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2025ORMind: A Cognitive-Inspired End-to-End Reasoning Framework for Operations Researchcited by 10
- 2025CoFFT: Chain of Foresight-Focus Thought for Visual Language Modelscited by 6
- 2025AutoOpt: A Dataset and a Unified Framework for Automating Optimization Problem Solvingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modeling
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
- 2026OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
- 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
- 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution
- 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory
- 2026CLAG: Adaptive Memory Organization via Agent-Driven Clustering for Small Language Model Agents
- 2025EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory