From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modeling
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Optimization modeling underpins real-world decision-making in logistics, manufacturing, energy, and public services, but reliably solving such problems from natural-language requirements remains challenging for current large language models (LLMs). In this paper, we propose Agora-Opt, a modular agentic framework for optimization modeling that combines decentralized debate with a read-write memory bank. Agora-Opt allows multiple agent teams to independently produce end-to-end solutions and reconcile them through an outcome-grounded debate protocol, while memory stores solver-verified artifacts and past disagreement resolutions to support training-free improvement over time. This design is flexible across both backbones and methods: it reduces base-model lock-in, transfers across different LLM families, and can be layered onto existing pipelines with minimal coupling. Across public benchmarks, Agora-Opt achieves the strongest overall performance among all compared methods, outperforming strong zero-shot LLMs, training-centric approaches, and prior agentic baselines. Further analyses show robust gains across backbone choices and component variants, and demonstrate that decentralized debate offers a structural advantage over centralized selection by enabling agents to refine candidate solutions through interaction and even recover correct formulations when all initial candidates are flawed. These results suggest that reliable optimization modeling benefits from combining collaborative cross-checking with reusable experience, and position Agora-Opt as a practical and extensible foundation for trustworthy optimization modeling assistance. Our code and data are available at https://github.com/CHIANGEL/Agora-Opt.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 50 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
36 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 35
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2018AI safety via debatecited by 384
23 more
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 133
- 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
- 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 105
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024Retrieval-Augmented Generation for Natural Language Processing: A Surveycited by 70
- 2023RET-LLM: Towards a General Read-Write Memory for Large Language Modelscited by 64
- 2022Augmenting Operations Research with Auto-Formulation of Optimization Models from Problem Descriptionscited by 54
- 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolutioncited by 52
- 2025OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modelingcited by 48
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2024OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scalecited by 37
- 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 30
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2025Stepwise Guided Policy Optimization: Coloring your Incorrect Reasoning in GRPOcited by 18
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Modelscited by 13
- 2025AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Librarycited by 12
- 2025ComPO: Preference Alignment via Comparison Oraclescited by 11
- 2025ORMind: A Cognitive-Inspired End-to-End Reasoning Framework for Operations Researchcited by 10
- 2023Operational Research: Methods and Applicationscited by 6
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scalingcited by 5
- 2025Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Modelscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agentscited by 2
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modelingcited by 0
- 2026Beyond Verified Answers: Solver-Informed Self-Distillation for Bootstrapping Operations Research Language Modelscited by 0
- 2026Beyond Verified Answers: Solver-Informed Self-Distillation for Bootstrapping Operations Research Language Models9 Sep 2026
- 2026Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling16 Aug 2026
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agents27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Let's Have a Conversation: Designing and Evaluating LLM Agents for Interactive Optimization
- 2026Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving
- 2026Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation
- 2026OptiLoop: Coordination-in-the-Loop Verification and Repair for LLM-Generated Optimization Agents
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
- 2026OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling
- 2026Opti-Agent-Bench: Benchmarking End-to-End Optimization R&D Agents on Real-World Business Problems
- 2026MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Research