mlsanityData to 14 Oct 2026

OptiLoop: Coordination-in-the-Loop Verification and Repair for LLM-Generated Optimization Agents

arXiv 2605.27630 ↗First posted 26 May 2026math.OC cs.SEcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Many decentralized decision problems require multiple parties to coordinate on shared decisions while keeping objectives, constraints, and data private. Large language models (LLMs) offer a promising way to lower the barrier to participation by generating local optimization agents from natural-language specifications. In coordination settings, however, executability is not enough: a generated agent may compile, solve, and pass local checks while still being semantically wrong, for example by misrepresenting costs, mis-scoping constraints, or responding incorrectly to incentives. Such errors often surface only during coordination, as systematic behavioral failures rather than infeasibility. We propose coordination-in-the-loop verification and repair for LLM-generated optimization agents. We instantiate this idea with an Alternating Direction Method of Multipliers (ADMM)-style consensus protocol and introduce OptiLoop, a pipeline that generates local optimization agents from text, verifies them through short, bounded coordination runs against a fixed reference counterparty, extracts structured behavioral and static evidence, and applies evidence-driven repair. When failures are structural rather than implementational, OptiLoop escalates from localized code fixes to corrected-formulation repair, and it can additionally reuse episodic lessons from prior instances. On 40 held-out test scenarios, OptiLoop-Full improves objective match from 66.0% to 93.0% and social match from 68.5% to 89.0% relative to a strong local-validation baseline, while reducing mean objective gap from 15.3% to 3.5% and mean social gap from 7.6% to 2.0%. These results show that, for generated optimization agents deployed inside decentralized decision loops, correctness should be validated in the loop itself rather than through isolated execution alone.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 7 of its 13 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

7 of 13 references.

References · 7

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
  3. 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 109
  4. 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
  5. 2026ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimizationcited by 8
  6. 2025Leveraging Large Language Models for Risk Assessment in Hyperconnected Logistic Hub Network Deploymentcited by 3
  7. 2025OptiHive: Ensemble Selection for LLM-Based Optimization via Statistical Modelingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation
  2. 2026From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modeling
  3. 2026Opti-Agent-Bench: Benchmarking End-to-End Optimization R&D Agents on Real-World Business Problems
  4. 2026DIANOIA: Diagnostic Decomposition and Joint Optimization for Multi-Agent Reasoning
  5. 2025OptimAI: Optimization from Natural Language Using LLM-Powered AI Agents
  6. 2025An Agent-Based Framework for the Automatic Validation of Mathematical Optimization Models
  7. 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
  8. 2026NEMO: Execution-Aware Optimization Modeling via Autonomous Coding Agents