mlsanityData to 14 Oct 2026

Models Can Model, But Can't Bind: Structured Grounding in Text-to-Optimization

arXiv 2605.21751 ↗First posted 20 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Text-to-optimization requires two separable capabilities: modeling -- choosing the right optimization structure -- and binding -- grounding every coefficient, index, and parameter in the concrete problem data. We study this via Text2Opt-Bench, a scalable benchmark of solver-verified optimization problems spanning 12 categories, from textbook linear programs to stochastic and multi-objective formulations with up to thousands of variables. Across 10+ models, we find that accuracy collapses as instance data grows, even when the formulation itself is simple. We call this the effective binding limit. We study it with a family of techniques, BIND, that externalize numeric data to structured files so the model binds data programmatically rather than transcribing from the prompt. When using an oracle for externalizing data, we recover between 12 and 27 accuracy points, confirming binding as a key -- but recoverable -- failure mode. In a deployable setting without oracle access, we validate our hypothesis by finetuning a model exclusively on binding and show that it outperforms end-to-end SFT and RL across three structurally distinct optimization categories, with a 1.5B binding specialist alone matching a 7B end-to-end baseline.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

22 of 33 references.

References · 22

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  7. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  8. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  9. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  10. 2023Teaching Large Language Models to Self-Debugcited by 988
  11. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
  12. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
10 more
  1. 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Modelscited by 109
  2. 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 50
  3. 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
  4. 2025A Survey of Optimization Modeling Meets LLMs: Progress and Future Directionscited by 31
  5. 2025OR-LLM-Agent: Automating Modeling and Solving of Operations Research Optimization Problems with Reasoning LLMcited by 15
  6. 2025Intrinsic Entropy of Context Length Scaling in LLMscited by 14
  7. 2024Evaluating LLM Reasoning in the Operations Research Domain with ORQAcited by 12
  8. 2025SolverLLM: Leveraging Test-Time Scaling for Optimization Problem via LLM-Guided Searchcited by 10
  9. 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scalingcited by 5
  10. 2025FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipelinecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.