GRIMIP: A General Framework for Instance-Specific Configuration of MIP Solvers Using LLMs
Not on the map. Why?
Abstract (arXiv)
Configuring the hyperparameters of Mixed-integer programming (MIP) solvers is a high-dimensional, instance-dependent optimization problem where suboptimal settings can degrade solving time by orders of magnitude. Default configurations are often suboptimal, while traditional tuning methods either suffer from the ``cold-start'' problem and inefficient search or heavily rely on expert experience. This paper introduces GRIMIP (textbfunderlineGeneral textbfunderlineReasoning for textbfunderlineInstance-specific textbfunderlineMIP configuration), a novel hybrid intelligence framework that synergistically integrates the semantic reasoning capabilities of Large Language Models (LLMs) with the sample-efficient search of Bayesian Optimization (BO). GRIMIP enables the LLM to function as a complete probabilistic surrogate within the BO loop, significantly improving performance and reducing sampling and evaluation costs. On seven benchmarks including MIPLIB, GRIMIP achieves over 40% reduction in Primal-Dual Integral on hard instances, outperforming SMAC and other LLM-assisted BO methods. By granting LLMs sufficient autonomy, GRIMIP combines the expert-level reasoning of LLMs with the efficient search of BO, achieving state-of-the-art performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 71 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
29 of 71 references.
References · 29
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
- 2015Deep Kernel Learningcited by 445
- 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 374
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 230
- 2020Solving Mixed Integer Programs Using Neural Networkscited by 182
- 2024Large Language Models to Enhance Bayesian Optimizationcited by 135
- 2016Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasetscited by 132
- 2014ParamILS: An Automatic Algorithm Configuration Frameworkcited by 89
- 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
17 more
- 2020HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisationcited by 83
- 2022Towards Learning Universal Hyperparameter Optimizers with Transformerscited by 81
- 2014Manifold Gaussian Processes for Regressioncited by 80
- 2023PFNs4BO: In-Context Learning for Bayesian Optimizationcited by 73
- 2023Using Large Language Models for Hyperparameter Optimizationcited by 71
- 2022The Machine Learning for Combinatorial Optimization Competition (ML4CO): Results and Insightscited by 39
- 2022A Survey of Methods for Automated Algorithm Configurationcited by 30
- 2024In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimizationcited by 26
- 2024Sequential Large Language Model-Based Hyper-parameter Optimizationcited by 24
- 2025Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?cited by 21
- 2025Efficient Heuristics Generation for Solving Combinatorial Optimization Problems Using Large Language Modelscited by 16
- 2025Large Language Model-Enhanced Multi-Armed Banditscited by 7
- 2022Instance-wise algorithm configuration with graph neural networkscited by 5
- 2018Efficient Global Optimization using Deep Gaussian Processescited by 4
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solverscited by 3
- 2024A learning-based mathematical programming formulation for the automatic configuration of optimization solverscited by 2
- 2025Are Your Generated Instances Truly Useful? GenBench-MILP: A Benchmark Suite for MILP Instance Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Leveraging Large Language Models for Solving Rare MIP Challenges
- 2025OptiMind: Teaching LLMs to Think Like Optimization Experts
- 2025LLMize: A Framework for Large Language Model-Based Numerical Optimization
- 2026OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
- 2024OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modeling
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratch
- 2025Peering Inside the Black Box: Uncovering LLM Errors in Optimization Modelling through Component-Level Evaluation
- 2025Text2Zinc: A Cross-Domain Dataset for Modeling Optimization and Satisfaction Problems in MiniZinc