Multi-task Representation Learning for Mixed Integer Linear Programming
Not on the map. Why?
Abstract (arXiv)
Mixed Integer Linear Programs (MILPs) are highly flexible and powerful tools for modeling and solving complex real-world combinatorial optimization problems. Recently, machine learning (ML)-guided approaches have demonstrated significant potential in improving MILP-solving efficiency. However, these methods typically rely on separate offline data collection and training processes, which limits their scalability and adaptability. This paper introduces the first multi-task learning framework for ML-guided MILP solving. The proposed framework provides MILP embeddings helpful in guiding MILP solving across solvers (e.g., Gurobi and SCIP) and across tasks (e.g., Branching and Solver configuration). Through extensive experiments on three widely used MILP benchmarks, we demonstrate that our multi-task learning model performs similarly to specialized models within the same distribution. Moreover, it significantly outperforms them in generalization across problem sizes and tasks.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 18 Dec 2024.
Builds on
29 of 57 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 617
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
- 2020Solving Mixed Integer Programs Using Neural Networkscited by 178
- 2019Reinforcement Learning for Integer Programming: Learning to Cutcited by 108
- 2022Learning To Cut By Looking Ahead: Cutting Plane Selection via Imitation Learningcited by 58
- 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 48
- 2021Learning to Schedule Heuristics in Branch-and-Boundcited by 45
17 more
- 2023A GNN-Guided Predict-and-Search Framework for Mixed-Integer Linear Programmingcited by 40
- 2022The Machine Learning for Combinatorial Optimization Competition (ML4CO): Results and Insightscited by 39
- 2024GOAL: A Generalist Combinatorial Optimization Agent Learnercited by 39
- 2023Searching Large Neighborhoods for Integer Linear Programs with Contrastive Learningcited by 37
- 2024The SCIP Optimization Suite 9.0cited by 37
- 2022Learning to Compare Nodes in Branch and Bound with Graph Neural Networkscited by 30
- 2024Towards Foundation Models for Mixed Integer Linear Programmingcited by 30
- 2024Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programmingcited by 24
- 2024Distributional MIPLIB: a Multi-Domain Library for Advancing ML-Guided MILP Methodscited by 15
- 2018Learning to Search via Retrospective Imitationcited by 13
- 2021Finding Backdoors to Integer Programs: A Monte Carlo Tree Search Frameworkcited by 12
- 2024Optimization Over Trained Neural Networks: Taking a Relaxing Walkcited by 10
- 2024CAMBranch: Contrastive Learning with Augmented MILPs for Branchingcited by 10
- 2023Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regionscited by 8
- 2021Learning Pseudo-Backdoors for Mixed Integer Programscited by 5
- 2022Instance-wise algorithm configuration with graph neural networkscited by 5
- 2023Automatic MILP Solver Configuration By Learning Problem Similaritiescited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025FORGE: Foundational Optimization Representations from Graph Embeddingscited by 2
- 2025ParBalans: Parallel Multi-Armed Bandits-based Adaptive Large Neighborhood Searchcited by 1
- 2025ID-PaS+ : Identity-Aware Predict-and-Search for General Mixed-Integer Linear Programscited by 1
- 2025Collab-Solver: Collaborative Solving Policy Learning for Mixed-Integer Linear Programmingcited by 0
- 2026Imitation Learning for Combinatorial Optimisation under Uncertaintycited by 0
- 2026Reformulation-Contrastive Learning for Mixed Integer Programscited by 0
- 2026Reformulation-Contrastive Learning for Mixed Integer Programs30 Sep 2026
- 2026Imitation Learning for Combinatorial Optimisation under Uncertainty8 Jan 2026
- 2025ID-PaS+ : Identity-Aware Predict-and-Search for General Mixed-Integer Linear Programs11 Dec 2025
- 2025FORGE: Foundational Optimization Representations from Graph Embeddings28 Aug 2025
- 2025ParBalans: Parallel Multi-Armed Bandits-based Adaptive Large Neighborhood Search8 Aug 2025
- 2025Collab-Solver: Collaborative Solving Policy Learning for Mixed-Integer Linear Programming5 Aug 2025