Between steps: Intermediate relaxations between big-M and convex hull formulations
Not on the map. Why?
Abstract (arXiv)
This work develops a class of relaxations in between the big-M and convex hull formulations of disjunctions, drawing advantages from both. The proposed "P-split" formulations split convex additively separable constraints into P partitions and form the convex hull of the partitioned disjuncts. Parameter P represents the trade-off of model size vs. relaxation strength. We examine the novel formulations and prove that, under certain assumptions, the relaxations form a hierarchy starting from a big-M equivalent and converging to the convex hull. We computationally compare the proposed formulations to big-M and convex hull formulations on a test set including: K-means clustering, P_ball problems, and ReLU neural networks. The computational results show that the intermediate P-split formulations can form strong outer approximations of the convex hull with fewer variables and constraints than the extended convex hull formulations, giving significant computational advantages over both the big-M and convex hull.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 5 of its 41 references that are in the map. First posted on arXiv 29 Jan 2021.
Builds on
5 of 41 references.
References · 5
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
- 2020Lossless Compression of Deep Neural Networkscited by 34
- 2019ReLU Networks as Surrogate Models in Mixed-Integer Linear Programscited by 33
- 2017Small and Strong Formulations for Unions of Convex Sets from the Cayley Embeddingcited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 3; 2025: 2.
11 papers.
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networkscited by 39
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 35
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programscited by 8
- 2022P-split formulations: A class of intermediate formulations between big-M and convex hull for disjunctive constraintscited by 7
- 2024Feed-Forward Neural Networks as a Mixed-Integer Programcited by 4
- 2023Model-based feature selection for neural networks: A mixed-integer programming approachcited by 2
- 2025Formal Verification of Markov Processes with Learned Parameterscited by 1
- 2024A cutting plane algorithm for globally solving low dimensional k-means clustering problemscited by 0
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activationscited by 0
- 2025Situational-Constrained Sequential Resources Allocation via Reinforcement Learningcited by 0
- 2025Situational-Constrained Sequential Resources Allocation via Reinforcement Learning17 Jun 2025
- 2025Formal Verification of Markov Processes with Learned Parameters27 Jan 2025
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activations30 Oct 2024
- 2024A cutting plane algorithm for globally solving low dimensional k-means clustering problems21 Feb 2024
- 2024Feed-Forward Neural Networks as a Mixed-Integer Program9 Feb 2024
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programs13 Dec 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Model-based feature selection for neural networks: A mixed-integer programming approach20 Feb 2023
- 2022P-split formulations: A class of intermediate formulations between big-M and convex hull for disjunctive constraints10 Feb 2022
- 2022OMLT: Optimization & Machine Learning Toolkit4 Feb 2022
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networks8 Feb 2021