# Alternating mixed-integer programming and neural network training for approximating stochastic two-stage problems

arXiv: https://arxiv.org/abs/2305.06785 · HTML: https://mlsanity.com/paper/2305.06785/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 May 2023.

## Built on by (most cited first, 6 of 6)

- [Optimization Over Trained Neural Networks: Taking a Relaxing Walk](https://mlsanity.com/paper/2401.03451/) (2024)
- [Neur2BiLO: Neural Bilevel Optimization](https://mlsanity.com/paper/2402.02552/) (2024)
- [ICNN-enhanced 2SP: Leveraging input convex neural networks for solving two-stage stochastic programming](https://mlsanity.com/paper/2505.05261/) (2025)
- [Deep Learning for Two-Stage Robust Integer Optimization](https://mlsanity.com/paper/2310.04345/) (2023)
- [Relaxation-Informed Training of Neural Network Surrogate Models](https://mlsanity.com/paper/2604.22746/) (2026)
- [Optimization for One, Feasibility for Most: Decoupling Optimization from Feasibility in Chance-Constrained Programs](https://mlsanity.com/paper/2610.19027/) (2026)

## Abstract (arXiv)

The presented work addresses two-stage stochastic programs (2SPs), a broadly applicable model to capture optimization problems subject to uncertain parameters with adjustable decision variables. In case the adjustable or second-stage variables contain discrete decisions, the corresponding 2SPs are known to be NP-complete. The standard approach of forming a single-stage deterministic equivalent problem can be computationally challenging even for small instances, as the number of variables and constraints scales with the number of scenarios. To avoid forming a potentially huge MILP problem, we build upon an approach of approximating the expected value of the second-stage problem by a neural network (NN) and encoding the resulting NN into the first-stage problem. The proposed algorithm alternates between optimizing the first-stage variables and retraining the NN. We demonstrate the value of our approach with the example of computing operating points in power systems by showing that the alternating approach provides improved first-stage decisions and a tighter approximation between the expected objective and its neural network approximation.
