mlsanityData to 7 Oct 2026

The Differentiable Feasibility Pump

arXiv 2411.03535 ↗First posted 5 Nov 2024math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Although nearly 20 years have passed since its conception, the feasibility pump algorithm remains a widely used heuristic to find feasible primal solutions to mixed-integer linear problems. Many extensions of the initial algorithm have been proposed. Yet, its core algorithm remains centered around two key steps: solving the linear relaxation of the original problem to obtain a solution that respects the constraints, and rounding it to obtain an integer solution. This paper shows that the traditional feasibility pump and many of its follow-ups can be seen as gradient-descent algorithms with specific parameters. A central aspect of this reinterpretation is observing that the traditional algorithm differentiates the solution of the linear relaxation with respect to its cost. This reinterpretation opens many opportunities for improving the performance of the original algorithm. We study how to modify the gradient-update step as well as extending its loss function. We perform extensive experiments on MIPLIB instances and show that these modifications can substantially reduce the number of iterations needed to find a solution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 5 Nov 2024.

Builds on

19 of 43 references.

References · 19

  1. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  2. 2017Smart "Predict, then Optimize"cited by 332
  3. 2019Differentiation of Blackbox Combinatorial Solverscited by 224
  4. 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
  5. 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
  6. 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
  7. 2019Learning with Fenchel-Young Lossescited by 117
  8. 2019MIPaaL: Mixed Integer Program as a Layercited by 93
  9. 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
  10. 2020Interior Point Solving for LP-based prediction+optimisationcited by 83
  11. 2023A Survey of Contextual Optimization Methods for Decision Making under Uncertaintycited by 81
  12. 2020SoftSort: A Continuous Relaxation for the argsort Operatorcited by 66
7 more
  1. 2022PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programmingcited by 32
  2. 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
  3. 2022Learning with Combinatorial Optimization Layers: a Probabilistic Approachcited by 28
  4. 2022Continuous cutting plane algorithms in integer programmingcited by 4
  5. 2023Differentiable Cutting-plane Layers for Mixed-integer Linear Optimizationcited by 3
  6. 2017Penalty Alternating Direction Methods for Mixed-Integer Optimization: A New View on Feasibility Pumpscited by 2
  7. 2016Improving the Randomization Step in Feasibility Pumpcited by 1

Built on by

Not cited yet.