mlsanityData to 7 Oct 2026

Differentiation Through Black-Box Quadratic Programming Solvers

arXiv 2410.06324 ↗First posted 8 Oct 2024cs.LG math.OCcited by 10

Not on the map. Why?

Abstract (arXiv)

Differentiable optimization has attracted significant research interest, particularly for quadratic programming (QP). Existing approaches for differentiating the solution of a QP with respect to its defining parameters often rely on specific integrated solvers. This integration limits their applicability, including their use in neural network architectures and bi-level optimization tasks, restricting users to a narrow selection of solver choices. To address this limitation, we introduce dQP, a modular and solver-agnostic framework for plug-and-play differentiation of virtually any QP solver. A key insight we leverage to achieve modularity is that, once the active set of inequality constraints is known, both the solution and its derivative can be expressed using simplified linear systems that share the same matrix. This formulation fully decouples the computation of the QP solution from its differentiation. Building on this result, we provide a minimal-overhead, open-source implementation ( https://github.com/cwmagoon/dQP ) that seamlessly integrates with over 15 state-of-the-art solvers. Comprehensive benchmark experiments demonstrate dQP's robustness and scalability, particularly highlighting its advantages in large-scale sparse problems.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 62 of its 117 references that are in the map. First posted on arXiv 8 Oct 2024.

Builds on

62 of 117 references.

References · 62

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2021Convex optimizationcited by 2,479
  4. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  5. 2016Learning to learn by gradient descent by gradient descentcited by 616
  6. 2019Deep Equilibrium Modelscited by 603
  7. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  8. 2019Meta-Learning with Implicit Gradientscited by 523
  9. 2019Differentiable Convex Optimization Layerscited by 458
  10. 2016Input Convex Neural Networkscited by 407
  11. 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 337
  12. 2019Differentiation of Blackbox Combinatorial Solverscited by 224
38 more
  1. 2021Efficient and Modular Implicit Differentiationcited by 199
  2. 2018Differentiable MPC for End-to-end Planning and Controlcited by 178
  3. 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 156
  4. 2020Multiscale Deep Equilibrium Modelscited by 149
  5. 2019Implicit Deep Learningcited by 124
  6. 2016On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimizationcited by 108
  7. 2020Monotone operator equilibrium networkscited by 100
  8. 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
  9. 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
  10. 2015Parallelizing the dual revised simplex methodcited by 83
  11. 2019Deep Declarative Networks: A New Hopecited by 77
  12. 2021On Training Implicit Modelscited by 73
  13. 2019Differentiating Through a Cone Programcited by 72
  14. 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 64
  15. 2018SparseMAP: Differentiable Sparse Structured Inferencecited by 62
  16. 2015Structured Prediction Energy Networkscited by 59
  17. 2015JuMP: A Modeling Language for Mathematical Optimizationcited by 49
  18. 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
  19. 2024The Elements of Differentiable Programmingcited by 41
  20. 2024Clarabel: An interior-point solver for conic programs with quadratic objectivescited by 40
  21. 2021On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layerscited by 35
  22. 2017End-to-End Learning for Structured Prediction Energy Networkscited by 33
  23. 2023Learning to Warm-Start Fixed-Point Optimization Algorithmscited by 32
  24. 2023One-step differentiation of iterative algorithmscited by 28
  25. 2018What game are we playing? End-to-end learning in normal and extensive form gamescited by 22
  26. 2022Alternating Differentiation for Optimization Layerscited by 22
  27. 2020HPIPM: a high-performance quadratic programming framework for model predictive controlcited by 21
  28. 2021Efficient differentiable quadratic programming layers: an ADMM approachcited by 19
  29. 2020Learning Linear Programs from Optimal Decisionscited by 18
  30. 2021Input Convex Gradient Networkscited by 17
  31. 2022TorchOpt: An Efficient Library for Differentiable Optimizationcited by 17
  32. 2022Flexible Differentiable Optimization via Model Transformationscited by 16
  33. 2021Joint inference and input optimization in equilibrium networkscited by 15
  34. 2022The Curse of Unrolling: Rate of Differentiating Through Optimizationcited by 15
  35. 2020Learning Composable Energy Surrogates for PDE Order Reductioncited by 13
  36. 2021Implicit Riemannian Concave Potential Mapscited by 10
  37. 2023PIQP: A Proximal Interior-Point Quadratic Programming Solvercited by 8
  38. 2021Diff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop Inferencecited by 7

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 7.

10 papers.