Differentiation Through Black-Box Quadratic Programming Solvers
Not on the map. Why?
Abstract (arXiv)
Differentiable optimization has attracted significant research interest, particularly for quadratic programming (QP). Existing approaches for differentiating the solution of a QP with respect to its defining parameters often rely on specific integrated solvers. This integration limits their applicability, including their use in neural network architectures and bi-level optimization tasks, restricting users to a narrow selection of solver choices. To address this limitation, we introduce dQP, a modular and solver-agnostic framework for plug-and-play differentiation of virtually any QP solver. A key insight we leverage to achieve modularity is that, once the active set of inequality constraints is known, both the solution and its derivative can be expressed using simplified linear systems that share the same matrix. This formulation fully decouples the computation of the QP solution from its differentiation. Building on this result, we provide a minimal-overhead, open-source implementation ( https://github.com/cwmagoon/dQP ) that seamlessly integrates with over 15 state-of-the-art solvers. Comprehensive benchmark experiments demonstrate dQP's robustness and scalability, particularly highlighting its advantages in large-scale sparse problems.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 62 of its 117 references that are in the map. First posted on arXiv 8 Oct 2024.
Builds on
62 of 117 references.
References · 62
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2021Convex optimizationcited by 2,479
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2019Deep Equilibrium Modelscited by 603
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2019Differentiable Convex Optimization Layerscited by 458
- 2016Input Convex Neural Networkscited by 407
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 337
- 2019Differentiation of Blackbox Combinatorial Solverscited by 224
38 more
- 2021Efficient and Modular Implicit Differentiationcited by 199
- 2018Differentiable MPC for End-to-end Planning and Controlcited by 178
- 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 156
- 2020Multiscale Deep Equilibrium Modelscited by 149
- 2019Implicit Deep Learningcited by 124
- 2016On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimizationcited by 108
- 2020Monotone operator equilibrium networkscited by 100
- 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
- 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
- 2015Parallelizing the dual revised simplex methodcited by 83
- 2019Deep Declarative Networks: A New Hopecited by 77
- 2021On Training Implicit Modelscited by 73
- 2019Differentiating Through a Cone Programcited by 72
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 64
- 2018SparseMAP: Differentiable Sparse Structured Inferencecited by 62
- 2015Structured Prediction Energy Networkscited by 59
- 2015JuMP: A Modeling Language for Mathematical Optimizationcited by 49
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2024The Elements of Differentiable Programmingcited by 41
- 2024Clarabel: An interior-point solver for conic programs with quadratic objectivescited by 40
- 2021On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layerscited by 35
- 2017End-to-End Learning for Structured Prediction Energy Networkscited by 33
- 2023Learning to Warm-Start Fixed-Point Optimization Algorithmscited by 32
- 2023One-step differentiation of iterative algorithmscited by 28
- 2018What game are we playing? End-to-end learning in normal and extensive form gamescited by 22
- 2022Alternating Differentiation for Optimization Layerscited by 22
- 2020HPIPM: a high-performance quadratic programming framework for model predictive controlcited by 21
- 2021Efficient differentiable quadratic programming layers: an ADMM approachcited by 19
- 2020Learning Linear Programs from Optimal Decisionscited by 18
- 2021Input Convex Gradient Networkscited by 17
- 2022TorchOpt: An Efficient Library for Differentiable Optimizationcited by 17
- 2022Flexible Differentiable Optimization via Model Transformationscited by 16
- 2021Joint inference and input optimization in equilibrium networkscited by 15
- 2022The Curse of Unrolling: Rate of Differentiating Through Optimizationcited by 15
- 2020Learning Composable Energy Surrogates for PDE Order Reductioncited by 13
- 2021Implicit Riemannian Concave Potential Mapscited by 10
- 2023PIQP: A Proximal Interior-Point Quadratic Programming Solvercited by 8
- 2021Diff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop Inferencecited by 7
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guaranteescited by 19
- 2025A Fully First-Order Layer for Differentiable Optimizationcited by 3
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Errorcited by 3
- 2026A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solverscited by 2
- 2026Learning to Optimize by Differentiable Programmingcited by 1
- 2026ODYN: An All-Shifted Non-Interior-Point Method for Quadratic Programming in Robotics and AIcited by 1
- 2025Integrated Prediction and Multi-period Portfolio Optimizationcited by 0
- 2026Covariance-Aware Transformers for Quadratic Programming and Decision Makingcited by 0
- 2026Efficient and provably convergent end-to-end training of deep neural networks with linear constraintscited by 0
- 2026dOPT: Differentiating Conic Optimization via Geometric Reductioncited by 0
- 2026dOPT: Differentiating Conic Optimization via Geometric Reduction27 Sep 2026
- 2026Efficient and provably convergent end-to-end training of deep neural networks with linear constraints12 May 2026
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Error2 May 2026
- 2026ODYN: An All-Shifted Non-Interior-Point Method for Quadratic Programming in Robotics and AI17 Feb 2026
- 2026Covariance-Aware Transformers for Quadratic Programming and Decision Making16 Feb 2026
- 2026A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solvers15 Feb 2026
- 2026Learning to Optimize by Differentiable Programming23 Jan 2026
- 2025Integrated Prediction and Multi-period Portfolio Optimization12 Dec 2025
- 2025A Fully First-Order Layer for Differentiable Optimization2 Dec 2025
- 2025FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guarantees31 May 2025