Differentiating Through a Cone Program
Not on the map. Why?
Abstract (arXiv)
We consider the problem of efficiently computing the derivative of the solution map of a convex cone program, when it exists. We do this by implicitly differentiating the residual map for its homogeneous self-dual embedding, and solving the linear systems of equations required using an iterative method. This allows us to efficiently compute the derivative operator, and its adjoint, evaluated at a vector. These correspond to computing an approximate new solution, given a perturbation to the cone program coefficients (i.e., perturbation analysis), and to computing the gradient of a function of the solution with respect to the coefficients. Our method scales to large problems, with numbers of coefficients in the millions. We present an open-source Python implementation of our method that solves a cone program and returns the derivative and its adjoint as abstract linear maps; our implementation can be easily integrated into software systems for automatic differentiation.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 9; 2023: 19; 2024: 13; 2025: 8; 2026: 11.
72 papers.
Sort:
By area:
- 2021Efficient and Modular Implicit Differentiationcited by 199
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2021Strategic Classification Made Practicalcited by 58
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2021Nonsmooth Implicit Differentiation for Machine Learning and Optimizationcited by 43
- 2022PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programmingcited by 32
- 2023RAYEN: Imposition of Hard Convex Constraints on Neural Networkscited by 30
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2021Learning to Solve the AC-OPF using Sensitivity-Informed Deep Neural Networkscited by 26
- 2022Alternating Differentiation for Optimization Layerscited by 22
- 2022SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problemscited by 21
- 2021Efficient differentiable quadratic programming layers: an ADMM approachcited by 19
38 more
- 2025FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guaranteescited by 19
- 2022Flexible Differentiable Optimization via Model Transformationscited by 16
- 2021The Perils of Learning Before Optimizingcited by 15
- 2023Backpropagation of Unrolled Solvers with Folded Optimizationcited by 13
- 2021Deep Learning Explicit Differentiable Predictive Control Laws for Buildingscited by 11
- 2023Differentiating Through Integer Linear Programs with Quadratic Regularization and Davis-Yin Splittingcited by 11
- 2024Dual Lagrangian Learning for Conic Optimizationcited by 11
- 2025Conformal Risk Training: End-to-End Optimization of Conformal Risk Controlcited by 11
- 2023Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learningcited by 10
- 2024Differentiation Through Black-Box Quadratic Programming Solverscited by 10
- 2024BPQP: A Differentiable Convex Optimization Framework for Efficient End-to-End Learningcited by 10
- 2023Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regimecited by 8
- 2024Differentiable Distributionally Robust Optimization Layerscited by 8
- 2021Diff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop Inferencecited by 7
- 2021Differentiable Rendering with Perturbed Optimizerscited by 7
- 2023End-to-End Reinforcement Learning of Koopman Models for Economic Nonlinear Model Predictive Controlcited by 6
- 2023The Pursuit of Human Labeling: A New Perspective on Unsupervised Learningcited by 6
- 2024DataSP: A Differential All-to-All Shortest Path Algorithm for Learning Costs and Predicting Paths with Contextcited by 6
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layerscited by 6
- 2023Deep Declarative Dynamic Time Warping for End-to-End Learning of Alignment Pathscited by 5
- 2023SCQPTH: an efficient differentiable splitting method for convex quadratic programmingcited by 5
- 2022On the complexity of nonsmooth automatic differentiationcited by 4
- 2022Learning Sparsity-Promoting Regularizers using Bilevel Optimizationcited by 4
- 2023Predict-Then-Optimize by Proxy: Learning Joint Models of Prediction and Optimizationcited by 4
- 2021DeepPSL: End-to-end perception and reasoningcited by 3
- 2021Bilevel learning of l1-regularizers with closed-form gradients(BLORC)cited by 3
- 2023Data-driven and Physics Informed Modelling of Chinese Hamster Ovary Cell Bioreactorscited by 3
- 2023On the Optimality, Stability, and Feasibility of Control Barrier Functions: An Adaptive Learning-Based Approachcited by 3
- 2023Differentiable Cutting-plane Layers for Mixed-integer Linear Optimizationcited by 3
- 2024Learning Joint Models of Prediction and Optimizationcited by 3
- 2025A Fully First-Order Layer for Differentiable Optimizationcited by 3
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Errorcited by 3
- 2023Implicit Bilevel Optimization: Differentiating through Bilevel Optimization Programmingcited by 2
- 2023Wasserstein Distributionally Robust Control Barrier Function using Conditional Value-at-Risk with Differentiable Convex Programmingcited by 2
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertaintycited by 2
- 2024Decision-Focused Forecasting: A Differentiable Multistage Optimisation Architecturecited by 2
- 2024Differentiable Convex Optimization Layers in Neural Architectures: Foundations and Perspectivescited by 2
- 2026A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solverscited by 2
50 most cited of 72 All 72 (JSON)
- 2026dOPT: Differentiating Conic Optimization via Geometric Reduction27 Sep 2026
- 2026lapanda: A Matrix-Free Differentiable Solver for Nonconvex Constrained Optimization Layers27 Sep 2026
- 2026Disciplined Bilevel Programming1 Sep 2026
- 2026End-to-End Fairness Optimization with Fair Decision-Focused Learning31 Jul 2026
- 2026End-to-End Learning of Safe Optimal Feedback Control in High Dimensions with Control Barrier Function Layers22 Jul 2026
- 2026Diff2SP: Diffusion Models for Correlated Scenario Generation in Stochastic Programming4 Jun 2026
- 2026Efficient and provably convergent end-to-end training of deep neural networks with linear constraints12 May 2026
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Error2 May 2026
- 2026A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solvers15 Feb 2026
- 2026partialCBDs: Differentiable Causal Block Diagrams7 Feb 2026
- 2026Learning to Optimize by Differentiable Programming23 Jan 2026
- 2025A Fully First-Order Layer for Differentiable Optimization2 Dec 2025
38 more
- 2025Conformal Risk Training: End-to-End Optimization of Conformal Risk Control9 Oct 2025
- 2025Inverse Optimization Latent Variable Models for Learning Costs Applied to Route Problems19 Sep 2025
- 2025Learning to Solve Constrained Bilevel Control Co-Design Problems11 Jul 2025
- 2025Learning to Fuse: Modality-Aware Adaptive Scheduling for Robust Multimodal Foundation Models15 Jun 2025
- 2025Leveraging Analytic Gradients in Provably Safe Reinforcement Learning2 Jun 2025
- 2025FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guarantees31 May 2025
- 2025Decision-Focused Learning for Complex System Identification: HVAC Management System Application24 Jan 2025
- 2024Differentiable Convex Optimization Layers in Neural Architectures: Foundations and Perspectives30 Dec 2024
- 2024BPQP: A Differentiable Convex Optimization Framework for Efficient End-to-End Learning28 Nov 2024
- 2024End-to-End Optimization and Learning of Fair Court Schedules22 Oct 2024
- 2024Differentiation Through Black-Box Quadratic Programming Solvers8 Oct 2024
- 2024RandALO: Out-of-sample risk estimation in no time flat15 Sep 2024
- 2024Learning Joint Models of Prediction and Optimization7 Sep 2024
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layers8 Jul 2024
- 2024Differentiable Distributionally Robust Optimization Layers24 Jun 2024
- 2024Decision-Focused Forecasting: A Differentiable Multistage Optimisation Architecture23 May 2024
- 2024DataSP: A Differential All-to-All Shortest Path Algorithm for Learning Costs and Predicting Paths with Context8 May 2024
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertainty12 Feb 2024
- 2024Learning Fair Ranking Policies via Differentiable Optimization of Ordered Weighted Averages7 Feb 2024
- 2024Dual Lagrangian Learning for Conic Optimization5 Feb 2024
- 2023Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization28 Dec 2023
- 2023Learning Deterministic Surrogates for Robust Convex QCQPs19 Dec 2023
- 2023Predict-Then-Optimize by Proxy: Learning Joint Models of Prediction and Optimization22 Nov 2023
- 2023Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime13 Nov 2023
- 2023Differentiable Cutting-plane Layers for Mixed-integer Linear Optimization6 Nov 2023
- 2023The Pursuit of Human Labeling: A New Perspective on Unsupervised Learning6 Nov 2023
- 2023Distributionally Safe Reinforcement Learning under Model Uncertainty: A Single-Level Approach by Differentiable Convex Programming3 Oct 2023
- 2023Wasserstein Distributionally Robust Control Barrier Function using Conditional Value-at-Risk with Differentiable Convex Programming15 Sep 2023
- 2023SCQPTH: an efficient differentiable splitting method for convex quadratic programming16 Aug 2023
- 2023End-to-End Reinforcement Learning of Koopman Models for Economic Nonlinear Model Predictive Control3 Aug 2023
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities25 Jul 2023
- 2023RAYEN: Imposition of Hard Convex Constraints on Neural Networks17 Jul 2023
- 2023Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning11 Jul 2023
- 2023On the Optimality, Stability, and Feasibility of Control Barrier Functions: An Adaptive Learning-Based Approach5 May 2023
- 2023Data-driven and Physics Informed Modelling of Chinese Hamster Ovary Cell Bioreactors5 May 2023
- 2023Deep Declarative Dynamic Time Warping for End-to-End Learning of Alignment Paths19 Mar 2023
- 2023Implicit Bilevel Optimization: Differentiating through Bilevel Optimization Programming28 Feb 2023
- 2023Differentiating Through Integer Linear Programs with Quadratic Regularization and Davis-Yin Splitting31 Jan 2023
50 newest of 72 All 72 (JSON)
- 2021Efficient and Modular Implicit Differentiationcited by 199
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2021Strategic Classification Made Practicalcited by 58
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2021Nonsmooth Implicit Differentiation for Machine Learning and Optimizationcited by 43
- 2022PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programmingcited by 32
- 2023RAYEN: Imposition of Hard Convex Constraints on Neural Networkscited by 30
- 2021Learning to Solve the AC-OPF using Sensitivity-Informed Deep Neural Networkscited by 26
- 2022Alternating Differentiation for Optimization Layerscited by 22
- 2022SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problemscited by 21
- 2021Efficient differentiable quadratic programming layers: an ADMM approachcited by 19
- 2025FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guaranteescited by 19
12 most cited of 70 All 70 (JSON)
- 2026dOPT: Differentiating Conic Optimization via Geometric Reduction27 Sep 2026
- 2026lapanda: A Matrix-Free Differentiable Solver for Nonconvex Constrained Optimization Layers27 Sep 2026
- 2026Disciplined Bilevel Programming1 Sep 2026
- 2026End-to-End Fairness Optimization with Fair Decision-Focused Learning31 Jul 2026
- 2026End-to-End Learning of Safe Optimal Feedback Control in High Dimensions with Control Barrier Function Layers22 Jul 2026
- 2026Efficient and provably convergent end-to-end training of deep neural networks with linear constraints12 May 2026
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Error2 May 2026
- 2026A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solvers15 Feb 2026
- 2026partialCBDs: Differentiable Causal Block Diagrams7 Feb 2026
- 2026Learning to Optimize by Differentiable Programming23 Jan 2026
- 2025A Fully First-Order Layer for Differentiable Optimization2 Dec 2025
- 2025Conformal Risk Training: End-to-End Optimization of Conformal Risk Control9 Oct 2025
12 newest of 70 All 70 (JSON)