Scalable Deep Unfolding of Conic Optimizers
Not on the map. Why?
Abstract (arXiv)
Deep unfolding (DU) accelerates iterative optimizers by introducing learnable components and training them through unrolled iterations, but extending DU to the large-scale semidefinite programs (SDPs) common in robotics has remained limited. Unrolling a full-update conic solver such as COSMO exposes two obstacles that prior work on learned conic solvers has not: backpropagating through the per-iteration linear-system solve incurs memory quadratic in the problem size once the coefficient matrix is formed explicitly, and backpropagating through the positive semidefinite (PSD) cone projection becomes numerically unstable when eigenvalues coincide. We address the first obstacle with a matrix-free implicit differentiation rule that operates entirely through matrix-vector products, reducing memory from O(n2) to O(n) and enabling backpropagation at scales where direct factorization runs out of memory. We address the second with a backward rule based on the Dalevckii--Krein representation of the Fr'echet derivative, which remains well-defined under repeated eigenvalues. Together these make it possible to learn lightweight hyperparameter policies and warm-starts for a full-update conic solver. We evaluate on nonlinear covariance steering problems solved via sequential convex programming (SCP), as well as standalone SDPs and second-order cone programs ranging from max-cut and Lov'asz vartheta SDPs to robust estimation and control problems. The learned policies outperform state-of-the-art solvers across all problems, and can provide up to a 50× speedup depending on the class. When used as a subroutine in SCP, the learned approach delivers over a 30× speedup compared to COSMO.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
29 of 46 references.
References · 29
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
- 2019Differentiable Convex Optimization Layerscited by 465
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 421
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
- 2021Efficient and Modular Implicit Differentiationcited by 203
- 2016Learning to Optimizecited by 195
- 2018Differentiable MPC for End-to-end Planning and Controlcited by 189
- 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 161
- 2022Tutorial on amortized optimizationcited by 83
- 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 77
- 2019Deep Unfolding for Communications Systems: A Survey and Some New Directionscited by 49
17 more
- 2024Clarabel: An interior-point solver for conic programs with quadratic objectivescited by 44
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 37
- 2023Learning to Warm-Start Fixed-Point Optimization Algorithmscited by 32
- 2021Accelerating Quadratic Optimization with Reinforcement Learningcited by 30
- 2022End-to-End Learning to Warm-Start for Real-Time Quadratic Optimizationcited by 26
- 2021Hyperparameter Tuning is All You Need for LISTAcited by 22
- 2019GPU Acceleration of ADMM for Large-Scale Quadratic Programmingcited by 16
- 2024Deep Distributed Optimization for Large-Scale Quadratic Programmingcited by 11
- 2019COSMO: A conic operator splitting method for convex conic problemscited by 8
- 2025Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel Imagingcited by 8
- 2017DeepKSPD: Learning Kernel-matrix-based SPD Representation for Fine-grained Image Recognitioncited by 7
- 2019Nonlinear Uncertainty Control with Iterative Covariance Steeringcited by 6
- 2023Differentiable Robust Model Predictive Controlcited by 5
- 2025Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfoldingcited by 4
- 2025Solving Quadratic Programs via Deep Unrolled Douglas-Rachford Splittingcited by 2
- 2021Chance-Constrained Covariance Steering in a Gaussian Random Field via Successive Convex Programmingcited by 1
- 2021Covariance Control of Discrete-Time Gaussian Linear Systems Using Affine Disturbance Feedback Control Policiescited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.