Difference-of-Convex Regularization for Graph Learning by Differentiable Programming
Not on the map. Why?
Abstract (arXiv)
Laplacian-regularized minimization is fundamental in signal processing and machine learning, but explicit construction of the dense graph Laplacian pseudoinverse can be computationally expensive. To address this issue, we consider the setting where the graph Laplacian is given and propose a Difference-of-Convex Regularizer (DCR) graph learning framework that learns a reusable approximation of the pseudoinverse action through regularized Maximum Likelihood Estimation (MLE) and shrinkage-regularized Convex--Concave Procedure (CCCP) iterations. For Laplacian-Regularized Nonnegative Least Squares (LR-NNLS), dual and Karush-Kuhn-Tucker (KKT) analysis motivates separating graph-dependent pseudoinverse learning from instance-specific optimization. The learned pseudoinverse is embedded into a differentiable primal optimization procedure as a graph-aware preconditioner for nonnegative reconstruction and can be reused across LR-NNLS instances sharing the same graph. We establish stability and fixed-point existence guarantees for the proposed pseudoinverse-learning iteration. Experiments across different graph topologies and scales demonstrate near-reference accuracy, competitive time-to-moderate-accuracy behavior, and effective cross-instance reuse across independently generated problem instances sharing the same graph.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 56 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
19 of 56 references.
References · 19
- 2021Convex optimizationcited by 2,515
- 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2024The Elements of Differentiable Programmingcited by 43
- 2016Disciplined Convex-Concave Programmingcited by 29
- 2014Regularized Tyler's Scatter Estimator: Existence, Uniqueness, and Algorithmscited by 12
- 2023Graph Convolutions Enrich the Self-Attention in Transformers!cited by 11
- 2022CCCP is Frank-Wolfe in disguisecited by 8
- 2024Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalizationcited by 6
- 2018Distributed Majorization-Minimization for Laplacian Regularized Problemscited by 4
- 2020Pseudoinverse Graph Convolutional Networks: Fast Filters Tailored for Large Eigengaps of Dense Graphs and Hypergraphscited by 3
- 2014A graph Laplacian regularization for hyperspectral data unmixingcited by 2
7 more
- 2019Reducing the Computational Complexity of Pseudoinverse for the Incremental Broad Learning System on Added Inputscited by 1
- 2021Minimizing Oracle-Structured Composite Functionscited by 1
- 2023Computing one-bit compressive sensing via zero-norm regularized DC loss model and its surrogatecited by 1
- 2023A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problemscited by 1
- 2025Iterative Polynomial Approximation Algorithms for Inverse Graph Filterscited by 1
- 2026Learning to Optimize by Differentiable Programmingcited by 1
- 2026Accelerating Regularized Attention Kernel Regression for Spectrum Cartographycited by 1
Built on by
Not cited yet.