# Learning to Learn Graph Topologies

arXiv: https://arxiv.org/abs/2110.09807 · HTML: https://mlsanity.com/paper/2110.09807/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 49 references that are in the map.
- First posted on arXiv 19 Oct 2021.

## Builds on (most cited first, 17 of 17)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Auto-Encoding Variational Bayes](https://mlsanity.com/paper/1312.6114/) (2013)
- [Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing](https://mlsanity.com/paper/1912.10557/) (2019)
- [Graph Signal Processing: Overview, Challenges and Applications](https://mlsanity.com/paper/1712.00468/) (2017)
- [Learning Deep CNN Denoiser Prior for Image Restoration](https://mlsanity.com/paper/1704.03264/) (2017)
- [Understanding disentangling in β-VAE](https://mlsanity.com/paper/1804.03599/) (2018)
- [Learning to Optimize: A Primer and A Benchmark](https://mlsanity.com/paper/2103.12828/) (2021)
- [How to learn a graph from smooth signals](https://mlsanity.com/paper/1601.02513/) (2016)
- [One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Models](https://mlsanity.com/paper/1703.09912/) (2017)
- [Learning step sizes for unfolded sparse coding](https://mlsanity.com/paper/1905.11071/) (2019)
- [Playing with Duality: An Overview of Recent Primal-Dual Approaches for Solving Large-Scale Optimization Problems](https://mlsanity.com/paper/1406.5429/) (2014)
- [GLAD: Learning Sparse Graph Recovery](https://mlsanity.com/paper/1906.00271/) (2019)
- [Structured Graph Learning Via Laplacian Spectral Constraints](https://mlsanity.com/paper/1909.11594/) (2019)
- [Estimation of positive definite M-matrices and structure learning for attractive Gaussian Markov Random fields](https://mlsanity.com/paper/1404.6640/) (2014)
- [Learning to Discover Sparse Graphical Models](https://mlsanity.com/paper/1605.06359/) (2016)
- [Understanding the Learned Iterative Soft Thresholding Algorithm with matrix factorization](https://mlsanity.com/paper/1706.01338/) (2017)

## Built on by (most cited first, 26 of 26)

- [Robust Graph Structure Learning under Heterophily](https://mlsanity.com/paper/2403.03659/) (2024)
- [Learning Hypergraphs From Signals With Dual Smoothness Prior](https://mlsanity.com/paper/2211.01717/) (2022)
- [Latent Graph Inference with Limited Supervision](https://mlsanity.com/paper/2310.04314/) (2023)
- [Methods for Recovering Conditional Independence Graphs: A Survey](https://mlsanity.com/paper/2211.06829/) (2022)
- [uGLAD: Sparse graph recovery by optimizing deep unrolled networks](https://mlsanity.com/paper/2205.11610/) (2022)
- [Stochastic Unrolled Federated Learning](https://mlsanity.com/paper/2305.15371/) (2023)
- [Learning Graph Structure from Convolutional Mixtures](https://mlsanity.com/paper/2205.09575/) (2022)
- [A Markov Random Field model for Hypergraph-based Machine Learning](https://mlsanity.com/paper/2308.14172/) (2023)
- [Hypergraph-MLP: Learning on Hypergraphs without Message Passing](https://mlsanity.com/paper/2312.09778/) (2023)
- [Learning Latent Graph Structures and their Uncertainty](https://mlsanity.com/paper/2405.19933/) (2024)
- [Graph Structure Learning with Interpretable Bayesian Neural Networks](https://mlsanity.com/paper/2406.14786/) (2024)
- [Neural Graph Revealers](https://mlsanity.com/paper/2302.13582/) (2023)
- [ASGNN: Graph Neural Networks with Adaptive Structure](https://mlsanity.com/paper/2210.01002/) (2022)
- [Heterogeneous Graph Structure Learning through the Lens of Data-generating Processes](https://mlsanity.com/paper/2503.08760/) (2025)
- [Unrolled Graph Learning for Multi-Agent Collaboration](https://mlsanity.com/paper/2210.17101/) (2022)
- [Graph Learning Across Data Silos](https://mlsanity.com/paper/2301.06662/) (2023)
- [SF-SGL: Solver-Free Spectral Graph Learning from Linear Measurements](https://mlsanity.com/paper/2302.04384/) (2023)
- [Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning](https://mlsanity.com/paper/2403.06535/) (2024)
- [Are uGLAD? Time will tell!](https://mlsanity.com/paper/2303.11647/) (2023)
- [Knowledge Propagation over Conditional Independence Graphs](https://mlsanity.com/paper/2308.05857/) (2023)
- [Learning to Learn Financial Networks for Optimising Momentum Strategies](https://mlsanity.com/paper/2308.12212/) (2023)
- [Joint Data Inpainting and Graph Learning via Unrolled Neural Networks](https://mlsanity.com/paper/2407.11429/) (2024)
- [LASE: Learned Adjacency Spectral Embeddings](https://mlsanity.com/paper/2412.17734/) (2024)
- [Dynamic Elliptical Graph Factor Models via Riemannian Optimization with Geodesic Temporal Regularization](https://mlsanity.com/paper/2605.18316/) (2026)
- [Multi-Source Wasserstein Distributionally Robust Graph Learning](https://mlsanity.com/paper/2608.19914/) (2026)
- [From topology learning to graph generation: A unifying perspective](https://mlsanity.com/paper/2609.02286/) (2026)

## Abstract (arXiv)

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the problem can be formulated as a regularised convex optimisation over a positive semidefinite cone and solved by iterative algorithms. Classic methods require an explicit convex function to reflect generic topological priors, e.g. the ℓ1 penalty for enforcing sparsity, which limits the flexibility and expressiveness in learning rich topological structures. We propose to learn a mapping from node data to the graph structure based on the idea of learning to optimise (L2O). Specifically, our model first unrolls an iterative primal-dual splitting algorithm into a neural network. The key structural proximal projection is replaced with a variational autoencoder that refines the estimated graph with enhanced topological properties. The model is trained in an end-to-end fashion with pairs of node data and graph samples. Experiments on both synthetic and real-world data demonstrate that our model is more efficient than classic iterative algorithms in learning a graph with specific topological properties.
