Spectral redemption: clustering sparse networks
Not on the map. Why?
Abstract (arXiv)
Spectral algorithms are classic approaches to clustering and community detection in networks. However, for sparse networks the standard versions of these algorithms are suboptimal, in some cases completely failing to detect communities even when other algorithms such as belief propagation can do so. Here we introduce a new class of spectral algorithms based on a non-backtracking walk on the directed edges of the graph. The spectrum of this operator is much better-behaved than that of the adjacency matrix or other commonly used matrices, maintaining a strong separation between the bulk eigenvalues and the eigenvalues relevant to community structure even in the sparse case. We show that our algorithm is optimal for graphs generated by the stochastic block model, detecting communities all the way down to the theoretical limit. We also show the spectrum of the non-backtracking operator for some real-world networks, illustrating its advantages over traditional spectral clustering.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jun 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 10; 2023: 10; 2024: 5; 2025: 10; 2026: 6.
54 papers.
Sort:
By area:
- 2021A Comprehensive Survey on Community Detection with Deep Learningcited by 63
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index modelscited by 17
- 2021Learning Parametrised Graph Shift Operatorscited by 16
- 2021Correlation detection in trees for planted graph alignmentcited by 14
- 2023Curvature-based Clustering on Graphscited by 14
- 2021Spectral embedding for dynamic networks with stability guaranteescited by 13
- 2021Graph neural network initialisation of quantum approximate optimisationcited by 13
- 2023A Comprehensive Review of Community Detection in Graphscited by 12
- 2022Towards Digital Twin Oriented Modelling of Complex Networked Systems and Their Dynamics: A Comprehensive Surveycited by 8
- 2021Two-way kernel matrix puncturing: towards resource-efficient PCA and spectral clusteringcited by 7
- 2023Non-backtracking Graph Neural Networkscited by 7
- 2026A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalizationcited by 7
38 more
- 2021Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphscited by 6
- 2021Estimating Graph Dimension with Cross-validated Eigenvaluescited by 6
- 2025Optimal Spectral Transitions in High-Dimensional Multi-Index Modelscited by 6
- 2022Matrix Completion with Hierarchical Graph Side Informationcited by 5
- 2022Sparse random hypergraphs: Non-backtracking spectra and community detectioncited by 5
- 2021Nonparametric Modeling of Higher-Order Interactions via Hypergraphonscited by 4
- 2021Community detection using low-dimensional network embedding algorithmscited by 4
- 2022Nonbacktracking spectral clustering of nonuniform hypergraphscited by 4
- 2023Neural-prior stochastic block modelcited by 4
- 2024Optimal thresholds and algorithms for a model of multi-modal learning in high dimensionscited by 4
- 2021Descriptive vs. inferential community detection in networks: pitfalls, myths, and half-truthscited by 3
- 2021A Spectral Method for Joint Community Detection and Orthogonal Group Synchronizationcited by 3
- 2022Implicit models, latent compression, intrinsic biases, and cheap lunches in community detectioncited by 3
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)cited by 3
- 2021Bayesian reconstruction of memories stored in neural networks from their connectivitycited by 2
- 2022Approximate sampling and estimation of partition functions using neural networkscited by 2
- 2023Zoo Guide to Network Embeddingcited by 2
- 2023Explainable Graph Spectral Clustering of Text Documentscited by 2
- 2023Consistency of Lloyd's Algorithm Under Perturbationscited by 2
- 2024Community detection with the Bethe-Hessiancited by 2
- 2025Low degree conjecture implies sharp computational thresholds in stochastic block modelcited by 2
- 2023A Network Science perspective of Graph Convolutional Networks: A surveycited by 1
- 2023GRANDE: a neural model over directed multigraphs with application to anti-money launderingcited by 1
- 2024Estimating the number of clusters of a Block Markov Chaincited by 1
- 2024Efficient Graph Coloring with Neural Networks: A Physics-Inspired Approach for Large Graphscited by 1
- 2025Stationary distribution of node2vec random walks on household modelscited by 1
- 2025Sparse corruption in low-rank matrix inference: the PCA benchmarkcited by 1
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Modelscited by 1
- 2022Semi-Supervised Clustering of Sparse Graphs: Crossing the Information-Theoretic Thresholdcited by 0
- 2022Multi-Frequency Joint Community Detection and Phase Synchronizationcited by 0
- 2022One Node at a Time: Node-Level Network Classificationcited by 0
- 2022Exact Recovery of Community Detection in dependent Gaussian Mixture Modelscited by 0
- 2023Revisiting Instance-Optimal Cluster Recovery in the Labeled Stochastic Block Modelcited by 0
- 2025Complex non-backtracking matrix for directed graphscited by 0
- 2025Unfolded Laplacian Spectral Embedding: A Theoretically Grounded Approach to Dynamic Network Representationcited by 0
- 2025Phase Transition for Stochastic Block Model with more than √n Communitiescited by 0
- 2025A roadmap for curvature-based geometric data analysis and learningcited by 0
- 2026Graph energy as a measure of community detectability in networkscited by 0
50 most cited of 54 All 54 (JSON)
- 2026HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models10 Aug 2026
- 2026The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy18 Jul 2026
- 2026Understanding Parallel Samplers in Masked Diffusion via Random Walks on Graphs22 Jun 2026
- 2026A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization11 Feb 2026
- 2026Fundamental Limits of Community Detection in Contextual Multi-Layer Stochastic Block Models9 Feb 2026
- 2026Graph energy as a measure of community detectability in networks8 Jan 2026
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models22 Dec 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)26 Nov 2025
- 2025Sparse corruption in low-rank matrix inference: the PCA benchmark14 Nov 2025
- 2025A roadmap for curvature-based geometric data analysis and learning26 Oct 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities19 Sep 2025
- 2025Unfolded Laplacian Spectral Embedding: A Theoretically Grounded Approach to Dynamic Network Representation18 Aug 2025
38 more
- 2025Complex non-backtracking matrix for directed graphs16 Jul 2025
- 2025Stationary distribution of node2vec random walks on household models26 Feb 2025
- 2025Low degree conjecture implies sharp computational thresholds in stochastic block model20 Feb 2025
- 2025Optimal Spectral Transitions in High-Dimensional Multi-Index Models4 Feb 2025
- 2024Community detection with the Bethe-Hessian5 Nov 2024
- 2024Efficient Graph Coloring with Neural Networks: A Physics-Inspired Approach for Large Graphs2 Aug 2024
- 2024Estimating the number of clusters of a Block Markov Chain25 Jul 2024
- 2024Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions3 Jul 2024
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index models24 May 2024
- 2023Non-backtracking Graph Neural Networks11 Oct 2023
- 2023A Comprehensive Review of Community Detection in Graphs21 Sep 2023
- 2023Consistency of Lloyd's Algorithm Under Perturbations1 Sep 2023
- 2023Explainable Graph Spectral Clustering of Text Documents1 Aug 2023
- 2023Curvature-based Clustering on Graphs19 Jul 2023
- 2023Revisiting Instance-Optimal Cluster Recovery in the Labeled Stochastic Block Model18 Jun 2023
- 2023Zoo Guide to Network Embedding5 May 2023
- 2023Neural-prior stochastic block model17 Mar 2023
- 2023GRANDE: a neural model over directed multigraphs with application to anti-money laundering4 Feb 2023
- 2023A Network Science perspective of Graph Convolutional Networks: A survey12 Jan 2023
- 2022Implicit models, latent compression, intrinsic biases, and cheap lunches in community detection17 Oct 2022
- 2022Exact Recovery of Community Detection in dependent Gaussian Mixture Models23 Sep 2022
- 2022Approximate sampling and estimation of partition functions using neural networks21 Sep 2022
- 2022One Node at a Time: Node-Level Network Classification3 Aug 2022
- 2022Multi-Frequency Joint Community Detection and Phase Synchronization16 Jun 2022
- 2022Semi-Supervised Clustering of Sparse Graphs: Crossing the Information-Theoretic Threshold24 May 2022
- 2022Nonbacktracking spectral clustering of nonuniform hypergraphs27 Apr 2022
- 2022Sparse random hypergraphs: Non-backtracking spectra and community detection14 Mar 2022
- 2022Towards Digital Twin Oriented Modelling of Complex Networked Systems and Their Dynamics: A Comprehensive Survey15 Feb 2022
- 2022Matrix Completion with Hierarchical Graph Side Information2 Jan 2022
- 2021A Spectral Method for Joint Community Detection and Orthogonal Group Synchronization25 Dec 2021
- 2021Descriptive vs. inferential community detection in networks: pitfalls, myths, and half-truths30 Nov 2021
- 2021Community detection using low-dimensional network embedding algorithms4 Nov 2021
- 2021Graph neural network initialisation of quantum approximate optimisation4 Nov 2021
- 2021Estimating Graph Dimension with Cross-validated Eigenvalues6 Aug 2021
- 2021Correlation detection in trees for planted graph alignment15 Jul 2021
- 2021Spectral embedding for dynamic networks with stability guarantees2 Jun 2021
- 2021A Comprehensive Survey on Community Detection with Deep Learning26 May 2021
- 2021Nonparametric Modeling of Higher-Order Interactions via Hypergraphons18 May 2021
50 newest of 54 All 54 (JSON)
- 2021A Comprehensive Survey on Community Detection with Deep Learningcited by 63
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index modelscited by 17
- 2021Learning Parametrised Graph Shift Operatorscited by 16
- 2021Correlation detection in trees for planted graph alignmentcited by 14
- 2023Curvature-based Clustering on Graphscited by 14
- 2021Spectral embedding for dynamic networks with stability guaranteescited by 13
- 2021Graph neural network initialisation of quantum approximate optimisationcited by 13
- 2023A Comprehensive Review of Community Detection in Graphscited by 12
- 2022Towards Digital Twin Oriented Modelling of Complex Networked Systems and Their Dynamics: A Comprehensive Surveycited by 8
- 2021Two-way kernel matrix puncturing: towards resource-efficient PCA and spectral clusteringcited by 7
- 2023Non-backtracking Graph Neural Networkscited by 7
- 2026A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalizationcited by 7
12 most cited of 53 All 53 (JSON)
- 2026HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models10 Aug 2026
- 2026The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy18 Jul 2026
- 2026A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization11 Feb 2026
- 2026Fundamental Limits of Community Detection in Contextual Multi-Layer Stochastic Block Models9 Feb 2026
- 2026Graph energy as a measure of community detectability in networks8 Jan 2026
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models22 Dec 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)26 Nov 2025
- 2025Sparse corruption in low-rank matrix inference: the PCA benchmark14 Nov 2025
- 2025A roadmap for curvature-based geometric data analysis and learning26 Oct 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities19 Sep 2025
- 2025Unfolded Laplacian Spectral Embedding: A Theoretically Grounded Approach to Dynamic Network Representation18 Aug 2025
- 2025Complex non-backtracking matrix for directed graphs16 Jul 2025
12 newest of 53 All 53 (JSON)