Neural-prior stochastic block model
Not on the map. Why?
Abstract (arXiv)
The stochastic block model (SBM) is widely studied as a benchmark for graph clustering aka community detection. In practice, graph data often come with node attributes that bear additional information about the communities. Previous works modeled such data by considering that the node attributes are generated from the node community memberships. In this work, motivated by a recent surge of works in signal processing using deep neural networks as priors, we propose to model the communities as being determined by the node attributes rather than the opposite. We define the corresponding model; we call it the neural-prior SBM. We propose an algorithm, stemming from statistical physics, based on a combination of belief propagation and approximate message passing. We analyze the performance of the algorithm as well as the Bayes-optimal performance. We identify detectability and exact recovery phase transitions, as well as an algorithmically hard region. The proposed model and algorithm can be used as a benchmark for both theory and algorithms. To illustrate this, we compare the optimal performances to the performance of simple graph neural networks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 17 Mar 2023.
Builds on
24 of 42 references.
References · 24
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2017Community Detection and Stochastic Block Modelscited by 319
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2020Model-Based Deep Learningcited by 141
- 2018Contextual Stochastic Block Modelscited by 134
- 2015Statistical physics of inference: Thresholds and algorithmscited by 128
- 2021Learning curves of generic features maps for realistic datasets with a teacher-student modelcited by 126
- 2017Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Modelscited by 116
- 2014Exact Recovery in the Stochastic Block Modelcited by 78
- 2013Spectral redemption: clustering sparse networkscited by 56
- 2018Entropy and mutual information in models of deep neural networkscited by 51
- 2014Community Detection in Networks with Node Attributescited by 44
12 more
- 2013A Proof Of The Block Model Threshold Conjecturecited by 36
- 2021Graph-based Approximate Message Passing Iterationscited by 35
- 2014Covariate-assisted spectral clusteringcited by 29
- 2017Bayesian stochastic blockmodelingcited by 27
- 2020Contextual Stochastic Block Model: Sharp Thresholds and Contiguitycited by 22
- 2019The spiked matrix model with generative priorscited by 20
- 2022Learning curves for the multi-class teacher-student perceptroncited by 17
- 2022Synthetic Graph Generation to Benchmark Graph Learningcited by 16
- 2017Multi-Layer Generalized Linear Estimationcited by 12
- 2014Phase transitions in semisupervised clustering of sparse networkscited by 5
- 2022On Classification Thresholds for Graph Attention with Edge Featurescited by 5
- 2022Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Costcited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 1.
4 papers.
- 2023Optimal Inference in Contextual Stochastic Block Modelscited by 12
- 2024Optimal thresholds and algorithms for a model of multi-modal learning in high dimensionscited by 4
- 2024Asymptotic generalization error of a single-layer graph convolutional networkcited by 3
- 2025Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block modelcited by 2
- 2025Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block model3 Mar 2025
- 2024Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions3 Jul 2024
- 2024Asymptotic generalization error of a single-layer graph convolutional network6 Feb 2024
- 2023Optimal Inference in Contextual Stochastic Block Models6 Jun 2023