mlsanityData to 14 Oct 2026

Neural-prior stochastic block model

arXiv 2303.09995 ↗First posted 17 Mar 2023cond-mat.dis-nn cs.SI stat.MLcited by 4

Not on the map. Why?

Abstract (arXiv)

The stochastic block model (SBM) is widely studied as a benchmark for graph clustering aka community detection. In practice, graph data often come with node attributes that bear additional information about the communities. Previous works modeled such data by considering that the node attributes are generated from the node community memberships. In this work, motivated by a recent surge of works in signal processing using deep neural networks as priors, we propose to model the communities as being determined by the node attributes rather than the opposite. We define the corresponding model; we call it the neural-prior SBM. We propose an algorithm, stemming from statistical physics, based on a combination of belief propagation and approximate message passing. We analyze the performance of the algorithm as well as the Bayes-optimal performance. We identify detectability and exact recovery phase transitions, as well as an algorithmically hard region. The proposed model and algorithm can be used as a benchmark for both theory and algorithms. To illustrate this, we compare the optimal performances to the performance of simple graph neural networks.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 17 Mar 2023.

Builds on

24 of 42 references.

References · 24

  1. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  2. 2017Community Detection and Stochastic Block Modelscited by 319
  3. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
  4. 2020Model-Based Deep Learningcited by 141
  5. 2018Contextual Stochastic Block Modelscited by 134
  6. 2015Statistical physics of inference: Thresholds and algorithmscited by 128
  7. 2021Learning curves of generic features maps for realistic datasets with a teacher-student modelcited by 126
  8. 2017Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Modelscited by 116
  9. 2014Exact Recovery in the Stochastic Block Modelcited by 78
  10. 2013Spectral redemption: clustering sparse networkscited by 56
  11. 2018Entropy and mutual information in models of deep neural networkscited by 51
  12. 2014Community Detection in Networks with Node Attributescited by 44
12 more
  1. 2013A Proof Of The Block Model Threshold Conjecturecited by 36
  2. 2021Graph-based Approximate Message Passing Iterationscited by 35
  3. 2014Covariate-assisted spectral clusteringcited by 29
  4. 2017Bayesian stochastic blockmodelingcited by 27
  5. 2020Contextual Stochastic Block Model: Sharp Thresholds and Contiguitycited by 22
  6. 2019The spiked matrix model with generative priorscited by 20
  7. 2022Learning curves for the multi-class teacher-student perceptroncited by 17
  8. 2022Synthetic Graph Generation to Benchmark Graph Learningcited by 16
  9. 2017Multi-Layer Generalized Linear Estimationcited by 12
  10. 2014Phase transitions in semisupervised clustering of sparse networkscited by 5
  11. 2022On Classification Thresholds for Graph Attention with Edge Featurescited by 5
  12. 2022Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Costcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2; 2025: 1.

4 papers.