mlsanityData to 14 Oct 2026

Unsupervised Learning via Network-Aware Embeddings

arXiv 2309.10408 ↗First posted 19 Sep 2023cs.LG cs.AI cs.SIcited by 0

Not on the map. Why?

Abstract (arXiv)

Data clustering, the task of grouping observations according to their similarity, is a key component of unsupervised learning -- with real world applications in diverse fields such as biology, medicine, and social science. Often in these fields the data comes with complex interdependencies between the dimensions of analysis, for instance the various characteristics and opinions people can have live on a complex social network. Current clustering methods are ill-suited to tackle this complexity: deep learning can approximate these dependencies, but not take their explicit map as the input of the analysis. In this paper, we aim at fixing this blind spot in the unsupervised learning literature. We can create network-aware embeddings by estimating the network distance between numeric node attributes via the generalized Euclidean distance. Differently from all methods in the literature that we know of, we do not cluster the nodes of the network, but rather its node attributes. In our experiments we show that having these network embeddings is always beneficial for the learning task; that our method scales to large networks; and that we can actually provide actionable insights in applications in a variety of fields such as marketing, economics, and political science. Our method is fully open source and data and code are available to reproduce all results in the paper.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 68 references that are in the map. First posted on arXiv 19 Sep 2023.

Builds on

26 of 68 references.

References · 26

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  5. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  7. 2016Variational Graph Auto-Encoderscited by 1,382
  8. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  9. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  10. 2017Generative Adversarial Networks: An Overviewcited by 590
  11. 2020Graph Clustering with Graph Neural Networkscited by 163
  12. 2019Attributed Graph Clustering: A Deep Attentional Embedding Approachcited by 149
14 more
  1. 2020Structural Deep Clustering Networkcited by 145
  2. 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 114
  3. 2016Community detection in networks: A user guidecited by 105
  4. 2013Multilayer Networkscited by 87
  5. 2014The structure and dynamics of multilayer networkscited by 51
  6. 2018Clustering with Deep Learning: Taxonomy and New Methodscited by 46
  7. 2014Community Detection in Networks with Node Attributescited by 44
  8. 2016The ground truth about metadata and community detection in networkscited by 42
  9. 2019Community detection in node-attributed social networks: a surveycited by 24
  10. 2016Approximate Gaussian Elimination for Laplacians: Fast, Sparse, and Simplecited by 23
  11. 2015Clustering attributed graphs: models, measures and methodscited by 20
  12. 2017Network Backboning with Noisy Datacited by 11
  13. 2021The Atlas for the Aspiring Network Scientistcited by 4
  14. 2021Variational Co-embedding Learning for Attributed Network Clusteringcited by 4

Built on by

Not cited yet.