mlsanityData to 7 Oct 2026

Simplifying complex machine learning by linearly separable network embedding spaces

arXiv 2410.01865 ↗First posted 2 Oct 2024cs.SI cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Low-dimensional embeddings are a cornerstone in the modelling and analysis of complex networks. However, most existing approaches for mining network embedding spaces rely on computationally intensive machine learning systems to facilitate downstream tasks. In the field of NLP, word embedding spaces capture semantic relationships textitlinearly, allowing for information retrieval using textitsimple linear operations on word embedding vectors. Here, we demonstrate that there are structural properties of network data that yields this linearity. We show that the more homophilic the network representation, the more linearly separable the corresponding network embedding space, yielding better downstream analysis results. Hence, we introduce novel graphlet-based methods enabling embedding of networks into more linearly separable spaces, allowing for their better mining. Our fundamental insights into the structure of network data that enable their textitlinear mining and exploitation enable the ML community to build upon, towards efficiently and explainably mining of the complex network data.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

24 of 62 references.

References · 24

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  4. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  5. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  7. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  8. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  9. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  10. 2015LINE: Large-scale Information Network Embeddingcited by 582
  11. 2019Multi-scale Attributed Node Embeddingcited by 543
  12. 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 312
12 more
  1. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  2. 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
  3. 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 197
  4. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  5. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  6. 2021Graph Representation Learning in Biomedicinecited by 79
  7. 2021Reconstruction for Powerful Graph Representationscited by 65
  8. 2023Linear Spaces of Meanings: Compositional Structures in Vision-Language Modelscited by 48
  9. 2014Exploring the structure and function of temporal networks with dynamic graphletscited by 10
  10. 2017Stochastic Graphlet Embeddingcited by 9
  11. 2018HONE: Higher-Order Network Embeddingscited by 6
  12. 2014New SVD based initialization strategy for Non-negative Matrix Factorizationcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.