mlsanityData to 13 Oct 2026

An Impossibility Theorem for Node Embedding

arXiv 2105.13251 ↗First posted 27 May 2021cs.LG cs.DM stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

With the increasing popularity of graph-based methods for dimensionality reduction and representation learning, node embedding functions have become important objects of study in the literature. In this paper, we take an axiomatic approach to understanding node embedding methods, first stating three properties for embedding dissimilarity networks, then proving that all three cannot be satisfied simultaneously by any node embedding method. Similar to existing results on the impossibility of clustering under certain axiomatic assumptions, this points to fundamental difficulties inherent to node embedding tasks. Once these difficulties are identified, we then relax these axioms to allow for certain node embedding methods to be admissible in our framework.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 70 references that are in the map. First posted on arXiv 27 May 2021.

Builds on

18 of 70 references.

References · 18

  1. 2017Inductive Representation Learning on Large Graphscited by 6,303
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,360
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,467
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,915
  5. 2014DeepWalk: Online Learning of Social Representationscited by 1,544
  6. 2016Geometric deep learning: going beyond Euclidean datacited by 1,045
  7. 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
  8. 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 198
  9. 2017Graph Embedding Techniques, Applications, and Performance: A Surveycited by 188
  10. 2017Network Representation Learning: A Surveycited by 101
  11. 2020Understanding graph embedding methods and their applicationscited by 50
  12. 2020The impossibility of low rank representations for triangle-rich complex networkscited by 32
6 more
  1. 2020Node Embeddings and Exact Low-Rank Representations of Complex Networkscited by 21
  2. 2013Axiomatic Construction of Hierarchical Clustering in Asymmetric Networkscited by 5
  3. 2014Hierarchical Quasi-Clustering Methods for Asymmetric Networkscited by 4
  4. 2019Metric Representations of Network Datacited by 2
  5. 2021Free Energy Node Embedding via Generalized Skip-gram with Negative Samplingcited by 2
  6. 2017Preserving Local and Global Information for Network Embeddingcited by 1

Built on by

Not cited yet.