Hashing-Accelerated Graph Neural Networks for Link Prediction
Not on the map. Why?
Abstract (arXiv)
Networks are ubiquitous in the real world. Link prediction, as one of the key problems for network-structured data, aims to predict whether there exists a link between two nodes. The traditional approaches are based on the explicit similarity computation between the compact node representation by embedding each node into a low-dimensional space. In order to efficiently handle the intensive similarity computation in link prediction, the hashing technique has been successfully used to produce the node representation in the Hamming space. However, the hashing-based link prediction algorithms face accuracy loss from the randomized hashing techniques or inefficiency from the learning to hash techniques in the embedding process. Currently, the Graph Neural Network (GNN) framework has been widely applied to the graph-related tasks in an end-to-end manner, but it commonly requires substantial computational resources and memory costs due to massive parameter learning, which makes the GNN-based algorithms impractical without the help of a powerful workhorse. In this paper, we propose a simple and effective model called #GNN, which balances the trade-off between accuracy and efficiency. #GNN is able to efficiently acquire node representation in the Hamming space for link prediction by exploiting the randomized hashing technique to implement message passing and capture high-order proximity in the GNN framework. Furthermore, we characterize the discriminative power of #GNN in probability. The extensive experimental results demonstrate that the proposed #GNN algorithm achieves accuracy comparable to the learning-based algorithms and outperforms the randomized algorithm, while running significantly faster than the learning-based algorithms. Also, the proposed algorithm shows excellent scalability on a large-scale network with the limited resources.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 23 of its 59 references that are in the map. First posted on arXiv 29 May 2021.
Builds on
23 of 59 references.
References · 23
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2015LINE: Large-scale Information Network Embeddingcited by 582
11 more
- 2015A Review of Relational Machine Learning for Knowledge Graphscited by 264
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2019Position-aware Graph Neural Networkscited by 203
- 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 197
- 2019Dynamic Graph Message Passing Networkscited by 62
- 2019SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentationcited by 55
- 2020Learning to Hash with Graph Neural Networks for Recommender Systemscited by 31
- 2017Deriving Neural Architectures from Sequence and Graph Kernelscited by 23
- 2018A Review for Weighted MinHash Algorithmscited by 4
- 2017Improved Consistent Weighted Sampling Revisitedcited by 3
- 2018Flexible Attributed Network Embeddingcited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 5; 2024: 4.
14 papers.
Sort:
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022PaSca: a Graph Neural Architecture Search System under the Scalable Paradigmcited by 37
- 2023Revisiting Link Prediction: A Data Perspectivecited by 29
- 2023Simplifying Subgraph Representation Learning for Scalable Link Predictioncited by 7
- 2023NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environmentscited by 5
- 2022A Lower Bound of Hash Codes' Performancecited by 2
- 2024RCoCo: Contrastive Collective Link Prediction across Multiplex Network in Riemannian Spacecited by 2
- 2023Graph Representation Learning for Interactive Biomolecule Systemscited by 1
- 2023From random-walks to graph-sprints: a low-latency node embedding framework on continuous-time dynamic graphscited by 1
- 2024PROXI: Challenging the GNNs for Link Predictioncited by 1
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimizationcited by 1
- 2021QUINT: Node embedding using network hashingcited by 0
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimization16 Dec 2024
- 2024PROXI: Challenging the GNNs for Link Prediction2 Oct 2024
- 2024Deep-Graph-Sprints: Accelerated Representation Learning in Continuous-Time Dynamic Graphs10 Jul 2024
- 2024RCoCo: Contrastive Collective Link Prediction across Multiplex Network in Riemannian Space4 Mar 2024
- 2023NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments22 Nov 2023
- 2023Revisiting Link Prediction: A Data Perspective1 Oct 2023
- 2023From random-walks to graph-sprints: a low-latency node embedding framework on continuous-time dynamic graphs17 Jul 2023
- 2023Graph Representation Learning for Interactive Biomolecule Systems5 Apr 2023
- 2023Simplifying Subgraph Representation Learning for Scalable Link Prediction29 Jan 2023
- 2022A Lower Bound of Hash Codes' Performance12 Oct 2022
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketching30 Sep 2022
- 2022Learning Similarity Preserving Binary Codes for Recommender Systems18 Apr 2022
2 more
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022PaSca: a Graph Neural Architecture Search System under the Scalable Paradigmcited by 37
- 2023Revisiting Link Prediction: A Data Perspectivecited by 29
- 2023Simplifying Subgraph Representation Learning for Scalable Link Predictioncited by 7
- 2023NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environmentscited by 5
- 2022A Lower Bound of Hash Codes' Performancecited by 2
- 2024RCoCo: Contrastive Collective Link Prediction across Multiplex Network in Riemannian Spacecited by 2
- 2023Graph Representation Learning for Interactive Biomolecule Systemscited by 1
- 2023From random-walks to graph-sprints: a low-latency node embedding framework on continuous-time dynamic graphscited by 1
- 2024PROXI: Challenging the GNNs for Link Predictioncited by 1
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimizationcited by 1
- 2021QUINT: Node embedding using network hashingcited by 0
12 most cited of 14 All 14 (JSON)
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimization16 Dec 2024
- 2024PROXI: Challenging the GNNs for Link Prediction2 Oct 2024
- 2024Deep-Graph-Sprints: Accelerated Representation Learning in Continuous-Time Dynamic Graphs10 Jul 2024
- 2024RCoCo: Contrastive Collective Link Prediction across Multiplex Network in Riemannian Space4 Mar 2024
- 2023NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments22 Nov 2023
- 2023Revisiting Link Prediction: A Data Perspective1 Oct 2023
- 2023From random-walks to graph-sprints: a low-latency node embedding framework on continuous-time dynamic graphs17 Jul 2023
- 2023Graph Representation Learning for Interactive Biomolecule Systems5 Apr 2023
- 2023Simplifying Subgraph Representation Learning for Scalable Link Prediction29 Jan 2023
- 2022A Lower Bound of Hash Codes' Performance12 Oct 2022
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketching30 Sep 2022
- 2022Learning Similarity Preserving Binary Codes for Recommender Systems18 Apr 2022
12 newest of 14 All 14 (JSON)