Towards Practical Large-scale Dynamical Heterogeneous Graph Embedding: Cold-start Resilient Recommendation
Not on the map. Why?
Abstract (arXiv)
Deploying dynamic heterogeneous graph embeddings in production faces key challenges of scalability, data freshness, and cold-start. This paper introduces a practical, two-stage solution that balances deep graph representation with low-latency incremental updates. Our framework combines HetSGFormer, a scalable graph transformer for static learning, with Incremental Locally Linear Embedding (ILLE), a lightweight, CPU-based algorithm for real-time updates. HetSGFormer captures global structure with linear scalability, while ILLE provides rapid, targeted updates to incorporate new data, thus avoiding costly full retraining. This dual approach is cold-start resilient, leveraging the graph to create meaningful embeddings from sparse data. On billion-scale graphs, A/B tests show HetSGFormer achieved up to a 6.11% lift in Advertiser Value over previous methods, while the ILLE module added another 3.22% lift and improved embedding refresh timeliness by 83.2%. Our work provides a validated framework for deploying dynamic graph learning in production environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
27 of 46 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2020Heterogeneous Graph Transformercited by 582
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2021Mesh Graphormercited by 265
15 more
- 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 195
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 148
- 2021A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directionscited by 144
- 2017Heterogeneous Information Network Embedding for Recommendationcited by 133
- 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
- 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 87
- 2022A Survey of Graph Neural Networks for Social Recommender Systemscited by 65
- 2018Dynamic Graph Representation Learning via Self-Attention Networkscited by 39
- 2022How Expressive are Transformers in Spectral Domain for Graphs?cited by 15
- 2020Modelling High-Order Social Relations for Item Recommendationcited by 13
- 2019Hierarchical Attentive Knowledge Graph Embedding for Personalized Recommendationcited by 9
- 2021Recommender systems based on graph embedding techniques: A comprehensive reviewcited by 8
Built on by
Not cited yet.