mlsanityData to 7 Oct 2026

Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems

arXiv 2507.01035 ↗First posted 21 Jun 2025cs.LG cs.AI cs.PFcited by 2

Not on the map. Why?

Abstract (arXiv)

The incessant advent of online services demands high speed and efficient recommender systems (ReS) that can maintain real-time performance along with processing very complex user-item interactions. The present study, therefore, considers computational bottlenecks involved in hybrid Graph Neural Network (GNN) and Large Language Model (LLM)-based ReS with the aim optimizing their inference latency and training efficiency. An extensive methodology was used: hybrid GNN-LLM integrated architecture-optimization strategies(quantization, LoRA, distillation)-hardware acceleration (FPGA, DeepSpeed)-all under R 4.4.2. Experimental improvements were significant, with the optimal Hybrid + FPGA + DeepSpeed configuration reaching 13.6% more accuracy (NDCG@10: 0.75) at 40-60ms of latency, while LoRA brought down training time by 66% (3.8 hours) in comparison to the non-optimized baseline. Irrespective of domain, such as accuracy or efficiency, it can be established that hardware-software co-design and parameter-efficient tuning permit hybrid models to outperform GNN or LLM approaches implemented independently. It recommends the use of FPGA as well as LoRA for real-time deployment. Future work should involve federated learning along with advanced fusion architectures for better scalability and privacy preservation. Thus, this research marks the fundamental groundwork concerning next-generation ReS balancing low-latency response with cutting-edge personalization.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

10 of 21 references.

References · 10

  1. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  2. 2024Compact Language Models via Pruning and Knowledge Distillationcited by 142
  3. 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 141
  4. 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
  5. 2022Merlin HugeCTR: GPU-accelerated Recommender System Training and Inferencecited by 20
  6. 2024Personalized Audiobook Recommendations at Spotify Through Graph Neural Networkscited by 14
  7. 2022LL-GNN: Low Latency Graph Neural Networks on FPGAs for High Energy Physicscited by 12
  8. 2022Low-latency Mini-batch GNN Inference on CPU-FPGA Heterogeneous Platformcited by 7
  9. 2025Reforge: Low-Latency Distributed GNN Serving with Selective Embedding Recomputationcited by 2
  10. 2024A Novel Evaluation Perspective on GNNs-based Recommender Systems through the Topology of the User-Item Graphcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.