Federated Personal Knowledge Graph Completion with Lightweight Large Language Models for Personalized Recommendations
Not on the map. Why?
Abstract (arXiv)
Personalized recommendation increasingly relies on private user data, motivating approaches that can adapt to individuals without centralizing their information. We present Federated Targeted Recommendations with Evolving Knowledge graphs and Language Models (FedTREK-LM), a framework that unifies lightweight large language models (LLMs), evolving personal knowledge graphs (PKGs), federated learning (FL), and Kahneman-Tversky Optimization to enable scalable, decentralized personalization. By prompting LLMs with structured PKGs, FedTREK-LM performs context-aware reasoning for personalized recommendation tasks such as movie and recipe suggestions. Across three lightweight Qwen3 models (0.6B, 1.7B, 4B), FedTREK-LM consistently and substantially outperforms state-of-the-art KG completion and federated recommendation baselines (HAKE, KBGAT, and FedKGRec), achieving more than a 4x improvement in F1-score on the movie and food benchmarks. Our results further show that real user data is critical for effective personalization, as synthetic data degrades performance by up to 46%. Overall, FedTREK-LM offers a practical paradigm for adaptive, LLM-powered personalization that generalizes across decentralized, evolving user PKGs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
24 of 41 references.
References · 24
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2020Flower: A Friendly Federated Learning Research Frameworkcited by 449
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
- 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
- 2018Towards Deep Conversational Recommendationscited by 174
- 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
- 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
- 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
- 2019Reinforcement Knowledge Graph Reasoning for Explainable Recommendationcited by 102
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2020FedE: Embedding Knowledge Graphs in Federated Settingcited by 46
- 2023LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPTcited by 42
12 more
- 2023Empirical Analysis of the Strengths and Weaknesses of PEFT Techniques for LLMscited by 38
- 2024Insights into Alignment: Evaluating DPO and its Variants Across Multiple Taskscited by 35
- 2022Decentralized Collaborative Learning Framework for Next POI Recommendationcited by 13
- 2021Applying Personal Knowledge Graphs to Healthcited by 7
- 2021Personal Health Knowledge Graph for Clinically Relevant Diet Recommendationscited by 7
- 2022GDSRec: Graph-Based Decentralized Collaborative Filtering for Social Recommendationcited by 6
- 2025Mitigating Unintended Memorization with LoRA in Federated Learning for LLMscited by 6
- 2025Federated Fine-Tuning of Large Language Models: Kahneman-Tversky vs. Direct Preference Optimizationcited by 4
- 2025Avoiding Over-Personalization with Rule-Guided Knowledge Graph Adaptation for LLM Recommendationscited by 3
- 2023Trust, Accountability, and Autonomy in Knowledge Graph-based AI for Self-determinationcited by 2
- 2025Aligning Language Models with Investor and Market Behavior for Financial Recommendationscited by 1
- 2025Parallel and Multi-Stage Knowledge Graph Retrieval for Behaviorally Aligned Financial Asset Recommendationscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.