mlsanityData to 7 Oct 2026

Empowering Contrastive Federated Sequential Recommendation with LLMs

arXiv 2602.09306 ↗First posted 10 Feb 2026cs.LG cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated sequential recommendation (FedSeqRec) aims to perform next-item prediction while keeping user data decentralised, yet model quality is frequently constrained by fragmented, noisy, and homogeneous interaction logs stored on individual devices. Many existing approaches attempt to compensate through manual data augmentation or additional server-side constraints, but these strategies either introduce limited semantic diversity or increase system overhead. To overcome these challenges, we propose LUMOS, a parameter-isolated FedSeqRec architecture that integrates large language models (LLMs) as local semantic generators. Instead of sharing gradients or auxiliary parameters, LUMOS privately invokes an on-device LLM to construct three complementary sequence variants from each user history: (i) future-oriented trajectories that infer plausible behavioural continuations, (ii) semantically equivalent rephrasings that retain user intent while diversifying interaction patterns, and (iii) preference-inconsistent counterfactuals that serve as informative negatives. These synthesized sequences are jointly encoded within the federated backbone through a tri-view contrastive optimisation scheme, enabling richer representation learning without exposing sensitive information. Experimental results across three public benchmarks show that LUMOS achieves consistent gains over competitive centralised and federated baselines on HR@20 and NDCG@20. In addition, the use of semantically grounded positive signals and counterfactual negatives improves robustness under noisy and adversarial environments, even without dedicated server-side protection modules. Overall, this work demonstrates the potential of LLM-driven semantic generation as a new paradigm for advancing privacy-preserving federated recommendation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 90 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

48 of 90 references.

References · 48

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  3. 2018Self-Attentive Sequential Recommendationcited by 1,169
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  5. 2017Neural Collaborative Filteringcited by 1,108
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  7. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  8. 2023A Survey on Large Language Models for Recommendationcited by 378
  9. 2020Self-supervised Graph Learning for Recommendationcited by 305
  10. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
  11. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  12. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
36 more
  1. 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
  2. 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
  3. 2019Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation Systemcited by 79
  4. 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
  5. 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
  6. 2022XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendationcited by 57
  7. 2021Stronger Privacy for Federated Collaborative Filtering with Implicit Feedbackcited by 26
  8. 2024FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Modelscited by 26
  9. 2023Interaction-level Membership Inference Attack Against Federated Recommender Systemscited by 23
  10. 2023Semi-decentralized Federated Ego Graph Learning for Recommendationcited by 22
  11. 2024Federated Large Language Models: Current Progress and Future Directionscited by 22
  12. 2021Prototype Learning for Interpretable Respiratory Sound Analysiscited by 21
  13. 2022Multi-view Multi-behavior Contrastive Learning in Recommendationcited by 21
  14. 2022Comprehensive Privacy Analysis on Federated Recommender System against Attribute Inference Attackscited by 21
  15. 2023HeteFedRec: Federated Recommender Systems with Model Heterogeneitycited by 20
  16. 2024On-Device Recommender Systems: A Comprehensive Surveycited by 20
  17. 2022Efficient Integration of Multi-Order Dynamics and Internal Dynamics in Stock Movement Predictioncited by 18
  18. 2023One Model for All: Large Language Models are Domain-Agnostic Recommendation Systemscited by 17
  19. 2022Untargeted Attack against Federated Recommendation Systems via Poisonous Item Embeddings and the Defensecited by 16
  20. 2023Contrastive Self-supervised Learning in Recommender Systems: A Surveycited by 14
  21. 2024Manipulating Recommender Systems: A Survey of Poisoning Attacks and Countermeasurescited by 14
  22. 2022Poisoning Deep Learning Based Recommender Model in Federated Learning Scenarioscited by 13
  23. 2022Detecting Rumours with Latency Guarantees using Massive Streaming Datacited by 12
  24. 2023PerFedRec++: Enhancing Personalized Federated Recommendation with Self-Supervised Pre-Trainingcited by 12
  25. 2024Diffusion-Based Cloud-Edge-Device Collaborative Learning for Next POI Recommendationscited by 12
  26. 2024Towards Personalized Privacy: User-Governed Data Contribution for Federated Recommendationcited by 11
  27. 2022Model-Agnostic and Diverse Explanations for Streaming Rumour Graphscited by 9
  28. 2023Hide Your Model: A Parameter Transmission-free Federated Recommender Systemcited by 9
  29. 2024Fast-FedUL: A Training-Free Federated Unlearning with Provable Skew Resiliencecited by 8
  30. 2025Multilingual Text-to-SQL: Benchmarking the Limits of Language Models with Collaborative Language Agentscited by 7
  31. 2022FedCL: Federated Contrastive Learning for Privacy-Preserving Recommendationcited by 6
  32. 2023Manipulating Federated Recommender Systems: Poisoning with Synthetic Users and Its Countermeasurescited by 5
  33. 2024Physical Trajectory Inference Attack and Defense in Decentralized POI Recommendationcited by 5
  34. 2024Poisoning Attacks and Defenses in Recommender Systems: A Surveycited by 5
  35. 2024PTF-FSR: A Parameter Transmission-Free Federated Sequential Recommender Systemcited by 5
  36. 2025Handling Heterophily in Recommender Systems with Wavelet Hypergraph Diffusioncited by 1

Built on by

Not cited yet.