A Privacy Preserving System for Movie Recommendations Using Federated Learning
Not on the map. Why?
Abstract (arXiv)
Recommender systems have become ubiquitous in the past years. They solve the tyranny of choice problem faced by many users, and are utilized by many online businesses to drive engagement and sales. Besides other criticisms, like creating filter bubbles within social networks, recommender systems are often reproved for collecting considerable amounts of personal data. However, to personalize recommendations, personal information is fundamentally required. A recent distributed learning scheme called federated learning has made it possible to learn from personal user data without its central collection. Consequently, we present a recommender system for movie recommendations, which provides privacy and thus trustworthiness on multiple levels: First and foremost, it is trained using federated learning and thus, by its very nature, privacy-preserving, while still enabling users to benefit from global insights. Furthermore, a novel federated learning scheme, called FedQ, is employed, which not only addresses the problem of non-i.i.d.-ness and small local datasets, but also prevents input data reconstruction attacks by aggregating client updates early. Finally, to reduce the communication overhead, compression is applied, which significantly compresses the exchanged neural network parametrizations to a fraction of their original size. We conjecture that this may also improve data privacy through its lossy quantization stage.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 45 of its 102 references that are in the map. First posted on arXiv 7 Mar 2023.
Builds on
45 of 102 references.
References · 45
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2018Group Normalizationcited by 1,514
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2017Neural Collaborative Filteringcited by 1,108
- 2019Deep Leakage from Gradientscited by 1,004
33 more
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
- 2018Federated Learning for Mobile Keyboard Predictioncited by 565
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 415
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 415
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2018Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Datacited by 242
- 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 185
- 2018Expanding the Reach of Federated Learning by Reducing Client Resource Requirementscited by 162
- 2020Optimal Client Sampling for Federated Learningcited by 123
- 2018Federated Learning for Keyword Spottingcited by 95
- 2021FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Taskscited by 84
- 2019Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation Systemcited by 79
- 2018Sparse Binary Compression: Towards Distributed Deep Learning with minimal Communicationcited by 51
- 2022Gradient Obfuscation Gives a False Sense of Security in Federated Learningcited by 37
- 2022On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Datacited by 36
- 2022Joint Privacy Enhancement and Quantization in Federated Learningcited by 34
- 2019Real-World Image Datasets for Federated Learningcited by 30
- 2021Federated Neural Collaborative Filteringcited by 30
- 2020Federated Multi-view Matrix Factorization for Personalized Recommendationscited by 27
- 2019DeepCABAC: A Universal Compression Algorithm for Deep Neural Networkscited by 26
- 2022LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorizationcited by 26
- 2022Data Leakage in Federated Averagingcited by 26
- 2021Federated Learning from Small Datasetscited by 14
- 2020Federating Recommendations Using Differentially Private Prototypescited by 13
- 2021A General Theory for Client Sampling in Federated Learningcited by 8
- 2022Speeding up Heterogeneous Federated Learning with Sequentially Trained Superclientscited by 6
- 2022Recommender Systems and Algorithmic Hatecited by 5
- 2022FedCAT: Towards Accurate Federated Learning via Device Concatenationcited by 1
- 2022Mixed Precision Quantization to Tackle Gradient Leakage Attacks in Federated Learningcited by 1
Built on by
Citing papers per year: 2024: 6.
6 papers.
- 2024Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Frameworkcited by 6
- 2024Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosiscited by 4
- 2024Optimizing Federated Learning by Entropy-Based Client Selectioncited by 3
- 2024FedSlate:A Federated Deep Reinforcement Learning Recommender Systemcited by 1
- 2024Assistive AI for Augmenting Human Decision-makingcited by 0
- 2024LightFusionRec: Lightweight Transformers-Based Cross-Domain Recommendation Modelcited by 0
- 2024Optimizing Federated Learning by Entropy-Based Client Selection2 Nov 2024
- 2024LightFusionRec: Lightweight Transformers-Based Cross-Domain Recommendation Model21 Oct 2024
- 2024Assistive AI for Augmenting Human Decision-making18 Oct 2024
- 2024FedSlate:A Federated Deep Reinforcement Learning Recommender System23 Sep 2024
- 2024Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis2 Jul 2024
- 2024Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Framework3 Jan 2024