# Practical Lossless Federated Singular Vector Decomposition over Billion-Scale Data

arXiv: https://arxiv.org/abs/2105.08925 · HTML: https://mlsanity.com/paper/2105.08925/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 May 2021.

## Built on by (most cited first, 18 of 18)

- [Vertical Federated Learning: Concepts, Advances and Challenges](https://mlsanity.com/paper/2211.12814/) (2022)
- [A Survey on Heterogeneous Federated Learning](https://mlsanity.com/paper/2210.04505/) (2022)
- [COLA: Cross-city Mobility Transformer for Human Trajectory Simulation](https://mlsanity.com/paper/2403.01801/) (2024)
- [Vertical Federated Knowledge Transfer via Representation Distillation for Healthcare Collaboration Networks](https://mlsanity.com/paper/2302.05675/) (2023)
- [A Survey for Federated Learning Evaluations: Goals and Measures](https://mlsanity.com/paper/2308.11841/) (2023)
- [Federated Analytics: A survey](https://mlsanity.com/paper/2302.01326/) (2023)
- [Class-wise Balancing Data Replay for Federated Class-Incremental Learning](https://mlsanity.com/paper/2507.07712/) (2025)
- [Vertical Federated Learning with Missing Features During Training and Inference](https://mlsanity.com/paper/2410.22564/) (2024)
- [A Survey on Contribution Evaluation in Vertical Federated Learning](https://mlsanity.com/paper/2405.02364/) (2024)
- [UniTrans: A Unified Vertical Federated Knowledge Transfer Framework for Enhancing Cross-Hospital Collaboration](https://mlsanity.com/paper/2501.11388/) (2025)
- [eFedLLM: Efficient LLM Inference Based on Federated Learning](https://mlsanity.com/paper/2411.16003/) (2024)
- [Federated singular value decomposition for high dimensional data](https://mlsanity.com/paper/2205.12109/) (2022)
- [HSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting](https://mlsanity.com/paper/2409.18482/) (2024)
- [Towards Active Participant Centric Vertical Federated Learning: Some Representations May Be All You Need](https://mlsanity.com/paper/2410.17648/) (2024)
- [A Two-Stage Federated Learning Approach for Industrial Prognostics Using Large-Scale High-Dimensional Signals](https://mlsanity.com/paper/2410.11101/) (2024)
- [Decentralized Differentially Private Power Method](https://mlsanity.com/paper/2507.22849/) (2025)
- [Vertical Federated Linear Contextual Bandits](https://mlsanity.com/paper/2210.11050/) (2022)
- [P3LS: Partial Least Squares under Privacy Preservation](https://mlsanity.com/paper/2401.14884/) (2024)

## Abstract (arXiv)

With the enactment of privacy-preserving regulations, e.g., GDPR, federated SVD is proposed to enable SVD-based applications over different data sources without revealing the original data. However, many SVD-based applications cannot be well supported by existing federated SVD solutions. The crux is that these solutions, adopting either differential privacy (DP) or homomorphic encryption (HE), suffer from accuracy loss caused by unremovable noise or degraded efficiency due to inflated data. In this paper, we propose FedSVD, a practical lossless federated SVD method over billion-scale data, which can simultaneously achieve lossless accuracy and high efficiency. At the heart of FedSVD is a lossless matrix masking scheme delicately designed for SVD: 1) While adopting the masks to protect private data, FedSVD completely removes them from the final results of SVD to achieve lossless accuracy; and 2) As the masks do not inflate the data, FedSVD avoids extra computation and communication overhead during the factorization to maintain high efficiency. Experiments with real-world datasets show that FedSVD is over 10000 times faster than the HE-based method and has 10 orders of magnitude smaller error than the DP-based solution on SVD tasks. We further build and evaluate FedSVD over three real-world applications: principal components analysis (PCA), linear regression (LR), and latent semantic analysis (LSA), to show its superior performance in practice. On federated LR tasks, compared with two state-of-the-art solutions: FATE and SecureML, FedSVD-LR is 100 times faster than SecureML and 10 times faster than FATE.