PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN
Not on the map. Why?
Abstract (arXiv)
We introduce PyVertical, a framework supporting vertical federated learning using split neural networks. The proposed framework allows a data scientist to train neural networks on data features vertically partitioned across multiple owners while keeping raw data on an owner's device. To link entities shared across different datasets' partitions, we use Private Set Intersection on IDs associated with data points. To demonstrate the validity of the proposed framework, we present the training of a simple dual-headed split neural network for a MNIST classification task, with data samples vertically distributed across two data owners and a data scientist.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
16 of 42 references.
References · 16
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
- 2020SplitFed: When Federated Learning Meets Split Learningcited by 308
- 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 298
- 2018Distributed learning of deep neural network over multiple agentscited by 277
- 2017Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryptioncited by 174
- 2018A generic framework for privacy preserving deep learningcited by 103
- 2020Multi-Participant Multi-Class Vertical Federated Learningcited by 47
- 2020SplitNN-driven Vertical Partitioningcited by 42
- 2020Asymmetrical Vertical Federated Learningcited by 26
4 more
- 2018Entity Resolution and Federated Learning get a Federated Resolutioncited by 23
- 2021Privacy and Trust Redefined in Federated Machine Learningcited by 13
- 2020Asymmetric Private Set Intersection with Applications to Contact Tracing and Private Vertical Federated Machine Learningcited by 12
- 2020A Distributed Trust Framework for Privacy-Preserving Machine Learningcited by 7
Built on by
Citing papers per year: 2021: 3; 2022: 12; 2023: 7; 2024: 9; 2025: 4.
35 papers.
Sort:
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Datacited by 36
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 34
- 2021Practical Defences Against Model Inversion Attacks for Split Neural Networkscited by 29
- 2022Vertical Federated Learning: A Structured Literature Reviewcited by 17
- 2022Similarity-based Label Inference Attack against Training and Inference of Split Learningcited by 15
- 2022FedLite: A Scalable Approach for Federated Learning on Resource-constrained Clientscited by 14
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
23 more
- 2022Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learningcited by 13
- 2023Communication-Efficient Vertical Federated Learning with Limited Overlapping Samplescited by 13
- 2023A Split-and-Privatize Framework for Large Language Model Fine-Tuningcited by 11
- 2024Training Machine Learning models at the Edge: A Surveycited by 11
- 2022Continual Horizontal Federated Learning for Heterogeneous Datacited by 8
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspectivecited by 7
- 2023Personalised Federated Learning On Heterogeneous Feature Spacescited by 5
- 2023GLASU: A Communication-Efficient Algorithm for Federated Learning with Vertically Distributed Graph Datacited by 3
- 2024Starlit: Privacy-Preserving Federated Learning to Enhance Financial Fraud Detectioncited by 3
- 2025Cooperative Decentralized Backdoor Attacks on Vertical Federated Learningcited by 3
- 2025Tree-based Models for Vertical Federated Learning: A Surveycited by 3
- 2025The Sherpa.ai Blind Vertical Federated Learning Paradigm to Minimize the Number of Communicationscited by 3
- 2023Privacy-Preserving Federated Learning over Vertically and Horizontally Partitioned Data for Financial Anomaly Detectioncited by 1
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systemscited by 1
- 2024Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Datacited by 1
- 2024TabVFL: Improving Latent Representation in Vertical Federated Learningcited by 1
- 2025PrivTune: Efficient and Privacy-Preserving Fine-Tuning of Large Language Models via Device-Cloud Collaborationcited by 1
- 2021An Information-Theoretic Analysis of The Cost of Decentralization for Learning and Inference Under Privacy Constraintscited by 0
- 2022Vertical Federated Linear Contextual Banditscited by 0
- 2023EASTER: Embedding Aggregation-based Heterogeneous Models Training in Vertical Federated Learningcited by 0
- 2024Survey of Privacy Threats and Countermeasures in Federated Learningcited by 0
- 2024De-VertiFL: A Solution for Decentralized Vertical Federated Learningcited by 0
- 2025PrivTune: Efficient and Privacy-Preserving Fine-Tuning of Large Language Models via Device-Cloud Collaboration9 Dec 2025
- 2025The Sherpa.ai Blind Vertical Federated Learning Paradigm to Minimize the Number of Communications19 Oct 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025Cooperative Decentralized Backdoor Attacks on Vertical Federated Learning16 Jan 2025
- 2024De-VertiFL: A Solution for Decentralized Vertical Federated Learning8 Oct 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024TabVFL: Improving Latent Representation in Vertical Federated Learning27 Apr 2024
- 2024Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data6 Mar 2024
- 2024Training Machine Learning models at the Edge: A Survey5 Mar 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
- 2024Survey of Privacy Threats and Countermeasures in Federated Learning1 Feb 2024
- 2024Starlit: Privacy-Preserving Federated Learning to Enhance Financial Fraud Detection19 Jan 2024
23 more
- 2024Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems3 Jan 2024
- 2023A Split-and-Privatize Framework for Large Language Model Fine-Tuning25 Dec 2023
- 2023Privacy-Preserving Federated Learning over Vertically and Horizontally Partitioned Data for Financial Anomaly Detection30 Oct 2023
- 2023EASTER: Embedding Aggregation-based Heterogeneous Models Training in Vertical Federated Learning20 Oct 2023
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learning15 Oct 2023
- 2023Communication-Efficient Vertical Federated Learning with Limited Overlapping Samples28 Mar 2023
- 2023GLASU: A Communication-Efficient Algorithm for Federated Learning with Vertically Distributed Graph Data16 Mar 2023
- 2023Personalised Federated Learning On Heterogeneous Feature Spaces26 Jan 2023
- 2022Vertical Federated Learning: A Structured Literature Review1 Dec 2022
- 2022Vertical Federated Learning: Concepts, Advances and Challenges23 Nov 2022
- 2022Vertical Federated Linear Contextual Bandits20 Oct 2022
- 2022Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learning13 Oct 2022
- 2022A Survey on Heterogeneous Federated Learning10 Oct 2022
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directions5 Aug 2022
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions20 Jul 2022
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data16 Jun 2022
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learning12 Apr 2022
- 2022Similarity-based Label Inference Attack against Training and Inference of Split Learning10 Mar 2022
- 2022Continual Horizontal Federated Learning for Heterogeneous Data4 Mar 2022
- 2022FedLite: A Scalable Approach for Federated Learning on Resource-constrained Clients28 Jan 2022
- 2021An Information-Theoretic Analysis of The Cost of Decentralization for Learning and Inference Under Privacy Constraints11 Oct 2021
- 2021From Distributed Machine Learning to Federated Learning: A Survey29 Apr 2021
- 2021Practical Defences Against Model Inversion Attacks for Split Neural Networks12 Apr 2021
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Datacited by 36
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 34
- 2021Practical Defences Against Model Inversion Attacks for Split Neural Networkscited by 29
- 2022Vertical Federated Learning: A Structured Literature Reviewcited by 17
- 2022Similarity-based Label Inference Attack against Training and Inference of Split Learningcited by 15
- 2022FedLite: A Scalable Approach for Federated Learning on Resource-constrained Clientscited by 14
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
12 most cited of 35 All 35 (JSON)
- 2025PrivTune: Efficient and Privacy-Preserving Fine-Tuning of Large Language Models via Device-Cloud Collaboration9 Dec 2025
- 2025The Sherpa.ai Blind Vertical Federated Learning Paradigm to Minimize the Number of Communications19 Oct 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025Cooperative Decentralized Backdoor Attacks on Vertical Federated Learning16 Jan 2025
- 2024De-VertiFL: A Solution for Decentralized Vertical Federated Learning8 Oct 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024TabVFL: Improving Latent Representation in Vertical Federated Learning27 Apr 2024
- 2024Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data6 Mar 2024
- 2024Training Machine Learning models at the Edge: A Survey5 Mar 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
- 2024Survey of Privacy Threats and Countermeasures in Federated Learning1 Feb 2024
- 2024Starlit: Privacy-Preserving Federated Learning to Enhance Financial Fraud Detection19 Jan 2024
12 newest of 35 All 35 (JSON)