ADI: Adversarial Dominating Inputs in Vertical Federated Learning Systems
Not on the map. Why?
Abstract (arXiv)
Vertical federated learning (VFL) system has recently become prominent as a concept to process data distributed across many individual sources without the need to centralize it. Multiple participants collaboratively train models based on their local data in a privacy-aware manner. To date, VFL has become a de facto solution to securely learn a model among organizations, allowing knowledge to be shared without compromising privacy of any individuals. Despite the prosperous development of VFL systems, we find that certain inputs of a participant, named adversarial dominating inputs (ADIs), can dominate the joint inference towards the direction of the adversary's will and force other (victim) participants to make negligible contributions, losing rewards that are usually offered regarding the importance of their contributions in federated learning scenarios. We conduct a systematic study on ADIs by first proving their existence in typical VFL systems. We then propose gradient-based methods to synthesize ADIs of various formats and exploit common VFL systems. We further launch greybox fuzz testing, guided by the saliency score of ``victim'' participants, to perturb adversary-controlled inputs and systematically explore the VFL attack surface in a privacy-preserving manner. We conduct an in-depth study on the influence of critical parameters and settings in synthesizing ADIs. Our study reveals new VFL attack opportunities, promoting the identification of unknown threats before breaches and building more secure VFL systems.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 55 of its 108 references that are in the map. First posted on arXiv 8 Jan 2022.
Builds on
55 of 108 references.
References · 55
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2015VQA: Visual Question Answeringcited by 2,506
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
- 2015Teaching Machines to Read and Comprehendcited by 1,049
38 more
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2016Universal adversarial perturbationscited by 784
- 2018How To Backdoor Federated Learningcited by 765
- 2018MINE: Mutual Information Neural Estimationcited by 683
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
- 2017Deep Neural Networks as Gaussian Processescited by 622
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
- 2018Federated Learning for Mobile Keyboard Predictioncited by 572
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 501
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 493
- 2019Fair Resource Allocation in Federated Learningcited by 394
- 2015Adversarial Autoencoderscited by 364
- 2018Analyzing Federated Learning through an Adversarial Lenscited by 351
- 2019Robust Aggregation for Federated Learningcited by 317
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 311
- 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 309
- 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 300
- 2018Distributed learning of deep neural network over multiple agentscited by 279
- 2016Hierarchical Question-Image Co-Attention for Visual Question Answeringcited by 278
- 2020Data Poisoning Attacks Against Federated Learning Systemscited by 275
- 2019Can You Really Backdoor Federated Learning?cited by 255
- 2019Simple Black-box Adversarial Attackscited by 251
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 246
- 2017Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryptioncited by 176
- 2019SecureBoost: A Lossless Federated Learning Frameworkcited by 176
- 2018Mitigating Sybils in Federated Learning Poisoningcited by 161
- 2020Feature Inference Attack on Model Predictions in Vertical Federated Learningcited by 106
- 2020Privacy Preserving Vertical Federated Learning for Tree-based Modelscited by 89
- 2020Collaborative Machine Learning with Incentive-Aware Model Rewardscited by 71
- 2016Simple Black-Box Adversarial Perturbations for Deep Networkscited by 42
- 2021A Comprehensive Survey of Incentive Mechanism for Federated Learningcited by 38
- 2019Hybrid Batch Attacks: Finding Black-box Adversarial Examples with Limited Queriescited by 33
- 2021Analysis and Applications of Class-wise Robustness in Adversarial Trainingcited by 33
- 2019A Crowdsourcing Framework for On-Device Federated Learningcited by 32
- 2020Backdoor attacks and defenses in feature-partitioned collaborative learningcited by 30
- 2020Universal Adversarial Perturbations: A Surveycited by 28
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 5; 2026: 1.
9 papers.
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challengescited by 15
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2025UniTrans: A Unified Vertical Federated Knowledge Transfer Framework for Enhancing Cross-Hospital Collaborationcited by 5
- 2024An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarioscited by 3
- 2025On the Inference (In-)Security of Vertical Federated Learning: Efficient Auditing against Inference Tampering Attackcited by 0
- 2025HASSLE: A Self-Supervised Learning Enhanced Hijacking Attack on Vertical Federated Learningcited by 0
- 2025VTarbel: Targeted Label Attack with Minimal Knowledge on Detector-enhanced Vertical Federated Learningcited by 0
- 2025VMask: Tunable Label Privacy Protection for Vertical Federated Learning via Layer Maskingcited by 0
- 2026Understanding Backdoor Vulnerabilities in Vertical Federated Learning: The Gap Between Research and Practicecited by 0
- 2026Understanding Backdoor Vulnerabilities in Vertical Federated Learning: The Gap Between Research and Practice13 Aug 2026
- 2025VMask: Tunable Label Privacy Protection for Vertical Federated Learning via Layer Masking19 Jul 2025
- 2025VTarbel: Targeted Label Attack with Minimal Knowledge on Detector-enhanced Vertical Federated Learning19 Jul 2025
- 2025HASSLE: A Self-Supervised Learning Enhanced Hijacking Attack on Vertical Federated Learning14 Jul 2025
- 2025On the Inference (In-)Security of Vertical Federated Learning: Efficient Auditing against Inference Tampering Attack3 Jul 2025
- 2025UniTrans: A Unified Vertical Federated Knowledge Transfer Framework for Enhancing Cross-Hospital Collaboration20 Jan 2025
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challenges9 Jul 2024
- 2024An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios27 Jan 2024
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learning15 Oct 2023