VFLGAN: Vertical Federated Learning-based Generative Adversarial Network for Vertically Partitioned Data Publication
Not on the map. Why?
Abstract (arXiv)
In the current artificial intelligence (AI) era, the scale and quality of the dataset play a crucial role in training a high-quality AI model. However, good data is not a free lunch and is always hard to access due to privacy regulations like the General Data Protection Regulation (GDPR). A potential solution is to release a synthetic dataset with a similar distribution to that of the private dataset. Nevertheless, in some scenarios, it has been found that the attributes needed to train an AI model belong to different parties, and they cannot share the raw data for synthetic data publication due to privacy regulations. In PETS 2023, Xue et al. proposed the first generative adversary network-based model, VertiGAN, for vertically partitioned data publication. However, after thoroughly investigating, we found that VertiGAN is less effective in preserving the correlation among the attributes of different parties. This article proposes a Vertical Federated Learning-based Generative Adversarial Network, VFLGAN, for vertically partitioned data publication to address the above issues. Our experimental results show that compared with VertiGAN, VFLGAN significantly improves the quality of synthetic data. Taking the MNIST dataset as an example, the quality of the synthetic dataset generated by VFLGAN is 3.2 times better than that generated by VertiGAN w.r.t. the Fr'echet Distance. We also designed a more efficient and effective Gaussian mechanism for the proposed VFLGAN to provide the synthetic dataset with a differential privacy guarantee. On the other hand, differential privacy only gives the upper bound of the worst-case privacy guarantee. This article also proposes a practical auditing scheme that applies membership inference attacks to estimate privacy leakage through the synthetic dataset.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
25 of 59 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2017Renyi Differential Privacycited by 643
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2018Scalable Private Learning with PATEcited by 266
- 2018Differentially Private Generative Adversarial Networkcited by 235
- 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 234
- 2018A Note on the Inception Scorecited by 225
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
13 more
- 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 213
- 2022Reconstructing Training Data with Informed Adversariescited by 143
- 2019Reconstruction and Membership Inference Attacks against Generative Modelscited by 122
- 2020GS-WGAN: A Gradient-Sanitized Approach for Learning Differentially Private Generatorscited by 117
- 2019Learning Disentangled Representations for Recommendationcited by 110
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detectioncited by 66
- 2022TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Datacited by 56
- 2018Improving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effectcited by 49
- 2022A Unified Framework for Quantifying Privacy Risk in Synthetic Datacited by 45
- 2023Achilles' Heels: Vulnerable Record Identification in Synthetic Data Publishingcited by 28
- 2022A General Framework for Auditing Differentially Private Machine Learningcited by 25
- 2017Wasserstein Divergence for GANscited by 22
- 2023Synthetic is all you need: removing the auxiliary data assumption for membership inference attacks against synthetic datacited by 18
Built on by
Citing papers per year: 2024: 1.
1 paper.