Privacy-preserving Collaborative Learning with Automatic Transformation Search
Not on the map. Why?
Abstract (arXiv)
Collaborative learning has gained great popularity due to its benefit of data privacy protection: participants can jointly train a Deep Learning model without sharing their training sets. However, recent works discovered that an adversary can fully recover the sensitive training samples from the shared gradients. Such reconstruction attacks pose severe threats to collaborative learning. Hence, effective mitigation solutions are urgently desired. In this paper, we propose to leverage data augmentation to defeat reconstruction attacks: by preprocessing sensitive images with carefully-selected transformation policies, it becomes infeasible for the adversary to extract any useful information from the corresponding gradients. We design a novel search method to automatically discover qualified policies. We adopt two new metrics to quantify the impacts of transformations on data privacy and model usability, which can significantly accelerate the search speed. Comprehensive evaluations demonstrate that the policies discovered by our method can defeat existing reconstruction attacks in collaborative learning, with high efficiency and negligible impact on the model performance.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 8; 2024: 7; 2025: 7; 2026: 2.
31 papers.
Sort:
By area:
- 2023Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimizationcited by 65
- 2021Bayesian Framework for Gradient Leakagecited by 34
- 2021EasyFL: A Low-code Federated Learning Platform For Dummiescited by 20
- 2021Batch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learningcited by 16
- 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?cited by 13
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
- 2022Concealing Sensitive Samples against Gradient Leakage in Federated Learningcited by 11
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2024Revisiting Gradient Pruning: A Dual Realization for Defending against Gradient Attackscited by 7
- 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systemscited by 7
- 2022FedDef: Defense Against Gradient Leakage in Federated Learning-based Network Intrusion Detection Systemscited by 6
- 2023Understanding Deep Gradient Leakage via Inversion Influence Functionscited by 6
19 more
- 2022An Interpretable Federated Learning-based Network Intrusion Detection Frameworkcited by 4
- 2023Maximum Knowledge Orthogonality Reconstruction with Gradients in Federated Learningcited by 4
- 2023PPIDSG: A Privacy-Preserving Image Distribution Sharing Scheme with GAN in Federated Learningcited by 4
- 2023Mutual Information Regularization for Vertical Federated Learningcited by 3
- 2024Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memorycited by 3
- 2022Combining Stochastic Defenses to Resist Gradient Inversion: An Ablation Studycited by 2
- 2025SVDefense: Effective Defense against Gradient Inversion Attacks via Singular Value Decompositioncited by 2
- 2023Privacy Protectability: An Information-theoretical Approachcited by 1
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fieldscited by 1
- 2023OASIS: Offsetting Active Reconstruction Attacks in Federated Learningcited by 0
- 2024Understanding Data Reconstruction Leakage in Federated Learning from a Theoretical Perspectivecited by 0
- 2024Privacy-Preserving Federated Learning via Dataset Distillationcited by 0
- 2024Anomalous Client Detection in Federated Learningcited by 0
- 2025Secure Generalization through Stochastic Bidirectional Parameter Updates Using Dual-Gradient Mechanismcited by 0
- 2025DRAUN: An Algorithm-Agnostic Data Reconstruction Attack on Federated Unlearning Systemscited by 0
- 2025Evaluating Selective Encryption Against Gradient Inversion Attackscited by 0
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Maskingcited by 0
- 2026A Unified Masked Jigsaw Puzzle Framework for Vision and Language Modelscited by 0
- 2026ARES: Scalable and Practical Gradient Inversion Attack in Federated Learning through Activation Recoverycited by 0
- 2026ARES: Scalable and Practical Gradient Inversion Attack in Federated Learning through Activation Recovery18 Mar 2026
- 2026A Unified Masked Jigsaw Puzzle Framework for Vision and Language Models17 Jan 2026
- 2025SVDefense: Effective Defense against Gradient Inversion Attacks via Singular Value Decomposition1 Oct 2025
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields8 Aug 2025
- 2025Evaluating Selective Encryption Against Gradient Inversion Attacks6 Aug 2025
- 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systems25 Jul 2025
- 2025DRAUN: An Algorithm-Agnostic Data Reconstruction Attack on Federated Unlearning Systems2 Jun 2025
- 2025Secure Generalization through Stochastic Bidirectional Parameter Updates Using Dual-Gradient Mechanism3 Apr 2025
- 2024Anomalous Client Detection in Federated Learning3 Nov 2024
- 2024Privacy-Preserving Federated Learning via Dataset Distillation25 Oct 2024
- 2024Understanding Data Reconstruction Leakage in Federated Learning from a Theoretical Perspective22 Aug 2024
19 more
- 2024Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory22 May 2024
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity18 Apr 2024
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attacks4 Mar 2024
- 2024Revisiting Gradient Pruning: A Dual Realization for Defending against Gradient Attacks30 Jan 2024
- 2023PPIDSG: A Privacy-Preserving Image Distribution Sharing Scheme with GAN in Federated Learning16 Dec 2023
- 2023OASIS: Offsetting Active Reconstruction Attacks in Federated Learning23 Nov 2023
- 2023Maximum Knowledge Orthogonality Reconstruction with Gradients in Federated Learning30 Oct 2023
- 2023Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization23 Oct 2023
- 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?22 Sep 2023
- 2023Understanding Deep Gradient Leakage via Inversion Influence Functions22 Sep 2023
- 2023Privacy Protectability: An Information-theoretical Approach25 May 2023
- 2023Mutual Information Regularization for Vertical Federated Learning1 Jan 2023
- 2022FedDef: Defense Against Gradient Leakage in Federated Learning-based Network Intrusion Detection Systems8 Oct 2022
- 2022Concealing Sensitive Samples against Gradient Leakage in Federated Learning13 Sep 2022
- 2022Combining Stochastic Defenses to Resist Gradient Inversion: An Ablation Study9 Aug 2022
- 2022An Interpretable Federated Learning-based Network Intrusion Detection Framework10 Jan 2022
- 2021Batch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learning10 Dec 2021
- 2021Bayesian Framework for Gradient Leakage8 Nov 2021
- 2021EasyFL: A Low-code Federated Learning Platform For Dummies17 May 2021
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
- 2023Mutual Information Regularization for Vertical Federated Learningcited by 3
- 2025DRAUN: An Algorithm-Agnostic Data Reconstruction Attack on Federated Unlearning Systemscited by 0
- 2025DRAUN: An Algorithm-Agnostic Data Reconstruction Attack on Federated Unlearning Systems2 Jun 2025
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attacks4 Mar 2024
- 2023Mutual Information Regularization for Vertical Federated Learning1 Jan 2023
- 2023Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimizationcited by 65
- 2021Bayesian Framework for Gradient Leakagecited by 34
- 2021EasyFL: A Low-code Federated Learning Platform For Dummiescited by 20
- 2021Batch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learningcited by 16
- 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?cited by 13
- 2022Concealing Sensitive Samples against Gradient Leakage in Federated Learningcited by 11
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2024Revisiting Gradient Pruning: A Dual Realization for Defending against Gradient Attackscited by 7
- 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systemscited by 7
- 2022FedDef: Defense Against Gradient Leakage in Federated Learning-based Network Intrusion Detection Systemscited by 6
- 2023Understanding Deep Gradient Leakage via Inversion Influence Functionscited by 6
- 2022An Interpretable Federated Learning-based Network Intrusion Detection Frameworkcited by 4
12 most cited of 27 All 27 (JSON)
- 2026ARES: Scalable and Practical Gradient Inversion Attack in Federated Learning through Activation Recovery18 Mar 2026
- 2026A Unified Masked Jigsaw Puzzle Framework for Vision and Language Models17 Jan 2026
- 2025SVDefense: Effective Defense against Gradient Inversion Attacks via Singular Value Decomposition1 Oct 2025
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields8 Aug 2025
- 2025Evaluating Selective Encryption Against Gradient Inversion Attacks6 Aug 2025
- 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systems25 Jul 2025
- 2025Secure Generalization through Stochastic Bidirectional Parameter Updates Using Dual-Gradient Mechanism3 Apr 2025
- 2024Anomalous Client Detection in Federated Learning3 Nov 2024
- 2024Privacy-Preserving Federated Learning via Dataset Distillation25 Oct 2024
- 2024Understanding Data Reconstruction Leakage in Federated Learning from a Theoretical Perspective22 Aug 2024
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity18 Apr 2024
12 newest of 27 All 27 (JSON)