When Machine Learning Meets Privacy: A Survey and Outlook
Not on the map. Why?
Abstract (arXiv)
The newly emerged machine learning (e.g. deep learning) methods have become a strong driving force to revolutionize a wide range of industries, such as smart healthcare, financial technology, and surveillance systems. Meanwhile, privacy has emerged as a big concern in this machine learning-based artificial intelligence era. It is important to note that the problem of privacy preservation in the context of machine learning is quite different from that in traditional data privacy protection, as machine learning can act as both friend and foe. Currently, the work on the preservation of privacy and machine learning (ML) is still in an infancy stage, as most existing solutions only focus on privacy problems during the machine learning process. Therefore, a comprehensive study on the privacy preservation problems and machine learning is required. This paper surveys the state of the art in privacy issues and solutions for machine learning. The survey covers three categories of interactions between privacy and machine learning: (i) private machine learning, (ii) machine learning aided privacy protection, and (iii) machine learning-based privacy attack and corresponding protection schemes. The current research progress in each category is reviewed and the key challenges are identified. Finally, based on our in-depth analysis of the area of privacy and machine learning, we point out future research directions in this field.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 20; 2023: 18; 2024: 13; 2025: 5; 2026: 1.
67 papers.
Sort:
By area:
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2023Large Language Models in Law: A Surveycited by 128
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2021Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AIcited by 26
- 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
- 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applicationscited by 22
- 2022The privacy issue of counterfactual explanations: explanation linkage attackscited by 20
- 2022Differential Privacy has Bounded Impact on Fairness in Classificationcited by 18
- 2023FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learningcited by 17
38 more
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representationscited by 16
- 2023GELU Activation Function in Deep Learning: A Comprehensive Mathematical Analysis and Performancecited by 16
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2023Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyondcited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regressioncited by 14
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairnesscited by 13
- 2022Autonomy and Intelligence in the Computing Continuum: Challenges, Enablers, and Future Directions for Orchestrationcited by 12
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2025Episodic memory in AI agents poses risks that should be studied and mitigatedcited by 11
- 2021Toward a Taxonomy of Trust for Probabilistic Machine Learningcited by 8
- 2022Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivitycited by 8
- 2024Byzantine-Robust Aggregation for Securing Decentralized Federated Learningcited by 7
- 2022A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systemscited by 6
- 2022When Fairness Meets Privacy: Fair Classification with Semi-Private Sensitive Attributescited by 6
- 2022MobileTL: On-device Transfer Learning with Inverted Residual Blockscited by 6
- 2024Responsible Artificial Intelligence: A Structured Literature Reviewcited by 6
- 2021Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challengescited by 5
- 2022MaSS: Multi-attribute Selective Suppressioncited by 5
- 2023(Local) Differential Privacy has NO Disparate Impact on Fairnesscited by 5
- 2021Predicting Patch Correctness Based on the Similarity of Failing Test Casescited by 4
- 2022Collaborative Drug Discovery: Inference-level Data Protection Perspectivecited by 4
- 2023Privacy-preserving machine learning for healthcare: open challenges and future perspectivescited by 4
- 2023Holistic Survey of Privacy and Fairness in Machine Learningcited by 4
- 2022Learning Neural Networks under Input-Output Specificationscited by 3
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairnesscited by 3
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Roboticscited by 3
- 2022Securing the Classification of COVID-19 in Chest X-ray Images: A Privacy-Preserving Deep Learning Approachcited by 2
- 2022Uncertainty-aware Personal Assistant for Making Personalized Privacy Decisionscited by 2
- 2023Uncovering Promises and Challenges of Federated Learning to Detect Cardiovascular Diseases: A Scoping Literature Reviewcited by 2
- 2024MedBlindTuner: Towards Privacy-preserving Fine-tuning on Biomedical Images with Transformers and Fully Homomorphic Encryptioncited by 2
- 2025On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levelscited by 2
- 2021Addressing Privacy Threats from Machine Learningcited by 1
- 2022LDL: A Defense for Label-Based Membership Inference Attackscited by 1
- 2023Multi-Task Model Personalization for Federated Supervised SVM in Heterogeneous Networkscited by 1
- 2023Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Modelscited by 1
- 2023Human-Producible Adversarial Examplescited by 1
50 most cited of 67 All 67 (JSON)
- 2026Shapley-Value-Based Feature Attribution for Data Masking31 Jul 2026
- 2025On the Detectability of Active Gradient Inversion Attacks in Federated Learning13 Nov 2025
- 2025FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation26 Jun 2025
- 2025On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levels25 Feb 2025
- 2025Federated Learning With Individualized Privacy Through Client Sampling29 Jan 2025
- 2025Episodic memory in AI agents poses risks that should be studied and mitigated20 Jan 2025
- 2024Byzantine-Robust Aggregation for Securing Decentralized Federated Learning26 Sep 2024
- 2024TPFL: Tsetlin-Personalized Federated Learning with Confidence-Based Clustering16 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regression18 Jul 2024
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Robotics27 Jun 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
38 more
- 2024MultiConfederated Learning: Inclusive Non-IID Data handling with Decentralized Federated Learning20 Apr 2024
- 2024Responsible Artificial Intelligence: A Structured Literature Review11 Mar 2024
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness21 Feb 2024
- 2024Double-Dip: Thwarting Label-Only Membership Inference Attacks with Transfer Learning and Randomization2 Feb 2024
- 2024Privacy and Security Implications of Cloud-Based AI Services : A Survey31 Jan 2024
- 2024Differentially-Private Multi-Tier Federated Learning21 Jan 2024
- 2024MedBlindTuner: Towards Privacy-preserving Fine-tuning on Biomedical Images with Transformers and Fully Homomorphic Encryption17 Jan 2024
- 2023zkDFL: An efficient and privacy-preserving decentralized federated learning with zero-knowledge proof1 Dec 2023
- 2023Large Language Models in Law: A Survey26 Nov 2023
- 2023Decentralized Personalized Online Federated Learning8 Nov 2023
- 2023Human-Producible Adversarial Examples30 Sep 2023
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Survey28 Sep 2023
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applications31 Aug 2023
- 2023Uncovering Promises and Challenges of Federated Learning to Detect Cardiovascular Diseases: A Scoping Literature Review26 Aug 2023
- 2023Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models17 Aug 2023
- 2023Holistic Survey of Privacy and Fairness in Machine Learning28 Jul 2023
- 2023FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learning25 Jul 2023
- 2023SoK: Privacy-Preserving Data Synthesis5 Jul 2023
- 2023Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyond1 Jun 2023
- 2023GELU Activation Function in Deep Learning: A Comprehensive Mathematical Analysis and Performance20 May 2023
- 2023(Local) Differential Privacy has NO Disparate Impact on Fairness25 Apr 2023
- 2023A Generative Framework for Low-Cost Result Validation of Machine Learning-as-a-Service Inference31 Mar 2023
- 2023Privacy-preserving machine learning for healthcare: open challenges and future perspectives27 Mar 2023
- 2023Multi-Task Model Personalization for Federated Supervised SVM in Heterogeneous Networks17 Mar 2023
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomy18 Jan 2023
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learning21 Dec 2022
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairness18 Dec 2022
- 2022MobileTL: On-device Transfer Learning with Inverted Residual Blocks5 Dec 2022
- 2022LDL: A Defense for Label-Based Membership Inference Attacks3 Dec 2022
- 2022Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivity3 Nov 2022
- 2022Differential Privacy has Bounded Impact on Fairness in Classification28 Oct 2022
- 2022The privacy issue of counterfactual explanations: explanation linkage attacks21 Oct 2022
- 2022MaSS: Multi-attribute Selective Suppression18 Oct 2022
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledge22 Aug 2022
- 2022When Fairness Meets Privacy: Fair Classification with Semi-Private Sensitive Attributes18 Jul 2022
- 2022White-box Membership Attack Against Machine Learning Based Retinopathy Classification30 May 2022
- 2022OPOM: Customized Invisible Cloak towards Face Privacy Protection24 May 2022
- 2022Uncertainty-aware Personal Assistant for Making Personalized Privacy Decisions13 May 2022
50 newest of 67 All 67 (JSON)
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representationscited by 16
- 2022LDL: A Defense for Label-Based Membership Inference Attackscited by 1
- 2024Double-Dip: Thwarting Label-Only Membership Inference Attacks with Transfer Learning and Randomizationcited by 1
- 2024Double-Dip: Thwarting Label-Only Membership Inference Attacks with Transfer Learning and Randomization2 Feb 2024
- 2022LDL: A Defense for Label-Based Membership Inference Attacks3 Dec 2022
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations27 Feb 2022
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2023Large Language Models in Law: A Surveycited by 128
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2021Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AIcited by 26
- 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
- 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applicationscited by 22
- 2022The privacy issue of counterfactual explanations: explanation linkage attackscited by 20
- 2022Differential Privacy has Bounded Impact on Fairness in Classificationcited by 18
- 2023FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learningcited by 17
- 2023GELU Activation Function in Deep Learning: A Comprehensive Mathematical Analysis and Performancecited by 16
12 most cited of 63 All 63 (JSON)
- 2026Shapley-Value-Based Feature Attribution for Data Masking31 Jul 2026
- 2025On the Detectability of Active Gradient Inversion Attacks in Federated Learning13 Nov 2025
- 2025FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation26 Jun 2025
- 2025On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levels25 Feb 2025
- 2025Federated Learning With Individualized Privacy Through Client Sampling29 Jan 2025
- 2025Episodic memory in AI agents poses risks that should be studied and mitigated20 Jan 2025
- 2024Byzantine-Robust Aggregation for Securing Decentralized Federated Learning26 Sep 2024
- 2024TPFL: Tsetlin-Personalized Federated Learning with Confidence-Based Clustering16 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regression18 Jul 2024
- 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Robotics27 Jun 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
12 newest of 63 All 63 (JSON)