Audit to Forget: A Unified Method to Revoke Patients' Private Data in Intelligent Healthcare
Not on the map. Why?
Abstract (arXiv)
Revoking personal private data is one of the basic human rights, which has already been sheltered by several privacy-preserving laws in many countries. However, with the development of data science, machine learning and deep learning techniques, this right is usually neglected or violated as more and more patients' data are being collected and used for model training, especially in intelligent healthcare, thus making intelligent healthcare a sector where technology must meet the law, regulations, and privacy principles to ensure that the innovation is for the common good. In order to secure patients' right to be forgotten, we proposed a novel solution by using auditing to guide the forgetting process, where auditing means determining whether a dataset has been used to train the model and forgetting requires the information of a query dataset to be forgotten from the target model. We unified these two tasks by introducing a new approach called knowledge purification. To implement our solution, we developed AFS, a unified open-source software, which is able to evaluate and revoke patients' private data from pre-trained deep learning models. We demonstrated the generality of AFS by applying it to four tasks on different datasets with various data sizes and architectures of deep learning networks. The software is publicly available at urlhttps://github.com/JoshuaChou2018/AFS.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 20 Feb 2023.
Builds on
34 of 61 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2019Machine Unlearningcited by 1,020
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2019Certified Data Removal from Machine Learning Modelscited by 512
- 2015An Introduction to Convolutional Neural Networkscited by 510
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 475
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
22 more
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearningcited by 360
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
- 2022A Survey of Machine Unlearningcited by 298
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearningcited by 274
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 273
- 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
- 2020Approximate Data Deletion from Machine Learning Modelscited by 250
- 2021Fast Yet Effective Machine Unlearningcited by 209
- 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teachercited by 189
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
- 2019Stolen Memories: Leveraging Model Memorization for Calibrated White-Box Membership Inferencecited by 168
- 2017Machine Learning Models that Remember Too Muchcited by 165
- 2021Adaptive Machine Unlearningcited by 164
- 2019Privacy Risks of Securing Machine Learning Models against Adversarial Examplescited by 136
- 2020Variational Bayesian Unlearningcited by 114
- 2020Machine Unlearning: Linear Filtration for Logit-based Classifierscited by 89
- 2022Towards Adversarial Evaluations for Inexact Machine Unlearningcited by 82
- 2017Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learningcited by 63
- 2021SSSE: Efficiently Erasing Samples from Trained Machine Learning Modelscited by 28
- 2022Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgottencited by 25
- 2020Have you forgotten? A method to assess if machine learning models have forgotten datacited by 16
- 2021EMA: Auditing Data Removal from Trained Modelscited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3; 2026: 1.
9 papers.
- 2024Learning to Unlearn for Robust Machine Unlearningcited by 19
- 2023Path to Medical AGI: Unify Domain-specific Medical LLMs with the Lowest Costcited by 12
- 2024Exploring Fairness in Educational Data Mining in the Context of the Right to be Forgottencited by 3
- 2025Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settingscited by 3
- 2024SoK: Security and Privacy Risks of Healthcare AIcited by 2
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
- 2025Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readinesscited by 2
- 2024From Machine Learning to Machine Unlearning: Complying with GDPR's Right to be Forgotten while Maintaining Business Value of Predictive Modelscited by 1
- 2026Revealing Training Data Exposure in Vision Language Large Models via Parameter Gradientscited by 0
- 2026Revealing Training Data Exposure in Vision Language Large Models via Parameter Gradients23 Jun 2026
- 2025Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings29 Jun 2025
- 2025Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness16 May 2025
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategies10 Mar 2025
- 2024From Machine Learning to Machine Unlearning: Complying with GDPR's Right to be Forgotten while Maintaining Business Value of Predictive Models26 Nov 2024
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024Learning to Unlearn for Robust Machine Unlearning15 Jul 2024
- 2024Exploring Fairness in Educational Data Mining in the Context of the Right to be Forgotten27 May 2024
- 2023Path to Medical AGI: Unify Domain-specific Medical LLMs with the Lowest Cost19 Jun 2023