Privacy-Preserving Model and Preprocessing Verification for Machine Learning
Not on the map. Why?
Abstract (arXiv)
This paper presents a framework for privacy-preserving verification of machine learning models, focusing on models trained on sensitive data. Integrating Local Differential Privacy (LDP) with model explanations from LIME and SHAP, our framework enables robust verification without compromising individual privacy. It addresses two key tasks: binary classification, to verify if a target model was trained correctly by applying the appropriate preprocessing steps, and multi-class classification, to identify specific preprocessing errors. Evaluations on three real-world datasets-Diabetes, Adult, and Student Record-demonstrate that while the ML-based approach is particularly effective in binary tasks, the threshold-based method performs comparably in multi-class tasks. Results indicate that although verification accuracy varies across datasets and noise levels, the framework provides effective detection of preprocessing errors, strong privacy guarantees, and practical applicability for safeguarding sensitive data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 14 Jan 2025.
Builds on
12 of 38 references.
References · 12
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2020Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?cited by 189
- 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 183
- 2017Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samplescited by 147
- 2020OptiLIME: Optimized LIME Explanations for Diagnostic Computer Algorithmscited by 30
- 2022pvCNN: Privacy-Preserving and Verifiable Convolutional Neural Network Testingcited by 20
- 2019Effects of Differential Privacy and Data Skewness on Membership Inference Vulnerabilitycited by 15
- 2021Machine Learning for Financial Forecasting, Planning and Analysis: Recent Developments and Pitfallscited by 5
- 2021Privacy-Preserving and Efficient Verification of the Outcome in Genome-Wide Association Studiescited by 2
Built on by
Not cited yet.