Watermarking Counterfactual Explanations
Not on the map. Why?
Abstract (arXiv)
Counterfactual (CF) explanations for ML model predictions provide actionable recourse recommendations to individuals adversely impacted by predicted outcomes. However, despite being preferred by end-users, CF explanations have been shown to pose significant security risks in real-world applications; in particular, malicious adversaries can exploit CF explanations to perform query-efficient model extraction attacks on the underlying proprietary ML model. To address this security challenge, we propose CFMark, a novel model-agnostic watermarking framework for detecting unauthorized model extraction attacks relying on CF explanations. CFMark involves a novel bi-level optimization problem to embed an indistinguishable watermark into the generated CF explanation such that any future model extraction attacks using these watermarked CF explanations can be detected using a null hypothesis significance testing (NHST) scheme. At the same time, the embedded watermark does not compromise the quality of the CF explanations. We evaluate CFMark across diverse real-world datasets, CF explanation methods, and model extraction techniques. Our empirical results demonstrate CFMark's effectiveness, achieving an F-1 score of ~0.89 in identifying unauthorized model extraction attacks using watermarked CF explanations. Importantly, this watermarking incurs only a negligible degradation in the quality of generated CF explanations (i.e., ~1.3% degradation in validity and ~1.6% in proximity). Our work establishes a critical foundation for the secure deployment of CF explanations in real-world applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 29 May 2024.
Builds on
36 of 53 references.
References · 36
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2023A Watermark for Large Language Modelscited by 667
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2018Actionable Recourse in Linear Classificationcited by 327
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2019Explainable Machine Learning in Deploymentcited by 210
24 more
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2018Truncated Back-propagation for Bilevel Optimizationcited by 187
- 2017Machine Learning Models that Remember Too Muchcited by 165
- 2018PRADA: Protecting against DNN Model Stealing Attackscited by 159
- 2017Neural Trojanscited by 151
- 2019Learning Model-Agnostic Counterfactual Explanations for Tabular Datacited by 146
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2019Preserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifierscited by 143
- 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
- 2020MetaPoison: Practical General-purpose Clean-label Data Poisoningcited by 114
- 2021Towards Robust and Reliable Algorithmic Recoursecited by 101
- 2019DAWN: Dynamic Adversarial Watermarking of Neural Networkscited by 94
- 2018Exploring Connections Between Active Learning and Model Extractioncited by 84
- 2022Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protectioncited by 80
- 2017Inverse Classification for Comparison-based Interpretability in Machine Learningcited by 49
- 2020Model extraction from counterfactual explanationscited by 46
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
- 2022DualCF: Efficient Model Extraction Attack from Counterfactual Explanationscited by 31
- 2022The privacy issue of counterfactual explanations: explanation linkage attackscited by 20
- 2021CounterNet: End-to-End Training of Prediction Aware Counterfactual Explanationscited by 17
- 2021Model-Based Counterfactual Synthesizer for Interpretationcited by 14
- 2022Differentially Private Counterfactuals via Functional Mechanismcited by 13
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2022Feature-based Learning for Diverse and Privacy-Preserving Counterfactual Explanationscited by 11
Built on by
Not cited yet.