Spurious Correlations in Concept Drift: Can Explanatory Interaction Help?
Not on the map. Why?
Abstract (arXiv)
Long-running machine learning models face the issue of concept drift (CD), whereby the data distribution changes over time, compromising prediction performance. Updating the model requires detecting drift by monitoring the data and/or the model for unexpected changes. We show that, however, spurious correlations (SCs) can spoil the statistics tracked by detection algorithms. Motivated by this, we introduce ebc-exstream, a novel detector that leverages model explanations to identify potential SCs and human feedback to correct for them. It leverages an entropy-based heuristic to reduce the amount of necessary feedback, cutting annotation costs. Our preliminary experiments on artificially confounded data highlight the promise of ebc-exstream for reducing the impact of SCs on detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 23 Jul 2024.
Builds on
21 of 36 references.
References · 21
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2020Concept Bottleneck Modelscited by 1,022
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2018Recognition in Terra Incognitacited by 655
- 2020Learning under Concept Drift: A Reviewcited by 470
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 349
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
- 2020River: machine learning for streaming data in Pythoncited by 96
- 2022GlanceNets: Interpretabile, Leak-proof Concept-based Modelscited by 73
9 more
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2024The Clever Hans Mirage: A Comprehensive Survey on Spurious Correlations in Machine Learningcited by 39
- 2021Why did the distribution change?cited by 37
- 2021Feature Shift Detection: Localizing Which Features Have Shifted via Conditional Distribution Testscited by 24
- 2023Spuriosity Didn't Kill the Classifier: Using Invariant Predictions to Harness Spurious Featurescited by 21
- 2023Model Based Explanations of Concept Driftcited by 19
- 2021Human-in-the-loop Handling of Knowledge Driftcited by 4
- 2021A Framework for Explainable Concept Drift Detection in Process Miningcited by 4
- 2022Offline Change Detection under Contaminationcited by 3
Built on by
Not cited yet.