Does the Explanation Drift Before the Guarantee? Label-Free Early Warning on Evolving Graphs
Not on the map. Why?
Abstract (arXiv)
Deployed models can fail silently as the world they describe evolves. Attribution drift has served as an early warning in tabular data; we ask whether, in graph streams, a model's own explanations can forewarn the loss of nominal conformal coverage. Doing so requires repairing the naive drift statistic twice. A vanishing edge loses mask mass regardless of whether the model relied on it, so we condition the importance on edge presence. Evolving graphs also break edge identity: a relabelling that changes nothing shifts the identity-based statistic by 0.69 on synthetic graphs and 0.83 on real ego-networks, whereas aggregating over structural roles brings both to 0.0 and stays well-defined when the support changes. We test six pre-registered regimes on thirty seeds each. A two-channel monitor, tracking conditional mask mass and its distribution over roles, precedes coverage collapse by 8 to 14.5 steps across four gradual regimes (node addition, removal, replacement, and edge thinning), all surviving Holm correction. A sudden knockout yields the expected zero lead, and a harmless change triggers no alarm. Leads track the length of the transitional phase (Spearman 0.79 over 150 runs). On real transaction ego-networks, the untuned mass channel forewarns staged drift by 27 steps and is the only channel, attributional or structural, that never alarms on a stationary stream. The main limitation is that the mass channel is blind to covariate drift, which breaks the guarantee in every run; the distributional channel detects it and also rescues the rewiring regime, so we report the two channels separately rather than as a union.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
14 of 23 references.
References · 14
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2019Conformal Prediction Under Covariate Shiftcited by 519
- 2020Inductive Representation Learning on Temporal Graphscited by 462
- 2020Parameterized Explainer for Graph Neural Networkcited by 426
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 119
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 101
- 2022Evaluating Explainability for Graph Neural Networkscited by 87
- 2023Model Based Explanations of Concept Driftcited by 21
- 2021STUDD: A Student-Teacher Method for Unsupervised Concept Drift Detectioncited by 19
- 2022Change Detection for Local Explainability in Evolving Data Streamscited by 8
- 2022Explanation Shift: Detecting distribution shifts on tabular data via the explanation spacecited by 7
2 more
Built on by
Not cited yet.