xaitimesynth: A Python Package for Evaluating Attribution Methods for Time Series with Synthetic Ground Truth
Not on the map. Why?
Abstract (arXiv)
Evaluating time series attribution methods is difficult because real-world datasets rarely provide ground truth for which time points drive a prediction. A common workaround is to generate synthetic data where class-discriminating features are placed at known locations, but each study currently reimplements this from scratch. We introduce xaitimesynth, a Python package that provides reusable infrastructure for this evaluation approach. The package generates synthetic time series following an additive model where each sample is a sum of background signal and a localized, class-discriminating feature, with the feature window automatically tracked as a ground truth mask. A fluent data generation API and YAML configuration format allow flexible and reproducible dataset definitions for both univariate and multivariate time series. The package also provides standard localization metrics, including AUC-PR, AUC-ROC, Relevance Mass Accuracy, and Relevance Rank Accuracy. xaitimesynth is open source and available at https://github.com/gregorbaer/xaitimesynth.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
19 of 28 references.
References · 19
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2018Deep learning for time series classification: a reviewcited by 576
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 126
- 2020Benchmarking Deep Learning Interpretability in Time Series Predictionscited by 102
- 2022Evaluation of post-hoc interpretability methods in time-series classificationcited by 53
- 2024Decoupling Pixel Flipping and Occlusion Strategy for Consistent XAI Benchmarkscited by 28
- 2023Learning Perturbations to Explain Time Series Predictionscited by 23
7 more
- 2023A Deep Dive into Perturbations as Evaluation Technique for Time Series XAIcited by 11
- 2023Robust Explainer Recommendation for Time Series Classificationcited by 7
- 2025Evaluating Model Explanations without Ground Truthcited by 7
- 2024Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classificationcited by 5
- 2025Class-Dependent Perturbation Effects in Evaluating Time Series Attributionscited by 5
- 2025Concept Extraction for Time Series with ECLAD-tscited by 2
- 2025Why Do Class-Dependent Evaluation Effects Occur with Time Series Feature Attributions? A Synthetic Data Investigationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.