# Guiding the generation of counterfactual explanations through temporal background knowledge for Predictive Process Monitoring

arXiv: https://arxiv.org/abs/2403.11642 · HTML: https://mlsanity.com/paper/2403.11642/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 54 references that are in the map.
- First posted on arXiv 18 Mar 2024.

## Builds on (most cited first, 19 of 19)

- [Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI](https://mlsanity.com/paper/1910.10045/) (2019)
- [Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR](https://mlsanity.com/paper/1711.00399/) (2017)
- [Explaining Machine Learning Classifiers through Diverse Counterfactual Explanations](https://mlsanity.com/paper/1905.07697/) (2019)
- [Algorithmic Recourse: from Counterfactual Explanations to Interventions](https://mlsanity.com/paper/2002.06278/) (2020)
- [pymoo: Multi-objective Optimization in Python](https://mlsanity.com/paper/2002.04504/) (2020)
- [Predictive Business Process Monitoring with LSTM Neural Networks](https://mlsanity.com/paper/1612.02130/) (2016)
- [The Intriguing Relation Between Counterfactual Explanations and Adversarial Examples](https://mlsanity.com/paper/2009.05487/) (2020)
- [Predictive Monitoring of Business Processes](https://mlsanity.com/paper/1312.4874/) (2013)
- [Outcome-Oriented Predictive Process Monitoring: Review and Benchmark](https://mlsanity.com/paper/1707.06766/) (2017)
- [GeCo: Quality Counterfactual Explanations in Real Time](https://mlsanity.com/paper/2101.01292/) (2021)
- [ReLAX: Reinforcement Learning Agent eXplainer for Arbitrary Predictive Models](https://mlsanity.com/paper/2110.11960/) (2021)
- [Clustering-Based Predictive Process Monitoring](https://mlsanity.com/paper/1506.01428/) (2015)
- [Counterfactual Explanations for Machine Learning: Challenges Revisited](https://mlsanity.com/paper/2106.07756/) (2021)
- [Finding Regions of Counterfactual Explanations via Robust Optimization](https://mlsanity.com/paper/2301.11113/) (2023)
- [DiCE4EL: Interpreting Process Predictions using a Milestone-Aware Counterfactual Approach](https://mlsanity.com/paper/2107.08697/) (2021)
- [Counterfactual Explanations for Predictive Business Process Monitoring](https://mlsanity.com/paper/2202.12018/) (2022)
- [An Explainable Decision Support System for Predictive Process Analytics](https://mlsanity.com/paper/2207.12782/) (2022)
- [CREATED: Generating Viable Counterfactual Sequences for Predictive Process Analytics](https://mlsanity.com/paper/2303.15844/) (2023)
- [Evolutionary approaches to explainable machine learning](https://mlsanity.com/paper/2306.14786/) (2023)

## Built on by (most cited first, 3 of 3)

- [DIFF-ERO: A Conformance-Aware Loss for Deep Learning in Process Mining](https://mlsanity.com/paper/2606.14283/) (2026)
- [Exploring LLM Features in Predictive Process Monitoring for Small-Scale Event-Logs](https://mlsanity.com/paper/2601.11468/) (2026)
- [Feature Attribution-Based Explainability Analysis of Deep Learning Models in Predictive Process Monitoring](https://mlsanity.com/paper/2607.17783/) (2026)

## Abstract (arXiv)

Counterfactual explanations suggest what should be different in the input instance to change the outcome of an AI system. When dealing with counterfactual explanations in the field of Predictive Process Monitoring, however, control flow relationships among events have to be carefully considered. A counterfactual, indeed, should not violate control flow relationships among activities (temporal background knowledege). Within the field of Explainability in Predictive Process Monitoring, there have been a series of works regarding counterfactual explanations for outcome-based predictions. However, none of them consider the inclusion of temporal background knowledge when generating these counterfactuals. In this work, we adapt state-of-the-art techniques for counterfactual generation in the domain of XAI that are based on genetic algorithms to consider a series of temporal constraints at runtime. We assume that this temporal background knowledge is given, and we adapt the fitness function, as well as the crossover and mutation operators, to maintain the satisfaction of the constraints. The proposed methods are evaluated with respect to state-of-the-art genetic algorithms for counterfactual generation and the results are presented. We showcase that the inclusion of temporal background knowledge allows the generation of counterfactuals more conformant to the temporal background knowledge, without however losing in terms of the counterfactual traditional quality metrics.
