Interpretable and Explainable Machine Learning Methods for Predictive Process Monitoring: A Systematic Literature Review
Not on the map. Why?
Abstract (arXiv)
This paper presents a systematic literature review (SLR) on the explainability and interpretability of machine learning (ML) models within the context of predictive process mining, using the PRISMA framework. Given the rapid advancement of artificial intelligence (AI) and ML systems, understanding the "black-box" nature of these technologies has become increasingly critical. Focusing specifically on the domain of process mining, this paper delves into the challenges of interpreting ML models trained with complex business process data. We differentiate between intrinsically interpretable models and those that require post-hoc explanation techniques, providing a comprehensive overview of the current methodologies and their applications across various application domains. Through a rigorous bibliographic analysis, this research offers a detailed synthesis of the state of explainability and interpretability in predictive process mining, identifying key trends, challenges, and future directions. Our findings aim to equip researchers and practitioners with a deeper understanding of how to develop and implement more trustworthy, transparent, and effective intelligent systems for predictive process analytics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 169 references that are in the map. First posted on arXiv 29 Dec 2023.
Builds on
13 of 169 references.
References · 13
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 88
- 2017Interpretable & Explorable Approximations of Black Box Modelscited by 54
- 2020Explainable Predictive Process Monitoringcited by 27
- 2020Explainable Artificial Intelligence for Process Mining: A General Overview and Application of a Novel Local Explanation Approach for Predictive Process Monitoringcited by 20
- 2021Explainability Is in the Mind of the Beholder: Establishing the Foundations of Explainable Artificial Intelligencecited by 13
- 2020XNAP: Making LSTM-based Next Activity Predictions Explainable by Using LRPcited by 12
- 2023Quantifying and Explaining Machine Learning Uncertainty in Predictive Process Monitoring: An Operations Research Perspectivecited by 10
- 2022An Explainable Decision Support System for Predictive Process Analyticscited by 8
- 2021Building Interpretable Models for Business Process Prediction using Shared and Specialised Attention Mechanismscited by 6
- 2022Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Modelscited by 5
- 2021Explainable AI Enabled Inspection of Business Process Prediction Modelscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025XABPs: Towards eXplainable Autonomous Business Processescited by 3
- 2026KANFIS: A Neuro-Symbolic Framework for Interpretable and Uncertainty-Aware Learningcited by 1
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Makingcited by 1
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networkscited by 0
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networks13 Sep 2026
- 2026Interpretable and Explainable Surrogate Modeling for Simulations: A State-of-the-Art Survey and Perspectives on Explainable AI for Decision-Making15 Apr 2026
- 2026KANFIS: A Neuro-Symbolic Framework for Interpretable and Uncertainty-Aware Learning3 Feb 2026
- 2025XABPs: Towards eXplainable Autonomous Business Processes31 Jul 2025