A Comparison of Deep-Learning Methods for Analysing and Predicting Business Processes
Not on the map. Why?
Abstract (arXiv)
Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional approaches. We extend the existing body of research by testing four different variants of Graph Neural Networks (GNN) and a fully connected Multi-layer Perceptron (MLP) with dropout for the tasks of predicting the nature and timestamp of the next process activity. In contrast to existing studies, we evaluate our models' performance at different stages of a process, determined by quartiles of the number of events and normalized quarters of the case duration. This provides new insights into the performance of a prediction model, as they behave differently at different stages of a business-process. Interestingly, our experiments show that the simple MLP often outperforms more sophisticated deep-learning models in both prediction tasks. We argue that care needs to be taken when applying automated process-prediction techniques at different stages of a process. We further argue that researchers should reflect their results with strong baselines methods like simple MLPs.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 11 Feb 2021.
Builds on
12 of 35 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2018Link Prediction Based on Graph Neural Networkscited by 832
- 2016Predictive Business Process Monitoring with LSTM Neural Networkscited by 104
- 2013Predictive Monitoring of Business Processescited by 37
- 2019Process Mining for Python (PM4Py): Bridging the Gap Between Process- and Data Sciencecited by 33
- 2020Predictive Business Process Monitoring via Generative Adversarial Nets: The Case of Next Event Predictioncited by 31
- 2020Lifelong Learning of Graph Neural Networks for Open-World Node Classificationcited by 22
- 2018Using Deep Learning for Title-Based Semantic Subject Indexing to Reach Competitive Performance to Full-Textcited by 10
- 2019Multi-Modal Adversarial Autoencoders for Recommendations of Citations and Subject Labelscited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 1; 2024: 2; 2025: 2; 2026: 1.
11 papers.
- 2021Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLPcited by 17
- 2024PGTNet: A Process Graph Transformer Network for Remaining Time Prediction of Business Process Instancescited by 14
- 2021Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoringcited by 12
- 2024SNAP: Semantic Stories for Next Activity Predictioncited by 8
- 2023Trace Encoding in Process Mining: a survey and benchmarkingcited by 6
- 2022A Framework for Extracting and Encoding Features from Object-Centric Event Datacited by 3
- 2025RLHGNN: Reinforcement Learning-driven Heterogeneous Graph Neural Network for Next Activity Prediction in Business Processescited by 1
- 2022Graph Summarization with Graph Neural Networkscited by 0
- 2022Encoder-Decoder Model for Suffix Prediction in Predictive Monitoringcited by 0
- 2025Semiconductor Industry Trend Prediction with Event Intervention Based on LSTM Model in Sentiment-Enhanced Time Series Datacited by 0
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networkscited by 0
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networks13 Sep 2026
- 2025Semiconductor Industry Trend Prediction with Event Intervention Based on LSTM Model in Sentiment-Enhanced Time Series Data19 Nov 2025
- 2025RLHGNN: Reinforcement Learning-driven Heterogeneous Graph Neural Network for Next Activity Prediction in Business Processes3 Jul 2025
- 2024PGTNet: A Process Graph Transformer Network for Remaining Time Prediction of Business Process Instances9 Apr 2024
- 2024SNAP: Semantic Stories for Next Activity Prediction28 Jan 2024
- 2023Trace Encoding in Process Mining: a survey and benchmarking5 Jan 2023
- 2022Encoder-Decoder Model for Suffix Prediction in Predictive Monitoring29 Nov 2022
- 2022A Framework for Extracting and Encoding Features from Object-Centric Event Data2 Sep 2022
- 2022Graph Summarization with Graph Neural Networks11 Mar 2022
- 2021Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoring17 Dec 2021
- 2021Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP8 Sep 2021