# Mind the Long Tail: Understanding the Difficulty of Delay Detection in Business Processes

arXiv: https://arxiv.org/abs/2608.14367 · HTML: https://mlsanity.com/paper/2608.14367/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 8 of its 30 references that are in the map.
- First posted on arXiv 14 Aug 2026.

## Builds on (most cited first, 8 of 8)

- [Delving into Deep Imbalanced Regression](https://mlsanity.com/paper/2102.09554/) (2021)
- [Balanced MSE for Imbalanced Visual Regression](https://mlsanity.com/paper/2203.16427/) (2022)
- [A systematic literature review on state-of-the-art deep learning methods for process prediction](https://mlsanity.com/paper/2101.09320/) (2021)
- [LSTM Networks for Data-Aware Remaining Time Prediction of Business Process Instances](https://mlsanity.com/paper/1711.03822/) (2017)
- [Time Matters: Time-Aware LSTMs for Predictive Business Process Monitoring](https://mlsanity.com/paper/2010.00889/) (2020)
- [PGTNet: A Process Graph Transformer Network for Remaining Time Prediction of Business Process Instances](https://mlsanity.com/paper/2404.06267/) (2024)
- [UBL: an R package for Utility-based Learning](https://mlsanity.com/paper/1604.08079/) (2016)
- [Model Optimization in Imbalanced Regression](https://mlsanity.com/paper/2206.09991/) (2022)

## Abstract (arXiv)

The early detection of delayed cases in business processes is a critical capability for organizations. Predictive process monitoring (PPM) supports this task by using historical event logs to predict the remaining time of ongoing cases, enabling timely interventions to avoid missed deadlines and service level violations. Although remaining time prediction has advanced considerably through sophisticated deep learning architectures, little is known about the intrinsic difficulty of delay detection itself. Since performance is typically assessed using aggregate metrics, prior work provides limited insight into how models perform across the target distribution, especially on the operationally most critical cases with large delays. In this paper, we address this gap by analyzing the difficulty of delay detection. Across 14 event logs, we show that remaining times are typically strongly right-skewed, with only a small fraction of cases exhibiting large delays. Existing models capture the mode of this distribution well but perform poorly on high-delay cases. We further uncover pronounced heteroscedasticity, showing that predictive uncertainty increases with delay magnitude. Based on these findings, we evaluate approaches to mitigate the imbalance problem, but find only limited benefits, suggesting that the key underlying problem may not be imbalance but higher uncertainty associated with delayed cases. We show that this correlation can be exploited to substantially improve the identification of delayed cases. Overall, our work provides new insights into the sources of difficulty in delay detection and identifies uncertainty-aware modeling as a promising direction for future PPM research.
