Time Series Foundation Models for Process Model Forecasting
Not on the map. Why?
Abstract (arXiv)
Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on single-case prefixes. Prior benchmarks show that machine learning and deep learning models provide only modest gains over statistical baselines, mainly due to the sparsity and heterogeneity of the DF time series. We investigate Time Series Foundation Models (TSFMs), large pre-trained models for generic time series, as an alternative for PMF. Using DF time series derived from real-life event logs, we compare zero-shot use of TSFMs, without additional training, with fine-tuned variants adapted on PMF-specific data. TSFMs generally achieve lower forecasting errors (MAE and RMSE) than traditional and specialized models trained from scratch on the same logs, indicating effective transfer of temporal structure from non-process domains. While fine-tuning can further improve accuracy, the gains are often small and may disappear on smaller or more complex datasets, so zero-shot use remains a strong default. Our study highlights the generalization capability and data efficiency of TSFMs for process-related time series and, to the best of our knowledge, provides the first systematic evaluation of temporal foundation models for PMF.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 67 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
42 of 67 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2024GPT-4o System Cardcited by 4,588
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023A Survey of Large Language Modelscited by 2,576
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2024Chronos: Learning the Language of Time Seriescited by 759
30 more
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024LoRA Learns Less and Forgets Lesscited by 328
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
- 2023TimeGPT-1cited by 158
- 2016Predictive Business Process Monitoring with LSTM Neural Networkscited by 104
- 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 101
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
- 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 69
- 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 64
- 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 58
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2024A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challengescited by 47
- 2020Deep Learning for Predictive Business Process Monitoring: Review and Benchmarkcited by 45
- 2023ProbTS: Benchmarking Point and Distributional Forecasting across Diverse Prediction Horizonscited by 36
- 2024In-Context Fine-Tuning for Time-Series Foundation Modelscited by 35
- 2024Scaling Law for Time Series Forecastingcited by 33
- 2024Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain Modality Forecastingcited by 18
- 2024Scaling-laws for Large Time-series Modelscited by 18
- 2024Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Modelscited by 10
- 2025Channel Dependence, Limited Lookback Windows, and the Simplicity of Datasets: How Biased is Time Series Forecasting?cited by 8
- 2025Domain Adaptation of LLMs for Process Datacited by 6
- 2024Leveraging Large Language Models for Enhanced Process Model Comprehensioncited by 5
- 2025Decision-Focused Fine-Tuning of Time Series Foundation Models for Dispatchable Feeder Optimizationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.