Efficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring
Not on the map. Why?
Abstract (arXiv)
Predictive Process Monitoring (PPM) models are increasingly deployed in dynamic environments where concept drift causes the underlying process distribution to shift over time. While recent work has moved toward online continual learning, existing methods train compact, task-specific networks entirely from scratch, leaving a persistent cold-start problem. Foundation Models (FMs) offer a compelling solution to this problem, but their continual fine-tuning in the process mining domain remains unexplored. We propose COMPASS (Continual Online foundation Model-based PPM with Adaptive SubSpaces), the first framework for online continual fine-tuning of FMs for PPM. COMPASS adapts loss-plateau drift detection to autonomously identify task boundaries in event streams and maintains a unified knowledge subspace including both pre-trained and task-specific directions. We evaluate our approach on nine event streams covering synthetic and real-world concept drift scenarios, across task-free and task-aware settings with multiple backbones and with consistent hyperparameter tuning across all methods. Our approach outperforms three SOTA non-FM competitors and two update strategy baselines, with particularly strong gains on streams exhibiting recurrent drift and complex, long-running cases, while incurring acceptable computational overhead compared to the non-FM competitors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 16 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
7 of 16 references.
References · 7
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
- 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptationcited by 27
- 2026KeepLoRA: Continual Learning with Residual Gradient Adaptationcited by 21
- 2021How do I update my model? On the resilience of Predictive Process Monitoring models to changecited by 7
- 2025Domain Adaptation of LLMs for Process Datacited by 6
- 2026Chameleons do not Forget: Prompt-Based Online Continual Learning for Next Activity Predictioncited by 2
Built on by
Not cited yet.