mlsanityData to 14 Oct 2026

Neuro-Symbolic Predictive Process Monitoring

arXiv 2509.00834 ↗First posted 31 Aug 2025cs.AI cs.FL cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper addresses the problem of suffix prediction in Business Process Management (BPM) by proposing a Neuro-Symbolic Predictive Process Monitoring (PPM) approach that integrates data-driven learning with temporal logic-based prior knowledge. While recent approaches leverage deep learning models for suffix prediction, they often fail to satisfy even basic logical constraints due to the lack of explicit integration of domain knowledge during training. We propose a novel method to incorporate Linear Temporal Logic over finite traces (LTLf) into the training process of autoregressive sequence predictors. Our approach introduces a differentiable logical loss function, defined using a soft approximation of LTLf semantics and the Gumbel-Softmax trick, which can be combined with standard predictive losses. This ensures that the model learns to generate suffixes that are both accurate and logically consistent. Experimental evaluation on three real-world datasets shows that our method improves suffix prediction accuracy and compliance with temporal constraints. We also introduce two variants of the logic loss (local and global) and demonstrate their effectiveness under noisy and realistic settings. While developed in the context of BPM, our framework is applicable to any symbolic sequence generation task and contributes to advancing Neuro-Symbolic AI.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 32 of its 60 references that are in the map. First posted on arXiv 31 Aug 2025.

Builds on

32 of 60 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  6. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  7. 2016Pixel Recurrent Neural Networkscited by 816
  8. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  9. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 417
  10. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
  11. 2020Logic Tensor Networkscited by 199
  12. 2017Neural-Symbolic Learning and Reasoning: A Survey and Interpretationcited by 196
20 more
  1. 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
  2. 2020NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraintscited by 149
  3. 2016Predictive Business Process Monitoring with LSTM Neural Networkscited by 104
  4. 2018CGMH: Constrained Sentence Generation by Metropolis-Hastings Samplingcited by 94
  5. 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 89
  6. 2016Predicting Process Behaviour using Deep Learningcited by 60
  7. 2025Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlocited by 46
  8. 2020Deep Learning for Predictive Business Process Monitoring: Review and Benchmarkcited by 45
  9. 2022ROAD-R: The Autonomous Driving Dataset with Logical Requirementscited by 34
  10. 2024Adaptable Logical Control for Large Language Modelscited by 30
  11. 2017Symbolic LTLf Synthesiscited by 21
  12. 2021A Deep Adversarial Model for Suffix and Remaining Time Prediction of Event Sequencescited by 17
  13. 2019Hybrid Compositional Reasoning for Reactive Synthesis from Finite-Horizon Specificationscited by 16
  14. 2021Embedding Symbolic Temporal Knowledge into Deep Sequential Modelscited by 11
  15. 2024NeSyA: Neurosymbolic Automatacited by 10
  16. 2024DeepDFA: Automata Learning through Neural Probabilistic Relaxationscited by 8
  17. 2021What Averages Do Not Tell -- Predicting Real Life Processes with Sequential Deep Learningcited by 7
  18. 2024Neural Reward Machinescited by 7
  19. 2024Conformance Checking of Fuzzy Logs against Declarative Temporal Specificationscited by 5
  20. 2023Knowledge-Driven Modulation of Neural Networks with Attention Mechanism for Next Activity Predictioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.