mlsanityData to 14 Oct 2026

Scaling Online Complex Event Detection with Synthetic Supervision and Mamba-Based Neural Algorithmic Reasoning

arXiv 2502.07250 ↗First posted 11 Feb 2025cs.LG cs.AIcited by 0

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Modern machine learning models excel at detecting individual actions, sounds, or scene attributes from short, localized observations. However, many real-world tasks, such as in smart cities and healthcare, require reasoning over high-level complex events (CEs): spatiotemporal, rule-governed patterns of short-term atomic events (AEs). Complex event detection (CED) is challenging due to long temporal dependencies, generalization beyond the training horizon, sparse CE-level supervision without temporally aligned fine-grained AE labels, and cognitively demanding annotation, as CE labels often depend on ordering, duration, negation, and completion-time semantics. These challenges are further amplified in an online setting that requires causal, streaming inference with limited computation. We identify the primary bottleneck in online CED as learning robust CE rules, and propose a Neural Algorithmic Reasoning framework that decouples rule learning from low-level sensor semantics by (i) generating large-scale synthetic AE-level concept traces to pretrain a Mamba-based CE-rule reasoner, and (ii) introducing an adapter that learns to map raw sensor inputs into the reasoner's latent space using limited, labeled sensor data. We introduce a controlled simulator-generated online multilabel CED testbed built from real-world multimodal sensor clips and rule-generated CE labels, with stress-test settings that vary sensor noise, distribution shift, and the window size used to segment streaming sensor sequences. Experiments on this controlled benchmark show that NAROCE is competitive with the strongest baselines and often outperforms them under these stress tests and longer-horizon generalization, while using 5x fewer labeled sensor sequences and 10-20x fewer FLOPs than all non-Mamba baselines. Code and dataset available at https://github.com/nesl/naroce_dailyoce.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 16 of its 44 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

16 of 44 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  5. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  6. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  7. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  8. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
  9. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  10. 2021Neural Algorithmic Reasoningcited by 94
  11. 2021Long Short-Term Transformer for Online Action Detectioncited by 88
  12. 2021OadTR: Online Action Detection with Transformerscited by 83
4 more
  1. 2016Online Action Detectioncited by 69
  2. 2023Memory-and-Anticipation Transformer for Online Action Understandingcited by 39
  3. 2022GateHUB: Gated History Unit with Background Suppression for Online Action Detectioncited by 27
  4. 2023E2E-LOAD: End-to-End Long-form Online Action Detectioncited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024An Empirical Evaluation of Neural and Neuro-symbolic Approaches to Real-time Multimodal Complex Event Detection
  2. 2025Toward Foundation Models for Online Complex Event Detection in CPS-IoT: A Case Study
  3. 2025From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoning
  4. 2026Abstract Event Causal Rules: Induction and Application
  5. 2026Grammar of the Wave: Towards Explainable Multivariate Time Series Event Detection via Neuro-Symbolic VLM Agents
  6. 2025A Challenge to Build Neuro-Symbolic Video Agents
  7. 2024PASS: Path-selective State Space Model for Event-based Recognition
  8. 2026dKFD: Phase-Structured Evidence Allocation for Fixed-Budget Localized Event Understanding