mlsanityData to 13 Oct 2026

Scalable Temporal Anomaly Causality Discovery in Large Systems: Achieving Computational Efficiency with Binary Anomaly Flag Data

arXiv 2412.11800 ↗First posted 16 Dec 2024cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Extracting anomaly causality facilitates diagnostics once monitoring systems detect system faults. Identifying anomaly causes in large systems involves investigating a broader set of monitoring variables across multiple subsystems. However, learning graphical causal models (GCMs) comes with a significant computational burden that restrains the applicability of most existing methods in real-time and large-scale deployments. In addition, modern monitoring applications for large systems often generate large amounts of binary alarm flags, and the distinct characteristics of binary anomaly data -- the meaning of state transition and data sparsity -- challenge existing causality learning mechanisms. This study proposes an anomaly causal discovery approach (AnomalyCD), addressing the accuracy and computational challenges of generating GCMs from temporal binary flag datasets. The AnomalyCD presents several strategies, such as anomaly data-aware causality testing, sparse data and prior link compression, and edge pruning adjustment approaches. We validate the performance of the approach on two datasets: monitoring sensor data from the readout-box system of the Compact Muon Solenoid experiment at CERN, and a public dataset from an information technology monitoring system. The results on temporal GCMs demonstrate a considerable reduction of computation overhead and a moderate enhancement of accuracy on the binary anomaly datasets. Code: https://github.com/muleina/AnomalyCD .

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 30 of its 97 references that are in the map. First posted on arXiv 16 Dec 2024.

Builds on

30 of 97 references.

References · 30

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,515
  2. 2017Detecting causal associations in large nonlinear time series datasetscited by 242
  3. 2019Gradient-Based Neural DAG Learningcited by 227
  4. 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 189
  5. 2013CAM: Causal additive models, high-dimensional order search and penalized regressioncited by 177
  6. 2019Time-Series Anomaly Detection Service at Microsoftcited by 163
  7. 2019Causal Discovery with Reinforcement Learningcited by 145
  8. 2020Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasetscited by 137
  9. 2018Multivariate LSTM-FCNs for Time Series Classificationcited by 120
  10. 2020High-recall causal discovery for autocorrelated time series with latent confounderscited by 82
  11. 2019Causal structure based root cause analysis of outlierscited by 65
  12. 2021Granger Causality: A Review and Recent Advancescited by 62
18 more
  1. 2021gCastle: A Python Toolbox for Causal Discoverycited by 61
  2. 2019A Graph Autoencoder Approach to Causal Structure Learningcited by 55
  3. 2021Ordering-Based Causal Discovery with Reinforcement Learningcited by 55
  4. 2021Why did the distribution change?cited by 37
  5. 2023Root Cause Identification for Collective Anomalies in Time Series given an Acyclic Summary Causal Graph with Loopscited by 30
  6. 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Datacited by 29
  7. 2020Reconstructing regime-dependent causal relationships from observational time seriescited by 28
  8. 2022ClaSP -- Parameter-free Time Series Segmentationcited by 21
  9. 2023Enhancing Causal Discovery from Robot Sensor Data in Dynamic Scenarioscited by 16
  10. 2024Comprehensive Review and Empirical Evaluation of Causal Discovery Algorithms for Numerical Datacited by 8
  11. 2018Root-cause Analysis for Time-series Anomalies via Spatiotemporal Graphical Modeling in Distributed Complex Systemscited by 4
  12. 2023Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimetercited by 4
  13. 2022Statistical Perspective on Functional and Causal Neural Connectomics: The Time-Aware PC Algorithmcited by 3
  14. 2017The model of an anomaly detector for HiLumi LHC magnets based on Recurrent Neural Networks and adaptive quantizationcited by 2
  15. 2024Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detectioncited by 2
  16. 2020The CMS monitoring infrastructure and applicationscited by 1
  17. 2022Framework for inferring empirical causal graphs from binary data to support multidimensional poverty analysiscited by 1
  18. 2024Lightweight Multi-System Multivariate Interconnection and Divergence Discoverycited by 1

Built on by

Not cited yet.