Self-supervised Learning for Anomaly Detection in Computational Workflows
Not on the map. Why?
Abstract (arXiv)
Anomaly detection is the task of identifying abnormal behavior of a system. Anomaly detection in computational workflows is of special interest because of its wide implications in various domains such as cybersecurity, finance, and social networks. However, anomaly detection in computational workflows~(often modeled as graphs) is a relatively unexplored problem and poses distinct challenges. For instance, when anomaly detection is performed on graph data, the complex interdependency of nodes and edges, the heterogeneity of node attributes, and edge types must be accounted for. Although the use of graph neural networks can help capture complex inter-dependencies, the scarcity of labeled anomalous examples from workflow executions is still a significant challenge. To address this problem, we introduce an autoencoder-driven self-supervised learning~(SSL) approach that learns a summary statistic from unlabeled workflow data and estimates the normal behavior of the computational workflow in the latent space. In this approach, we combine generative and contrastive learning objectives to detect outliers in the summary statistics. We demonstrate that by estimating the distribution of normal behavior in the latent space, we can outperform state-of-the-art anomaly detection methods on our benchmark datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 2 Oct 2023.
Builds on
20 of 40 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2019An Introduction to Variational Autoencoderscited by 997
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
- 2022Context Autoencoder for Self-Supervised Representation Learningcited by 297
- 2019PyOD: A Python Toolbox for Scalable Outlier Detectioncited by 221
- 2021SiT: Self-supervised vIsion Transformercited by 99
- 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
8 more
- 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
- 2020SelfAugment: Automatic Augmentation Policies for Self-Supervised Learningcited by 32
- 2018Anomaly Detection using Autoencoders in High Performance Computing Systemscited by 25
- 2022Graph Anomaly Detection with Graph Neural Networks: Current Status and Challengescited by 23
- 2022Differentiable Top-k Classification Learningcited by 21
- 2021Anomaly Clustering: Grouping Images into Coherent Clusters of Anomaly Typescited by 13
- 2023Flow-Bench: A Dataset for Computational Workflow Anomaly Detectioncited by 2
Built on by
Not cited yet.