Self-Supervised and Interpretable Anomaly Detection using Network Transformers
Not on the map. Why?
Abstract (arXiv)
Monitoring traffic in computer networks is one of the core approaches for defending critical infrastructure against cyber attacks. Machine Learning (ML) and Deep Neural Networks (DNNs) have been proposed in the past as a tool to identify anomalies in computer networks. Although detecting these anomalies provides an indication of an attack, just detecting an anomaly is not enough information for a user to understand the anomaly. The black-box nature of off-the-shelf ML models prevents extracting important information that is fundamental to isolate the source of the fault/attack and take corrective measures. In this paper, we introduce the Network Transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. The presented approach has the following advantages: 1) enhanced interpretability by incorporating the graph structure of computer networks; 2) provides a hierarchical set of features that enables analysis at different levels of granularity; 3) self-supervised training that does not require labeled data. The presented approach was tested by evaluating the successful detection of anomalies in an Industrial Control System (ICS). The presented approach successfully identified anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 64 references that are in the map. First posted on arXiv 25 Feb 2022.
Builds on
16 of 64 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016Layer Normalizationcited by 5,669
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Non-local Neural Networkscited by 2,293
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
- 2021Graph Neural Network-Based Anomaly Detection in Multivariate Time Seriescited by 301
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
4 more
- 2020A review on outlier/anomaly detection in time series datacited by 189
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 148
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2020Structural Temporal Graph Neural Networks for Anomaly Detection in Dynamic Graphscited by 56
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 0; 2026: 1.
2 papers.