# Online Anomaly Detection in HPC Systems

arXiv: https://arxiv.org/abs/1902.08447 · HTML: https://mlsanity.com/paper/1902.08447/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Feb 2019.

## Built on by (most cited first, 2 of 2)

- [RUAD: unsupervised anomaly detection in HPC systems](https://mlsanity.com/paper/2208.13169/) (2022)
- [DeepHYDRA: Resource-Efficient Time-Series Anomaly Detection in Dynamically-Configured Systems](https://mlsanity.com/paper/2405.07749/) (2024)

## Abstract (arXiv)

Reliability is a cumbersome problem in High Performance Computing Systems and Data Centers evolution. During operation, several types of fault conditions or anomalies can arise, ranging from malfunctioning hardware to improper configurations or imperfect software. Currently, system administrator and final users have to discover it manually. Clearly this approach does not scale to large scale supercomputers and facilities: automated methods to detect faults and unhealthy conditions is needed. Our method uses a type of neural network called autoncoder trained to learn the normal behavior of a real, in-production HPC system and it is deployed on the edge of each computing node. We obtain a very good accuracy (values ranging between 90% and 95%) and we also demonstrate that the approach can be deployed on the supercomputer nodes without negatively affecting the computing units performance.