Benchmarking Deep Learning Models for Anomaly Detection in Real-World Cloud Telemetry
Not on the map. Why?
Abstract (arXiv)
Modern cloud platforms generate high-dimensional, noisy telemetry from thousands of microservices. Unlike classical anomaly detection benchmarks, cloud anomalies are short-lived, irregular, and largely non-periodic, making timely detection challenging. We present an empirical benchmark of deep learning models for anomaly detection using a real-world IBM Cloud Console dataset. We evaluate GRU, Transformer, TimesNet, and Autoformer architectures using the Numenta Anomaly Benchmark (NAB), a timing-aware metric that accounts for early detection and false alarms. TimesNet achieves the highest NAB scores due to strong early-detection sensitivity. Transformer models also detect anomalies early but incur higher false-positive rates. An improved GRU autoencoder, incorporating robust scoring and persistence rules, achieves competitive performance with a more stable false-alarm profile. Overall, the modest performance differences suggest that real cloud anomalies are dominated by short-term deviations rather than persistent periodic structure, emphasizing the importance of timing-aware evaluation and robust post-processing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 12 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
6 of 12 references.
References · 6
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
- 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
- 2015Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmarkcited by 88
- 2021Anomaly Detection and Failure Root Cause Analysis in (Micro)Service-Based Cloud Applications: A Surveycited by 48
- 2024Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Datasetcited by 7
Built on by
Not cited yet.