mlsanityData to 7 Oct 2026

Are we certain it's anomalous?

arXiv 2211.09224 ↗First posted 16 Nov 2022cs.LG cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

The progress in modelling time series and, more generally, sequences of structured data has recently revamped research in anomaly detection. The task stands for identifying abnormal behaviors in financial series, IT systems, aerospace measurements, and the medical domain, where anomaly detection may aid in isolating cases of depression and attend the elderly. Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations and since the definition of anomalous is sometimes subjective. Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD). HypAD learns self-supervisedly to reconstruct the input signal. We adopt best practices from the state-of-the-art to encode the sequence by an LSTM, jointly learned with a decoder to reconstruct the signal, with the aid of GAN critics. Uncertainty is estimated end-to-end by means of a hyperbolic neural network. By using uncertainty, HypAD may assess whether it is certain about the input signal but it fails to reconstruct it because this is anomalous; or whether the reconstruction error does not necessarily imply anomaly, as the model is uncertain, e.g. a complex but regular input signal. The novel key idea is that a detectable anomaly is one where the model is certain but it predicts wrongly. HypAD outperforms the current state-of-the-art for univariate anomaly detection on established benchmarks based on data from NASA, Yahoo, Numenta, Amazon, and Twitter. It also yields state-of-the-art performance on a multivariate dataset of anomaly activities in elderly home residences, and it outperforms the baseline on SWaT. Overall, HypAD yields the lowest false alarms at the best performance rate, thanks to successfully identifying detectable anomalies.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 29 of its 68 references that are in the map. First posted on arXiv 16 Nov 2022.

Builds on

29 of 68 references.

References · 29

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  3. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  4. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  5. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
  6. 2019Hyperbolic Graph Convolutional Neural Networkscited by 400
  7. 2018Hyperbolic Neural Networkscited by 393
  8. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  9. 2019Hyperbolic Graph Neural Networkscited by 244
  10. 2019Hyperbolic Image Embeddingscited by 219
  11. 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 213
  12. 2019MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscited by 176
17 more
  1. 2016A Theory of Generative ConvNetcited by 174
  2. 2018Acquisition of Localization Confidence for Accurate Object Detectioncited by 174
  3. 2018Hyperbolic Attention Networkscited by 122
  4. 2020Multivariate Confidence Calibration for Object Detectioncited by 98
  5. 2015Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmarkcited by 87
  6. 2021An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Seriescited by 68
  7. 2016Cooperative Training of Descriptor and Generator Networkscited by 60
  8. 2020TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networkscited by 55
  9. 2020Differentiating through the Fr'echet Meancited by 52
  10. 2021Learning the Predictability of the Futurecited by 48
  11. 2021Anomaly Detection of Time Series with Smoothness-Inducing Sequential Variational Auto-Encodercited by 39
  12. 2021Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filteringcited by 31
  13. 2016Self Paced Deep Learning for Weakly Supervised Object Detectioncited by 25
  14. 2020Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detectioncited by 19
  15. 2021Uncertainty-Aware Camera Pose Estimation from Points and Linescited by 16
  16. 2021Dense Uncertainty Estimationcited by 9
  17. 2019Unsupervised Boosting-based Autoencoder Ensembles for Outlier Detectioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 6; 2025: 3; 2026: 1.

13 papers.

Sort:

By area: