mlsanityData to 7 Oct 2026

TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection

arXiv 2411.11641 ↗First posted 18 Nov 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Time series anomaly detection aims to identify unusual patterns in data or deviations from systems' expected behavior. The reconstruction-based methods are the mainstream in this task, which learn point-wise representation via unsupervised learning. However, the unlabeled anomaly points in training data may cause these reconstruction-based methods to learn and reconstruct anomalous data, resulting in the challenge of capturing normal patterns. In this paper, we propose a time series anomaly detection method based on implicit neural representation (INR) reconstruction, named TSINR, to address this challenge. Due to the property of spectral bias, TSINR enables prioritizing low-frequency signals and exhibiting poorer performance on high-frequency abnormal data. Specifically, we adopt INR to parameterize time series data as a continuous function and employ a transformer-based architecture to predict the INR of given data. As a result, the proposed TSINR method achieves the advantage of capturing the temporal continuity and thus is more sensitive to discontinuous anomaly data. In addition, we further design a novel form of INR continuous function to learn inter- and intra-channel information, and leverage a pre-trained large language model to amplify the intense fluctuations in anomalies. Extensive experiments demonstrate that TSINR achieves superior overall performance on both univariate and multivariate time series anomaly detection benchmarks compared to other state-of-the-art reconstruction-based methods. Our codes are available.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 84 references that are in the map. First posted on arXiv 18 Nov 2024.

Builds on

33 of 84 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  9. 2018On the Spectral Bias of Neural Networkscited by 1,321
  10. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  12. 2021Neural Fields in Visual Computing and Beyondcited by 539
21 more
  1. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
  2. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 387
  3. 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 211
  4. 2017A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencodercited by 209
  5. 2021Implicit Neural Representations for Image Compressioncited by 161
  6. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  7. 2021Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoTcited by 104
  8. 2023DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detectioncited by 103
  9. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  10. 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 88
  11. 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 87
  12. 2020Time Series Change Point Detection with Self-Supervised Contrastive Predictive Codingcited by 58
  13. 2020ContactNets: Learning Discontinuous Contact Dynamics with Smooth, Implicit Representationscited by 38
  14. 2021Distilling Holistic Knowledge with Graph Neural Networkscited by 26
  15. 2023Time Series Continuous Modeling for Imputation and Forecasting with Implicit Neural Representationscited by 16
  16. 2023Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesiscited by 13
  17. 2022Time-Series Anomaly Detection with Implicit Neural Representationcited by 10
  18. 2023Multi-scale Cross-restoration Framework for Electrocardiogram Anomaly Detectioncited by 10
  19. 2019NFAD: Fixing anomaly detection using normalizing flowscited by 6
  20. 2023SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-hoc Interpretable Fault Diagnosis with Limited Fault Samplescited by 5
  21. 2022Hilbert Distillation for Cross-Dimensionality Networkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.