mlsanityData to 7 Oct 2026

SEDformer: Event-Synchronous Spiking Transformers for Irregular Telemetry Time Series Forecasting

arXiv 2602.02230 ↗First posted 2 Feb 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Telemetry streams from large-scale Internet-connected systems (e.g., IoT deployments and online platforms) naturally form an irregular multivariate time series (IMTS) whose accurate forecasting is operationally vital. A closer examination reveals a defining Sparsity-Event Duality (SED) property of IMTS, i.e., long stretches with sparse or no observations are punctuated by short, dense bursts where most semantic events (observations) occur. However, existing Graph- and Transformer-based forecasters ignore SED: pre-alignment to uniform grids with heavy padding violates sparsity by inflating sequences and forcing computation at non-informative steps, while relational recasting weakens event semantics by disrupting local temporal continuity. These limitations motivate a more faithful and natural modeling paradigm for IMTS that aligns with its SED property. We find that Spiking Neural Networks meet this requirement, as they communicate via sparse binary spikes and update in an event-driven manner, aligning naturally with the SED nature of IMTS. Therefore, we present SEDformer, an SED-enhanced Spiking Transformer for telemetry IMTS forecasting that couples: (1) a SED-based Spike Encoder converts raw observations into event synchronous spikes using an Event-Aligned LIF neuron, (2) an Event-Preserving Temporal Downsampling module compresses long gaps while retaining salient firings and (3) a stack of SED-based Spike Transformer blocks enable intra-series dependency modeling with a membrane-based linear attention driven by EA-LIF spiking features. Experiments on public telemetry IMTS datasets show that SEDformer attains state-of-the-art forecasting accuracy while reducing energy and memory usage, providing a natural and efficient path for modeling IMTS.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

30 of 67 references.

References · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  4. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  5. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  6. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  7. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  8. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  9. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 263
  10. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
  11. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  12. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
18 more
  1. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
  2. 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
  3. 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 178
  4. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 171
  5. 2019Time-Series Anomaly Detection Service at Microsoftcited by 163
  6. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 103
  7. 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 101
  8. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
  9. 2021Advancing Spiking Neural Networks towards Deep Residual Learningcited by 76
  10. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
  11. 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 54
  12. 2024TSI-Bench: Benchmarking Time Series Imputationcited by 33
  13. 2022EXIT: Extrapolation and Interpolation-based Neural Controlled Differential Equations for Time-series Classification and Forecastingcited by 22
  14. 2025HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecastingcited by 14
  15. 2022TSFool: Crafting Highly-Imperceptible Adversarial Time Series through Multi-Objective Attackcited by 9
  16. 2025Multivariate Time Series Anomaly Detection by Capturing Coarse-Grained Intra- and Inter-Variate Dependenciescited by 8
  17. 2025Revitalizing Canonical Pre-Alignment for Irregular Multivariate Time Series Forecastingcited by 5
  18. 2025SUSTeR: Sparse Unstructured Spatio Temporal Reconstruction on Traffic Predictioncited by 3

Built on by

Not cited yet.