mlsanityData to 7 Oct 2026

Topological Attention for Time Series Forecasting

arXiv 2107.09031 ↗First posted 19 Jul 2021cs.LG stat.MLcited by 14

Not on the map. Why?

Abstract (arXiv)

The problem of (point) forecasting textitunivariate time series is considered. Most approaches, ranging from traditional statistical methods to recent learning-based techniques with neural networks, directly operate on raw time series observations. As an extension, we study whether textitlocal topological properties, as captured via persistent homology, can serve as a reliable signal that provides complementary information for learning to forecast. To this end, we propose textittopological attention, which allows attending to local topological features within a time horizon of historical data. Our approach easily integrates into existing end-to-end trainable forecasting models, such as textttN-BEATS, and in combination with the latter exhibits state-of-the-art performance on the large-scale M4 benchmark dataset of 100,000 diverse time series from different domains. Ablation experiments, as well as a comparison to a broad range of forecasting methods in a setting where only a single time series is available for training, corroborate the beneficial nature of including local topological information through an attention mechanism.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 15 of its 48 references that are in the map. First posted on arXiv 19 Jul 2021.

Builds on

15 of 48 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  4. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  5. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 235
  6. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  7. 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 125
  8. 2019Ripser: efficient computation of Vietoris-Rips persistence barcodescited by 115
  9. 2019Deep Factors for Forecastingcited by 86
  10. 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 74
  11. 2019Graph Filtration Learningcited by 68
  12. 2019Connectivity-Optimized Representation Learning via Persistent Homologycited by 43
3 more
  1. 2019PI-Net: A Deep Learning Approach to Extract Topological Persistence Imagescited by 12
  2. 2018Chatter Classification in Turning Using Machine Learning and Topological Data Analysiscited by 6
  3. 2019Cyclicality, Periodicity and the Topology of Time Seriescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 3; 2026: 3.

14 papers.

Sort: