Global and Local Topology-Aware Attention with Persistent Homology and Euler Biases for Time-Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Scientific time series often encode predictive geometric structure, including connectivity, cycles, shell-like geometry, directional changes, and nonlinear neighborhoods, that standard dot-product attention does not explicitly represent. We introduce a topology-aware attention framework that adds such structure to attention logits using persistent homology (H0-H2), anchored Euler characteristic transforms, and kernel-Hilbert channels. A validation-gated local residual captures local topological signals, including a Zeng-style local H0 component, only when held-out validation data support the correction. Exact Vietoris-Rips computations and smooth topological surrogates are evaluated under a no-leakage protocol with train-only calibration, validation-only selection, and test-only reporting. We evaluate guarded topology-aware variants across three architecture families: lightweight attention/Ridge, PatchTSTForRegression, and TimeSeriesTransformerForPrediction. Experiments include synthetic benchmarks isolating higher-order topology and real datasets covering CO2, S&P 500 return-window geometry, and NASA IMS bearing degradation. The audit uses matched paired comparisons across seven dataset units, three random seeds, and three chronological splits, giving 63 paired units per architecture and 189 paired units overall. Topology-aware models show positive paired effects when geometry is predictive, with heterogeneous magnitude across datasets and architectures. Lightweight attention/Ridge improves in 46 of 63 units, with mean relative RMSE reduction of 12.5% and paired randomization p=7.2e-4; PatchTST improves in 33 units and retains the baseline in 20 units, with 23.5% reduction and p=3.5e-5; and TimeSeriesTransformer improves in 47 units, with 47.8% reduction and p<1e-4. The results support topology as a validation-selected, architecture-compatible inductive bias.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
14 of 32 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
- 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
- 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 75
- 2023Differentiable Euler Characteristic Transforms for Shape Classificationcited by 18
- 2021Topological Attention for Time Series Forecastingcited by 14
- 2023Euler Characteristic Tools For Topological Data Analysiscited by 13
- 2024Topology-Informed Graph Transformercited by 13
- 2024Attending to Topological Spaces: The Cellular Transformercited by 11
- 2024Linear Transformer Topological Masking with Graph Random Featurescited by 7
2 more
Built on by
Not cited yet.