# A Temporal Kolmogorov-Arnold Transformer for Time Series Forecasting

arXiv: https://arxiv.org/abs/2406.02486 · HTML: https://mlsanity.com/paper/2406.02486/

## Key facts

- Cited by 52 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 44 references that are in the map.
- First posted on arXiv 4 Jun 2024.

## Builds on (most cited first, 21 of 21)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://mlsanity.com/paper/1910.10683/) (2019)
- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://mlsanity.com/paper/2012.07436/) (2020)
- [Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism](https://mlsanity.com/paper/1909.08053/) (2019)
- [Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)](https://mlsanity.com/paper/1511.07289/) (2015)
- [Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting](https://mlsanity.com/paper/1912.09363/) (2019)
- [Compressive Transformers for Long-Range Sequence Modelling](https://mlsanity.com/paper/1911.05507/) (2019)
- [Language Modeling with Gated Convolutional Networks](https://mlsanity.com/paper/1612.08083/) (2016)
- [KAN: Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2404.19756/) (2024)
- [Efficient Content-Based Sparse Attention with Routing Transformers](https://mlsanity.com/paper/2003.05997/) (2020)
- [The Evolved Transformer](https://mlsanity.com/paper/1901.11117/) (2019)
- [Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case](https://mlsanity.com/paper/2001.08317/) (2020)
- [Temporal Pattern Attention for Multivariate Time Series Forecasting](https://mlsanity.com/paper/1809.04206/) (2018)
- [Wav-KAN: Wavelet Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2405.12832/) (2024)
- [Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks](https://mlsanity.com/paper/1909.09586/) (2019)
- [Kolmogorov-Arnold Networks (KANs) for Time Series Analysis](https://mlsanity.com/paper/2405.08790/) (2024)
- [TKAN: Temporal Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2405.07344/) (2024)
- [TENER: Adapting Transformer Encoder for Named Entity Recognition](https://mlsanity.com/paper/1911.04474/) (2019)
- [Autoregressive Convolutional Neural Networks for Asynchronous Time Series](https://mlsanity.com/paper/1703.04122/) (2017)
- [Mask Attention Networks: Rethinking and Strengthen Transformer](https://mlsanity.com/paper/2103.13597/) (2021)

## Built on by (most cited first, 30 of 52)

- [KAN 2.0: Kolmogorov-Arnold Networks Meet Science](https://mlsanity.com/paper/2408.10205/) (2024)
- [A Survey on Kolmogorov-Arnold Network](https://mlsanity.com/paper/2411.06078/) (2024)
- [fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functions](https://mlsanity.com/paper/2406.07456/) (2024)
- [KAGNNs: Kolmogorov-Arnold Networks meet Graph Learning](https://mlsanity.com/paper/2406.18380/) (2024)
- [Adaptive Training of Grid-Dependent Physics-Informed Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2407.17611/) (2024)
- [KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Search](https://mlsanity.com/paper/2406.17630/) (2024)
- [On the expressiveness and spectral bias of KANs](https://mlsanity.com/paper/2410.01803/) (2024)
- [CoxKAN: Kolmogorov-Arnold Networks for Interpretable, High-Performance Survival Analysis](https://mlsanity.com/paper/2409.04290/) (2024)
- [FC-KAN: Function Combinations in Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2409.01763/) (2024)
- [DropKAN: Regularizing KANs by masking post-activations](https://mlsanity.com/paper/2407.13044/) (2024)
- [SigKAN: Signature-Weighted Kolmogorov-Arnold Networks for Time Series](https://mlsanity.com/paper/2406.17890/) (2024)
- [Generalization Bounds and Model Complexity for Kolmogorov-Arnold Networks](https://mlsanity.com/paper/2410.08026/) (2024)
- [Exploring Kolmogorov-Arnold Networks for Interpretable Time Series Classification](https://mlsanity.com/paper/2411.14904/) (2024)
- [QKAN-LSTM: Quantum-inspired Kolmogorov-Arnold Long Short-term Memory](https://mlsanity.com/paper/2512.05049/) (2025)
- [Deep State Space Recurrent Neural Networks for Time Series Forecasting](https://mlsanity.com/paper/2407.15236/) (2024)
- [Are KANs Effective for Multivariate Time Series Forecasting?](https://mlsanity.com/paper/2408.11306/) (2024)
- [A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Experts](https://mlsanity.com/paper/2409.15161/) (2024)
- [Free-Knots Kolmogorov-Arnold Network: On the Analysis of Spline Knots and Advancing Stability](https://mlsanity.com/paper/2501.09283/) (2025)
- [Rethinking the Function of Neurons in KANs](https://mlsanity.com/paper/2407.20667/) (2024)
- [FourierKAN outperforms MLP on Text Classification Head Fine-tuning](https://mlsanity.com/paper/2408.08803/) (2024)
- [Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attention](https://mlsanity.com/paper/2502.13693/) (2025)
- [Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learning](https://mlsanity.com/paper/2502.21130/) (2025)
- [LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration](https://mlsanity.com/paper/2602.20497/) (2026)
- [KAN we improve on HEP classification tasks? Kolmogorov-Arnold Networks applied to an LHC physics example](https://mlsanity.com/paper/2408.02743/) (2024)
- [TabKANet: Tabular Data Modeling with Kolmogorov-Arnold Network and Transformer](https://mlsanity.com/paper/2409.08806/) (2024)
- [Incorporating Arbitrary Matrix Group Equivariance into KANs](https://mlsanity.com/paper/2410.00435/) (2024)
- [A Temporal Linear Network for Time Series Forecasting](https://mlsanity.com/paper/2410.21448/) (2024)
- [Deep Learning for VWAP Execution in Crypto Markets: Beyond the Volume Curve](https://mlsanity.com/paper/2502.13722/) (2025)
- [HiPPO-KAN: Efficient KAN Model for Time Series Analysis](https://mlsanity.com/paper/2410.14939/) (2024)
- [SigGate: Enhancing Recurrent Neural Networks with Signature-Based Gating Mechanisms](https://mlsanity.com/paper/2502.09318/) (2025)

## Abstract (arXiv)

Capturing complex temporal patterns and relationships within multivariate data streams is a difficult task. We propose the Temporal Kolmogorov-Arnold Transformer (TKAT), a novel attention-based architecture designed to address this task using Temporal Kolmogorov-Arnold Networks (TKANs). Inspired by the Temporal Fusion Transformer (TFT), TKAT emerges as a powerful encoder-decoder model tailored to handle tasks in which the observed part of the features is more important than the a priori known part. This new architecture combined the theoretical foundation of the Kolmogorov-Arnold representation with the power of transformers. TKAT aims to simplify the complex dependencies inherent in time series, making them more "interpretable". The use of transformer architecture in this framework allows us to capture long-range dependencies through self-attention mechanisms.