mlsanityData to 7 Oct 2026

A Temporal Kolmogorov-Arnold Transformer for Time Series Forecasting

arXiv 2406.02486 ↗First posted 4 Jun 2024cs.LGcited by 50

Not on the map. Why?

Abstract (arXiv)

Capturing complex temporal patterns and relationships within multivariate data streams is a difficult task. We propose the Temporal Kolmogorov-Arnold Transformer (TKAT), a novel attention-based architecture designed to address this task using Temporal Kolmogorov-Arnold Networks (TKANs). Inspired by the Temporal Fusion Transformer (TFT), TKAT emerges as a powerful encoder-decoder model tailored to handle tasks in which the observed part of the features is more important than the a priori known part. This new architecture combined the theoretical foundation of the Kolmogorov-Arnold representation with the power of transformers. TKAT aims to simplify the complex dependencies inherent in time series, making them more "interpretable". The use of transformer architecture in this framework allows us to capture long-range dependencies through self-attention mechanisms.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 4 Jun 2024.

Builds on

21 of 44 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2016Layer Normalizationcited by 5,579
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  6. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  7. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  8. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 699
  9. 2016Language Modeling with Gated Convolutional Networkscited by 688
  10. 2024KAN: Kolmogorov-Arnold Networkscited by 634
  11. 2020Efficient Content-Based Sparse Attention with Routing Transformerscited by 469
  12. 2019The Evolved Transformercited by 180
9 more
  1. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
  2. 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
  3. 2024Wav-KAN: Wavelet Kolmogorov-Arnold Networkscited by 118
  4. 2019Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networkscited by 103
  5. 2024Kolmogorov-Arnold Networks (KANs) for Time Series Analysiscited by 97
  6. 2024TKAN: Temporal Kolmogorov-Arnold Networkscited by 70
  7. 2019TENER: Adapting Transformer Encoder for Named Entity Recognitioncited by 69
  8. 2017Autoregressive Convolutional Neural Networks for Asynchronous Time Seriescited by 31
  9. 2021Mask Attention Networks: Rethinking and Strengthen Transformercited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 26; 2025: 20; 2026: 4.

50 papers.

Sort:

By area:

  1. 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 116
  2. 2024A Survey on Kolmogorov-Arnold Networkcited by 67
  3. 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 60
  4. 2024KAGNNs: Kolmogorov-Arnold Networks meet Graph Learningcited by 48
  5. 2024Adaptive Training of Grid-Dependent Physics-Informed Kolmogorov-Arnold Networkscited by 37
  6. 2024KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Searchcited by 36
  7. 2024On the expressiveness and spectral bias of KANscited by 36
  8. 2024CoxKAN: Kolmogorov-Arnold Networks for Interpretable, High-Performance Survival Analysiscited by 22
  9. 2024FC-KAN: Function Combinations in Kolmogorov-Arnold Networkscited by 18
  10. 2024DropKAN: Regularizing KANs by masking post-activationscited by 14
  11. 2024SigKAN: Signature-Weighted Kolmogorov-Arnold Networks for Time Seriescited by 13
  12. 2024Generalization Bounds and Model Complexity for Kolmogorov-Arnold Networkscited by 11
38 more
  1. 2024Exploring Kolmogorov-Arnold Networks for Interpretable Time Series Classificationcited by 8
  2. 2025QKAN-LSTM: Quantum-inspired Kolmogorov-Arnold Long Short-term Memorycited by 8
  3. 2024Deep State Space Recurrent Neural Networks for Time Series Forecastingcited by 6
  4. 2024Are KANs Effective for Multivariate Time Series Forecasting?cited by 6
  5. 2024A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Expertscited by 6
  6. 2025Free-Knots Kolmogorov-Arnold Network: On the Analysis of Spline Knots and Advancing Stabilitycited by 6
  7. 2024Rethinking the Function of Neurons in KANscited by 5
  8. 2024FourierKAN outperforms MLP on Text Classification Head Fine-tuningcited by 5
  9. 2025Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attentioncited by 5
  10. 2025Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learningcited by 5
  11. 2024KAN we improve on HEP classification tasks? Kolmogorov-Arnold Networks applied to an LHC physics examplecited by 4
  12. 2024TabKANet: Tabular Data Modeling with Kolmogorov-Arnold Network and Transformercited by 4
  13. 2024Incorporating Arbitrary Matrix Group Equivariance into KANscited by 4
  14. 2024A Temporal Linear Network for Time Series Forecastingcited by 4
  15. 2025Deep Learning for VWAP Execution in Crypto Markets: Beyond the Volume Curvecited by 4
  16. 2026LESA: Learnable Stage-Aware Predictors for Diffusion Model Accelerationcited by 4
  17. 2024HiPPO-KAN: Efficient KAN Model for Time Series Analysiscited by 3
  18. 2025SigGate: Enhancing Recurrent Neural Networks with Signature-Based Gating Mechanismscited by 3
  19. 2025AF-KAN: Activation Function-Based Kolmogorov-Arnold Networks for Efficient Representation Learningcited by 3
  20. 2025Physics-informed KAN PointNet: Deep learning for simultaneous solutions to inverse problems in incompressible flow on numerous irregular geometriescited by 3
  21. 2025TFKAN: Time-Frequency KAN for Long-Term Time Series Forecastingcited by 3
  22. 2025Interpretable Clinical Classification with Kolmogorov-Arnold Networkscited by 3
  23. 2024Kolmogorov Arnold Networks in Fraud Detection: Bridging the Gap Between Theory and Practicecited by 2
  24. 2025Recurrent Neural Networks for Dynamic VWAP Execution: Adaptive Trading Strategies with Temporal Kolmogorov-Arnold Networkscited by 2
  25. 2025VWAP Execution with Signature-Enhanced Transformers: A Multi-Asset Learning Approachcited by 1
  26. 2025LEMs: A Primer On Large Execution Modelscited by 1
  27. 2025Uncertainty Quantification for Scientific Machine Learning using Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)cited by 1
  28. 2026Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networkscited by 1
  29. 2026SechKAN: Kolmogorov-Arnold Networks with Hyperbolic Secant Functionscited by 1
  30. 2024On the Convergence of (Stochastic) Gradient Descent for Kolmogorov--Arnold Networkscited by 0
  31. 2024Can KAN Work? Exploring the Potential of Kolmogorov-Arnold Networks in Computer Visioncited by 0
  32. 2025HKAN: Hierarchical Kolmogorov-Arnold Network without Backpropagationcited by 0
  33. 2025STAN: Smooth Transition Autoregressive Networkscited by 0
  34. 2025NukesFormers: Unpaired Hyperspectral Image Generation with Non-Uniform Domain Alignmentcited by 0
  35. 2025Combinations of Fast Activation and Trigonometric Functions in Kolmogorov-Arnold Networkscited by 0
  36. 2025KANFormer for Predicting Fill Probabilities via Survival Analysis in Limit Order Bookscited by 0
  37. 2025Sprecher Networks: A Parameter-Efficient Kolmogorov-Arnold Architecturecited by 0
  38. 2026Evaluating the Effectiveness of SechKAN on 1D Datacited by 0