Temporal Functional Circuits: From Spline Plots to Faithful Explanations in KAN Forecasting
Not on the map. Why?
Abstract (arXiv)
Unlike MLPs, Kolmogorov-Arnold Networks (KANs) expose explicit learnable edge functions on every connection, enabling mechanistic explanation in time-series forecasting. This paper introduces Temporal Functional Circuits, a framework that transforms KAN edge functions from latent visualizations into faithful, temporally grounded explanations. Built on a gated residual KAN that decomposes forecasts into a linear base and a sparsely activated KAN correction, the framework (i) maps each edge to input lags via output-aware attribution, (ii) ranks edges by learned activation range, and (iii) validates faithfulness through edge-level interventions including zeroing and spline removal. Removing the learned B-spline component while retaining the base SiLU term degrades forecasts, providing evidence that the spline shape itself carries predictive value beyond the base activation. On four synthetic regimes of increasing complexity, the learned gate opens progressively wider as signal complexity grows. On regime-switching signals, gated KAN achieves 59% lower MSE than linear-only models. Across eight benchmarks, the gated architecture is competitive with linear, attention, and MLP alternatives, while providing interpretable edge functions that MLP-based corrections cannot offer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
27 of 41 references.
References · 27
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2019Attention is not Explanationcited by 916
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
15 more
- 2019Attention is not not Explanationcited by 629
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
- 2021Causal Abstractions of Neural Networkscited by 401
- 2020Benchmarking Deep Learning Interpretability in Time Series Predictionscited by 102
- 2024Kolmogorov-Arnold Networks (KANs) for Time Series Analysiscited by 97
- 2021Explaining Time Series Predictions with Dynamic Maskscited by 72
- 2023Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistencycited by 42
- 2023Mixture-of-Linear-Experts for Long-term Time Series Forecastingcited by 29
- 2021Temporal Dependencies in Feature Importance for Time Series Predictionscited by 27
- 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecastingcited by 27
- 2024A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Expertscited by 6
- 2025CausalKANs: interpretable treatment effect estimation with Kolmogorov-Arnold networkscited by 2
- 2025QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networkscited by 2
- 2026Time series forecasting with Hahn Kolmogorov-Arnold networkscited by 1
- 2026DecompKAN: Decomposed Patch-KAN for Long-Term Time Series Forecastingcited by 1
Built on by
Not cited yet.