Complementary Matrix-Gated QKAN Fast-Weight Programmers for Quantum Dynamics Forecasting
Not on the map. Why?
Abstract (arXiv)
Sequence models must decide what to write into memory and what to retain. In quantum and quantum-inspired sequence learning, nonlinear recurrent updates often require repeated circuit evaluations and sequential backpropagation through time, making long contexts costly. Gated fast-weight programmers (FWPs) based on quantum-inspired Kolmogorov-Arnold networks (QKANs) alleviate this bottleneck by storing context in time-varying fast parameters. However, their scalar gate applies one retention-write balance to every fast-state coordinate, forcing all parameters to share a memory timescale. We introduce Self-Modulating QKAN-based FWPs, which replace this broadcast gate with low-rank-generated element-wise modulation of the new-proposal branch, a bounded old-state branch, or both. We further propose Complementary Matrix Gating (CMG), which uses one sigmoid matrix gate to retain the old state and its complement to write the new proposal. CMG provides coordinate-wise memory control while preserving the bounded convex update and affine prefix-scan structure of scalar gating, at the modulation-head cost of a single-branch rule. We compare four self-modulating rules with scalar gating across four FWP architectures combining classical and QKAN-based slow and fast programmers. Across seven single-step forecasting benchmarks and five sequence lengths, CMG gives the most consistent improvements for architectures whose fast programmer incorporates a QKAN-based module. In direct multi-step forecasting of Jaynes-Cummings and transmon-resonator dynamics simulated with CUDA-Q Dynamics, CMG models maintain mean-squared errors on the order of 0.001 or lower across forecasting horizons of 4, 8, and 16 steps, while improving on their scalar-gated counterparts by at least 91.2%. These results establish coordinate-wise complementary modulation as a stable and effective update for QKAN-based FWPs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
27 of 41 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2024KAN: Kolmogorov-Arnold Networkscited by 649
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2020Quantum Long Short-Term Memorycited by 120
- 2020Recurrent Quantum Neural Networkscited by 80
- 2021The Shape of Learning Curves: a Reviewcited by 70
- 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 70
- 2017Simple Recurrent Units for Highly Parallelizable Recurrencecited by 61
15 more
- 2015Gated Feedback Recurrent Neural Networkscited by 54
- 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecastingcited by 30
- 2023Quantum Recurrent Neural Networks for Sequential Learningcited by 25
- 2024Learning to Program Variational Quantum Circuits with Fast Weightscited by 24
- 2025A Practitioner's Guide to Kolmogorov-Arnold Networkscited by 18
- 2019EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networkscited by 11
- 2025Quantum Variational Activation Functions Empower Kolmogorov-Arnold Networkscited by 10
- 2025QKAN-LSTM: Quantum-inspired Kolmogorov-Arnold Long Short-term Memorycited by 8
- 2024Are KANs Effective for Multivariate Time Series Forecasting?cited by 6
- 2026CuTe Layout Representation and Algebracited by 6
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learningcited by 4
- 2026Generative Quantum-inspired Kolmogorov-Arnold Eigensolvercited by 3
- 2026Parameter-Efficient Quantum-Inspired Fast Weight Programmers for Traffic-Matrix Forecastingcited by 3
- 2026Self-Modulating Quantum Fast-Weight Programmers for Efficient Adaptive Sequential Learningcited by 2
- 2026Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gatescited by 1
Built on by
Not cited yet.