Quantum Variational Activation Functions Empower Kolmogorov-Arnold Networks
Not on the map. Why?
Abstract (arXiv)
Variational quantum circuits (VQCs) are central to quantum machine learning, while recent progress in Kolmogorov-Arnold networks (KANs) highlights the power of learnable activation functions. We unify these directions by introducing the quantum variational activation function (QVAF), a general framework in which parameterized quantum circuits serve as learnable activation functions; in this work we study an efficient single-qubit instantiation called DatA Re-Uploading ActivatioN (DARUAN). We show that DARUAN with trainable data-preprocessing weights can realize an exponentially growing accessible frequency support with the number of re-uploading repetitions; for an explicit geometric choice of these weights, this gives a capacity-level exponential parameter reduction relative to independently parameterized Fourier activations. Embedding DARUAN into KAN yields the quantum-inspired Kolmogorov-Arnold Network (QKAN), which retains the interpretability of the KAN architecture while improving parameter efficiency, expressivity, and generalization. We further introduce layer extension and the hybrid QKAN (HQKAN) architecture to improve scalability and computational efficiency, enabling QKAN modules to act as compact replacements for multi-layer perceptrons (MLPs) in large-scale models. We provide theoretical analysis and extensive experiments on function regression, image classification, and autoregressive generative language modeling, demonstrating the efficiency and scalability of QKANs. Because the single-qubit circuits are efficiently simulable on classical quantum simulators, QKANs have quantum-inspired advantage in parameter efficiency and training stability; DARUANs and QKANs serve as present-day validation of the QVAF concept, and the trained DARUANs are directly executable and feasible on current noisy intermediate-scale quantum (NISQ) hardware for inference validation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 36 of its 70 references that are in the map. First posted on arXiv 17 Sep 2025.
Builds on
36 of 70 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2018Barren plateaus in quantum neural network training landscapescited by 630
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 333
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
- 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 167
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 144
- 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 128
- 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
- 2019Transfer learning in hybrid classical-quantum neural networkscited by 114
24 more
- 2017Quantum machine learning: a classical perspectivecited by 95
- 2021Quantum machine learning beyond kernel methodscited by 92
- 2020A survey on modern trainable activation functionscited by 89
- 2021Federated Quantum Machine Learningcited by 82
- 2016Quantum-enhanced machine learningcited by 79
- 2024KAN or MLP: A Fairer Comparisoncited by 73
- 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
- 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 70
- 2022Exploiting symmetry in variational quantum machine learningcited by 69
- 2019Pad'e Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networkscited by 67
- 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 64
- 2014Learning Activation Functions to Improve Deep Neural Networkscited by 63
- 2024Kolmogorov-Arnold Transformercited by 56
- 2024BSRBF-KAN: A combination of B-splines and Radial Basis Functions in Kolmogorov-Arnold Networkscited by 46
- 2024Exploring the Potential of Polynomial Basis Functions in Kolmogorov-Arnold Networks: A Comparative Study of Different Groups of Polynomialscited by 35
- 2024Unveiling the Power of Wavelets: A Wavelet-based Kolmogorov-Arnold Network for Hyperspectral Image Classificationcited by 34
- 2024Scaling Law for Language Models Training Considering Batch Sizecited by 22
- 2022Power and limitations of single-qubit native quantum neural networkscited by 19
- 2024Quantum Implicit Neural Representationscited by 16
- 2023Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuitscited by 10
- 2023Enabling Non-Linear Quantum Operations through Variational Quantum Splinescited by 3
- 2024KANsformer for Scalable Beamformingcited by 3
- 2025Introduction to Quantum Machine Learning and Quantum Architecture Searchcited by 3
- 2025QuKAN: A Quantum Circuit Born Machine approach to Quantum Kolmogorov Arnold Networkscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2025QKAN-LSTM: Quantum-inspired Kolmogorov-Arnold Long Short-term Memorycited by 8
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learningcited by 4
- 2026Generative Quantum-inspired Kolmogorov-Arnold Eigensolvercited by 3
- 2026Parameter-Efficient Quantum-Inspired Fast Weight Programmers for Traffic-Matrix Forecastingcited by 3
- 2026Recursive QLSTM with Dynamic Variational Quantum Circuit Adaptationcited by 2
- 2026Self-Modulating Quantum Fast-Weight Programmers for Efficient Adaptive Sequential Learningcited by 2
- 2026Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gatescited by 1
- 2026Quantum Kolmogorov--Arnold representation theorem for continuous unitary-valued mapscited by 0
- 2026Complementary Matrix-Gated QKAN Fast-Weight Programmers for Quantum Dynamics Forecastingcited by 0
- 2026Hybrid Quantum-inspired Kolmogorov-Arnold Networks for Privacy-Aware Federated Biosignal Learningcited by 0
- 2026Hybrid Quantum-inspired Kolmogorov-Arnold Networks for Privacy-Aware Federated Biosignal Learning14 Aug 2026
- 2026Complementary Matrix-Gated QKAN Fast-Weight Programmers for Quantum Dynamics Forecasting30 Jul 2026
- 2026Quantum Kolmogorov--Arnold representation theorem for continuous unitary-valued maps3 Jul 2026
- 2026Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gates2 Jul 2026
- 2026Parameter-Efficient Quantum-Inspired Fast Weight Programmers for Traffic-Matrix Forecasting26 Jun 2026
- 2026Self-Modulating Quantum Fast-Weight Programmers for Efficient Adaptive Sequential Learning22 Jun 2026
- 2026Recursive QLSTM with Dynamic Variational Quantum Circuit Adaptation22 Jun 2026
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning7 May 2026
- 2026Generative Quantum-inspired Kolmogorov-Arnold Eigensolver6 May 2026
- 2025QKAN-LSTM: Quantum-inspired Kolmogorov-Arnold Long Short-term Memory4 Dec 2025