mlsanityData to 14 Oct 2026

Quantum Variational Activation Functions Empower Kolmogorov-Arnold Networks

arXiv 2509.14026 ↗First posted 17 Sep 2025quant-ph cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Variational quantum circuits (VQCs) are central to quantum machine learning, while recent progress in Kolmogorov-Arnold networks (KANs) highlights the power of learnable activation functions. We unify these directions by introducing the quantum variational activation function (QVAF), a general framework in which parameterized quantum circuits serve as learnable activation functions; in this work we study an efficient single-qubit instantiation called DatA Re-Uploading ActivatioN (DARUAN). We show that DARUAN with trainable data-preprocessing weights can realize an exponentially growing accessible frequency support with the number of re-uploading repetitions; for an explicit geometric choice of these weights, this gives a capacity-level exponential parameter reduction relative to independently parameterized Fourier activations. Embedding DARUAN into KAN yields the quantum-inspired Kolmogorov-Arnold Network (QKAN), which retains the interpretability of the KAN architecture while improving parameter efficiency, expressivity, and generalization. We further introduce layer extension and the hybrid QKAN (HQKAN) architecture to improve scalability and computational efficiency, enabling QKAN modules to act as compact replacements for multi-layer perceptrons (MLPs) in large-scale models. We provide theoretical analysis and extensive experiments on function regression, image classification, and autoregressive generative language modeling, demonstrating the efficiency and scalability of QKANs. Because the single-qubit circuits are efficiently simulable on classical quantum simulators, QKANs have quantum-inspired advantage in parameter efficiency and training stability; DARUANs and QKANs serve as present-day validation of the QVAF concept, and the trained DARUANs are directly executable and feasible on current noisy intermediate-scale quantum (NISQ) hardware for inference validation.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 36 of its 70 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

36 of 70 references.

References · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  4. 2018Barren plateaus in quantum neural network training landscapescited by 630
  5. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
  6. 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 333
  7. 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
  8. 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 167
  9. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 144
  10. 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 128
  11. 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
  12. 2019Transfer learning in hybrid classical-quantum neural networkscited by 114
24 more
  1. 2017Quantum machine learning: a classical perspectivecited by 95
  2. 2021Quantum machine learning beyond kernel methodscited by 92
  3. 2020A survey on modern trainable activation functionscited by 89
  4. 2021Federated Quantum Machine Learningcited by 82
  5. 2016Quantum-enhanced machine learningcited by 79
  6. 2024KAN or MLP: A Fairer Comparisoncited by 73
  7. 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
  8. 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 70
  9. 2022Exploiting symmetry in variational quantum machine learningcited by 69
  10. 2019Pad'e Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networkscited by 67
  11. 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 64
  12. 2014Learning Activation Functions to Improve Deep Neural Networkscited by 63
  13. 2024Kolmogorov-Arnold Transformercited by 56
  14. 2024BSRBF-KAN: A combination of B-splines and Radial Basis Functions in Kolmogorov-Arnold Networkscited by 46
  15. 2024Exploring the Potential of Polynomial Basis Functions in Kolmogorov-Arnold Networks: A Comparative Study of Different Groups of Polynomialscited by 35
  16. 2024Unveiling the Power of Wavelets: A Wavelet-based Kolmogorov-Arnold Network for Hyperspectral Image Classificationcited by 34
  17. 2024Scaling Law for Language Models Training Considering Batch Sizecited by 22
  18. 2022Power and limitations of single-qubit native quantum neural networkscited by 19
  19. 2024Quantum Implicit Neural Representationscited by 16
  20. 2023Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuitscited by 10
  21. 2023Enabling Non-Linear Quantum Operations through Variational Quantum Splinescited by 3
  22. 2024KANsformer for Scalable Beamformingcited by 3
  23. 2025Introduction to Quantum Machine Learning and Quantum Architecture Searchcited by 3
  24. 2025QuKAN: A Quantum Circuit Born Machine approach to Quantum Kolmogorov Arnold Networkscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 9.

10 papers.