mlsanityData to 7 Oct 2026

Architectural Scaling Surpass Basis Complexity? Efficient KANs with Single-Parameter Design

arXiv 2410.14951 ↗First posted 19 Oct 2024cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

The landscape of Kolmogorov-Arnold Networks (KANs) is rapidly expanding, yet lacks a unified theoretical framework and a clear principle for efficient architecture design. This paper addresses these gaps with three core contributions. First, we introduce the Universal KAN (Uni-KAN) framework, a novel abstraction that formally unifies all KAN-style networks through dense and sparse representations. We prove their interchangeability and provide an open-source library for this framework, facilitating future research. Second, we propose the Efficient KAN Expansion (EKE) Hypothesis, a design philosophy positing that allocating parameters to architectural scaling rather than basis function complexity yields superior performance. Third, we present Single-Parameter KANs (SKANs), a family of ultra-lightweight networks that embody the EKE Hypothesis. Our comprehensive experiments provide the first strong empirical validation for the theoretical necessity of basis function smoothness for stable training. Furthermore, SKANs demonstrate state-of-the-art performance, improving F1 scores by up to 6.51% and reducing test loss by 93.1%, while achieving up to 6x faster training speeds compared to existing KAN variants. These results establish a robust framework, a guiding hypothesis, and a practical methodology for designing the next generation of efficient and powerful neural networks. The code is accessible at https://anonymous.4open.science/r/SKAN-EBBB/.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 19 Oct 2024.

Builds on

21 of 32 references.

References · 21

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  4. 2024KAN: Kolmogorov-Arnold Networkscited by 634
  5. 2020Lagrangian Neural Networkscited by 388
  6. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
  7. 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 271
  8. 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
  9. 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 176
  10. 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 125
  11. 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
  12. 2024DeepOKAN: Deep Operator Network Based on Kolmogorov Arnold Networks for Mechanics Problemscited by 82
9 more
  1. 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
  2. 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 60
  3. 2024KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physicscited by 58
  4. 2024Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensingcited by 46
  5. 2024Finite basis Kolmogorov-Arnold networks: domain decomposition for data-driven and physics-informed problemscited by 35
  6. 2024Kolmogorov-Arnold Graph Neural Networkscited by 31
  7. 2024Smooth Kolmogorov Arnold networks enabling structural knowledge representationcited by 22
  8. 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Modelscited by 20
  9. 2024Kolmogorov-Arnold PointNet: Deep learning for prediction of fluid fields on irregular geometriescited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 1.

6 papers.