Architectural Scaling Surpass Basis Complexity? Efficient KANs with Single-Parameter Design
Not on the map. Why?
Abstract (arXiv)
The landscape of Kolmogorov-Arnold Networks (KANs) is rapidly expanding, yet lacks a unified theoretical framework and a clear principle for efficient architecture design. This paper addresses these gaps with three core contributions. First, we introduce the Universal KAN (Uni-KAN) framework, a novel abstraction that formally unifies all KAN-style networks through dense and sparse representations. We prove their interchangeability and provide an open-source library for this framework, facilitating future research. Second, we propose the Efficient KAN Expansion (EKE) Hypothesis, a design philosophy positing that allocating parameters to architectural scaling rather than basis function complexity yields superior performance. Third, we present Single-Parameter KANs (SKANs), a family of ultra-lightweight networks that embody the EKE Hypothesis. Our comprehensive experiments provide the first strong empirical validation for the theoretical necessity of basis function smoothness for stable training. Furthermore, SKANs demonstrate state-of-the-art performance, improving F1 scores by up to 6.51% and reducing test loss by 93.1%, while achieving up to 6x faster training speeds compared to existing KAN variants. These results establish a robust framework, a guiding hypothesis, and a practical methodology for designing the next generation of efficient and powerful neural networks. The code is accessible at https://anonymous.4open.science/r/SKAN-EBBB/.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
21 of 32 references.
References · 21
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2020Lagrangian Neural Networkscited by 388
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 271
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 176
- 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 125
- 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
- 2024DeepOKAN: Deep Operator Network Based on Kolmogorov Arnold Networks for Mechanics Problemscited by 82
9 more
- 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
- 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 60
- 2024KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physicscited by 58
- 2024Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensingcited by 46
- 2024Finite basis Kolmogorov-Arnold networks: domain decomposition for data-driven and physics-informed problemscited by 35
- 2024Kolmogorov-Arnold Graph Neural Networkscited by 31
- 2024Smooth Kolmogorov Arnold networks enabling structural knowledge representationcited by 22
- 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Modelscited by 20
- 2024Kolmogorov-Arnold PointNet: Deep learning for prediction of fluid fields on irregular geometriescited by 11
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 1.
6 papers.
- 2024A Survey on Kolmogorov-Arnold Networkcited by 67
- 2025MatrixKAN: Parallelized Kolmogorov-Arnold Networkcited by 7
- 2025ChemKANs for Combustion Chemistry Modeling and Accelerationcited by 4
- 2024LArctan-SKAN: Simple and Efficient Single-Parameterized Kolmogorov-Arnold Networks using Learnable Trigonometric Functioncited by 3
- 2025AF-KAN: Activation Function-Based Kolmogorov-Arnold Networks for Efficient Representation Learningcited by 3
- 2026SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bitscited by 0
- 2026SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits1 Aug 2026
- 2025ChemKANs for Combustion Chemistry Modeling and Acceleration17 Apr 2025
- 2025AF-KAN: Activation Function-Based Kolmogorov-Arnold Networks for Efficient Representation Learning8 Mar 2025
- 2025MatrixKAN: Parallelized Kolmogorov-Arnold Network11 Feb 2025
- 2024A Survey on Kolmogorov-Arnold Network9 Nov 2024
- 2024LArctan-SKAN: Simple and Efficient Single-Parameterized Kolmogorov-Arnold Networks using Learnable Trigonometric Function25 Oct 2024