DualFlexKAN: Dual-stage Kolmogorov-Arnold Networks with Independent Function Control
Not on the map. Why?
Abstract (arXiv)
Multi-Layer Perceptrons (MLPs) rely on pre-defined, fixed activation functions, imposing a static inductive bias that forces the network to approximate complex topologies solely through increased depth and width. Kolmogorov-Arnold Networks (KANs) address this limitation through edge-centric learnable functions, yet their formulation suffers from quadratic parameter scaling and architectural rigidity that hinders the effective integration of standard regularization techniques. This paper introduces the DualFlexKAN (DFKAN), a flexible architecture featuring a dual-stage mechanism that independently controls pre-linear input transformations and post-linear output activations. This decoupling enables hybrid networks that optimize the trade-off between expressiveness and computational cost. Unlike standard formulations, DFKAN supports diverse basis function families, including orthogonal polynomials, B-splines, and radial basis functions, integrated with configurable regularization strategies that stabilize training dynamics. Comprehensive evaluations across regression benchmarks, physics-informed tasks, and function approximation demonstrate that DFKAN outperforms both MLPs and conventional KANs in accuracy, convergence speed, and gradient fidelity. The proposed hybrid configurations achieve superior performance with one to two orders of magnitude fewer parameters than standard KANs, effectively mitigating the parameter explosion problem while preserving KAN-style expressiveness. DFKAN provides a principled, scalable framework for incorporating adaptive non-linearities, proving particularly advantageous for data-efficient learning and interpretable function discovery in scientific applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
18 of 41 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2021Revisiting Deep Learning Models for Tabular Datacited by 725
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2021Well-tuned Simple Nets Excel on Tabular Datasetscited by 151
- 2024Wav-KAN: Wavelet Kolmogorov-Arnold Networkscited by 118
- 2024A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networkscited by 103
6 more
- 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 69
- 2024Kolmogorov-Arnold Networks: A Critical Assessment of Claims, Performance, and Practical Viabilitycited by 23
- 2024SineKAN: Kolmogorov-Arnold Networks Using Sinusoidal Activation Functionscited by 15
- 2024PointNet with KAN versus PointNet with MLP for 3D Classification and Segmentation of Point Setscited by 15
- 2024A Comprehensive Benchmark of Machine and Deep Learning Across Diverse Tabular Datasetscited by 13
- 2024Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPscited by 3
Built on by
Not cited yet.