KAN-MLP-Mixer: A comprehensive investigation of the usage of Kolmogorov-Arnold Networks (KANs) for improving IMU-based Human Activity Recognition
Not on the map. Why?
Abstract (arXiv)
Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional multi-layer perceptrons (MLPs) are far more tolerant to noise and computationally efficient. Replacing all MLP components with KANs in HAR models often degrades accuracy and computation efficiency, highlighting an open challenge: how to combine KANs' precision with MLPs' noise robustness and efficiency. To address this, we systematically explore various placements of KAN modules within deep HAR networks and propose a hybrid architecture that strategically synergizes the strengths of both paradigms, which uses a KAN-based input embedding layer, retains MLP layers for intermediate feature mixing, and introduces a specialized LarctanKAN module for final activity classification. Across eight public HAR datasets, the hybrid KAN-MLP model achieves an average macro F1 score relative improvement of 5.33% compared pure-MLP model, significantly outperforming standalone KAN and MLP baselines. Furthermore, integrating this hybrid strategy into other state-of-the-art HAR architectures consistently boosts their performance. Our findings demonstrate that a carefully orchestrated combination of KAN, MLP, or other conventional neural components yields more robust and accurate HAR models for real-world wearable sensing environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 42 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
13 of 42 references.
References · 13
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2021Pay Attention to MLPscited by 367
- 2020Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunitiescited by 125
- 2024Wav-KAN: Wavelet Kolmogorov-Arnold Networkscited by 118
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 116
- 2024KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physicscited by 58
- 2024A Benchmarking Study of Kolmogorov-Arnold Networks on Tabular Datacited by 25
- 2024Reduced Effectiveness of Kolmogorov-Arnold Networks on Functions with Noisecited by 17
- 2024DropKAN: Regularizing KANs by masking post-activationscited by 14
- 2024Initial Investigation of Kolmogorov-Arnold Networks (KANs) as Feature Extractors for IMU Based Human Activity Recognitioncited by 12
- 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platformscited by 11
- 2021Human Activity Recognition using Wearable Sensors: Review, Challenges, Evaluation Benchmarkcited by 5
Built on by
Not cited yet.