Lookup multivariate Kolmogorov-Arnold Networks
Not on the map. Why?
Abstract (arXiv)
High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold Networks (lmKANs), which deliver a substantially better trade-off between capacity and inference cost. Our construction expresses a general high-dimensional mapping through trainable low-dimensional multivariate functions. These functions can carry dozens or hundreds of trainable parameters each, and yet it takes only a few multiplications to compute them because they are implemented as spline lookup tables. Empirically, lmKANs reduce inference FLOPs by up to 6.0x while matching the flexibility of MLPs in general high-dimensional function approximation. In another feedforward fully connected benchmark, on the tabular-like dataset of randomly displaced methane configurations, lmKANs enable more than 10x higher H100 throughput at equal accuracy. Within frameworks of Convolutional Neural Networks, lmKAN-based CNNs cut inference FLOPs at matched accuracy by 1.6-2.1x and by 1.7x on the CIFAR-10 and ImageNet-1k datasets, respectively. Our code, including dedicated CUDA kernels, is available online at https://github.com/schwallergroup/lmkan.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 72 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
29 of 72 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2020Rethinking Attention with Performerscited by 1,601
17 more
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2021Scaling Vision Transformerscited by 999
- 2024KAN: Kolmogorov-Arnold Networkscited by 649
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2015Conditional Computation in Neural Networks for faster modelscited by 167
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 128
- 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
- 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
- 2024Convolutional Kolmogorov-Arnold Networkscited by 77
- 2024KAN or MLP: A Fairer Comparisoncited by 73
- 2024A Survey on Kolmogorov-Arnold Networkcited by 68
- 2024Kolmogorov-Arnold Transformercited by 56
- 2023Smooth, exact rotational symmetrization for deep learning on point cloudscited by 39
- 2024KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Searchcited by 37
- 2024PointNet with KAN versus PointNet with MLP for 3D Classification and Segmentation of Point Setscited by 15
- 2024Hardware Acceleration of Kolmogorov-Arnold Network (KAN) for Lightweight Edge Inferencecited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026InKAN: B-Spline KANs via Truncated Power Formcited by 2
- 2026InKAN: B-Spline KANs via Truncated Power Form2 Sep 2026