mlsanityData to 14 Oct 2026

Lookup multivariate Kolmogorov-Arnold Networks

arXiv 2509.07103 ↗First posted 8 Sep 2025cs.LG cs.AI cs.PFcited by 1

Not on the map. Why?

Abstract (arXiv)

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold Networks (lmKANs), which deliver a substantially better trade-off between capacity and inference cost. Our construction expresses a general high-dimensional mapping through trainable low-dimensional multivariate functions. These functions can carry dozens or hundreds of trainable parameters each, and yet it takes only a few multiplications to compute them because they are implemented as spline lookup tables. Empirically, lmKANs reduce inference FLOPs by up to 6.0x while matching the flexibility of MLPs in general high-dimensional function approximation. In another feedforward fully connected benchmark, on the tabular-like dataset of randomly displaced methane configurations, lmKANs enable more than 10x higher H100 throughput at equal accuracy. Within frameworks of Convolutional Neural Networks, lmKAN-based CNNs cut inference FLOPs at matched accuracy by 1.6-2.1x and by 1.7x on the CIFAR-10 and ImageNet-1k datasets, respectively. Our code, including dedicated CUDA kernels, is available online at https://github.com/schwallergroup/lmkan.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 72 references that are in the map. First posted on arXiv 8 Sep 2025.

Builds on

29 of 72 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  7. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  8. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  9. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  10. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  11. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  12. 2020Rethinking Attention with Performerscited by 1,601
17 more
  1. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  2. 2021Scaling Vision Transformerscited by 999
  3. 2024KAN: Kolmogorov-Arnold Networkscited by 649
  4. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
  5. 2015Conditional Computation in Neural Networks for faster modelscited by 167
  6. 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
  7. 2024Kolmogorov-Arnold Networks are Radial Basis Function Networkscited by 128
  8. 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
  9. 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
  10. 2024Convolutional Kolmogorov-Arnold Networkscited by 77
  11. 2024KAN or MLP: A Fairer Comparisoncited by 73
  12. 2024A Survey on Kolmogorov-Arnold Networkcited by 68
  13. 2024Kolmogorov-Arnold Transformercited by 56
  14. 2023Smooth, exact rotational symmetrization for deep learning on point cloudscited by 39
  15. 2024KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Searchcited by 37
  16. 2024PointNet with KAN versus PointNet with MLP for 3D Classification and Segmentation of Point Setscited by 15
  17. 2024Hardware Acceleration of Kolmogorov-Arnold Network (KAN) for Lightweight Edge Inferencecited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.