FuncCode: Compressing Kolmogorov--Arnold Networks in Function Space with Hardware-Aware Quantization
Not on the map. Why?
Abstract (arXiv)
Kolmogorov--Arnold Networks (KANs) replace scalar edge weights with learnable univariate functions, increasing flexibility but also parameter memory because each edge stores multiple coefficients, often together with a separate base branch. We introduce FuncCode, a basis-agnostic compression approach that forms shared codebooks from sampled edge responses, codes the basis and base branches independently, and exports the resulting codebooks and per-edge indices in a quantized, bit-packed format. Across spline and polynomial KANs, sampled edge responses exhibit 13--35% lower effective rank than their coefficient representations. Further replicated controls show that function-space clustering alone is statistically tied with coefficient-space clustering; the consistent accuracy gain comes from preserving the distinct sharing structure of the two branches. On a ten-seed MNIST benchmark, FuncCode compresses spline and GRAM KANs by 31.6× and 17.6× with only 0.31 and 0.34 pp accuracy loss. On a 6.1M-edge convolutional KAGN, it achieves 19.9× compression while remaining within 0.54 pp of dense accuracy on CIFAR-10 and 1.89 pp on CIFAR-100. After compression, per-edge indices account for up to 99.4% of stored weight bits, making the representation index-bound. Across nine bit-exact FPGA accelerators, FuncCode reduces SplineKAN post-route weight memory by 3.87× relative to dense INT4, without increasing cycle count or latency. The FuncCode implementation is available at https://github.com/OSU-STARLAB/FuncCode.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
9 of 23 references.
References · 9
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2019Learned Step Size Quantizationcited by 628
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
- 2015Compressing Neural Networks with the Hashing Trickcited by 150
- 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
- 2024KAN or MLP: A Fairer Comparisoncited by 73
- 2025KANEL'E: Kolmogorov-Arnold Networks for Efficient LUT-based Evaluationcited by 13
- 2026KANtize: Exploring Low-bit Quantization of Kolmogorov-Arnold Networks for Efficient Inferencecited by 4
- 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Valuecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits
- 2025QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks
- 2025A Practitioner's Guide to Kolmogorov-Arnold Networks
- 2025GS-KAN: Parameter-Efficient Kolmogorov-Arnold Networks via Sprecher-Type Shared Basis Functions
- 2026Kilobyte Models: Neural Networks as a Seed and a Quantized Latent
- 2025SHARe-KAN: Post-Training Vector Quantization for Cache-Resident KAN Inference
- 2021Compact representations of convolutional neural networks via weight pruning and quantization
- 2026ButterflyMoE: Compression-Scalable Ternary Experts via Structured Butterfly Orbits