mlsanityData to 14 Oct 2026

FuncCode: Compressing Kolmogorov--Arnold Networks in Function Space with Hardware-Aware Quantization

arXiv 2609.26067 ↗First posted 4 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Kolmogorov--Arnold Networks (KANs) replace scalar edge weights with learnable univariate functions, increasing flexibility but also parameter memory because each edge stores multiple coefficients, often together with a separate base branch. We introduce FuncCode, a basis-agnostic compression approach that forms shared codebooks from sampled edge responses, codes the basis and base branches independently, and exports the resulting codebooks and per-edge indices in a quantized, bit-packed format. Across spline and polynomial KANs, sampled edge responses exhibit 13--35% lower effective rank than their coefficient representations. Further replicated controls show that function-space clustering alone is statistically tied with coefficient-space clustering; the consistent accuracy gain comes from preserving the distinct sharing structure of the two branches. On a ten-seed MNIST benchmark, FuncCode compresses spline and GRAM KANs by 31.6× and 17.6× with only 0.31 and 0.34 pp accuracy loss. On a 6.1M-edge convolutional KAGN, it achieves 19.9× compression while remaining within 0.54 pp of dense accuracy on CIFAR-10 and 1.89 pp on CIFAR-100. After compression, per-edge indices account for up to 99.4% of stored weight bits, making the representation index-bound. Across nine bit-exact FPGA accelerators, FuncCode reduces SplineKAN post-route weight memory by 3.87× relative to dense INT4, without increasing cycle count or latency. The FuncCode implementation is available at https://github.com/OSU-STARLAB/FuncCode.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

9 of 23 references.

References · 9

  1. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  2. 2019Learned Step Size Quantizationcited by 628
  3. 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
  4. 2015Compressing Neural Networks with the Hashing Trickcited by 150
  5. 2024Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximationcited by 118
  6. 2024KAN or MLP: A Fairer Comparisoncited by 73
  7. 2025KANEL'E: Kolmogorov-Arnold Networks for Efficient LUT-based Evaluationcited by 13
  8. 2026KANtize: Exploring Low-bit Quantization of Kolmogorov-Arnold Networks for Efficient Inferencecited by 4
  9. 2025Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Valuecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits
  2. 2025QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks
  3. 2025A Practitioner's Guide to Kolmogorov-Arnold Networks
  4. 2025GS-KAN: Parameter-Efficient Kolmogorov-Arnold Networks via Sprecher-Type Shared Basis Functions
  5. 2026Kilobyte Models: Neural Networks as a Seed and a Quantized Latent
  6. 2025SHARe-KAN: Post-Training Vector Quantization for Cache-Resident KAN Inference
  7. 2021Compact representations of convolutional neural networks via weight pruning and quantization
  8. 2026ButterflyMoE: Compression-Scalable Ternary Experts via Structured Butterfly Orbits