PolyKAN: A Polyhedral Analysis Framework for Provable and Approximately Optimal KAN Compression
Not on the map. Why?
Abstract (arXiv)
Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multi-Layer Perceptrons (MLPs), offering enhanced interpretability and a solid mathematical foundation. However, their parameter efficiency remains a significant challenge for practical deployment. This paper introduces PolyKAN, a novel theoretical framework for KAN compression that provides formal guarantees on both model size reduction and approximation error. By leveraging the inherent piecewise polynomial structure of KANs, we formulate the compression problem as a polyhedral region merging task. We establish a rigorous polyhedral characterization of KANs, develop a complete theory of ε-equivalent compression, and design a dynamic programming algorithm that achieves approximately optimal compression under specified error bounds. Our theoretical analysis demonstrates that PolyKAN achieves provably near-optimal compression while maintaining strict error control, with guaranteed global optimality for univariate spline functions. This framework provides the first formal foundation for KAN compression with mathematical guarantees, opening new directions for the efficient deployment of interpretable neural architectures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 13 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
11 of 13 references.
References · 11
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2014On the Number of Linear Regions of Deep Neural Networkscited by 378
- 2018Stronger generalization bounds for deep nets via a compression approachcited by 306
- 2017Bounding and Counting Linear Regions of Deep Neural Networkscited by 161
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
- 2024ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLUcited by 32
- 2025Relating Piecewise Linear Kolmogorov Arnold Networks to ReLU Networkscited by 2
Built on by
Not cited yet.