mlsanityData to 14 Oct 2026

Stability-Constrained Approximation in Spline KANs: Exact Layer Balancing and Budget-Compatible Saturation

arXiv 2609.17619 ↗First posted 14 Sep 2026stat.ML cs.LG cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep spline superposition networks face a tension between approximation order and stability across depth. We study approximation under a hard layerwise Lipschitz budget, and organise it around two quantities: the factorisation stability complexity of a given deep factorisation, and the budget-compatible approximation complexity of a discretisation operator. First, we solve exactly the finite-depth diagonal balancing problem for a fixed chain of nonnegative envelope matrices: the optimal uniform layer budget equals |ML-1cdots M0|∞→∞1/L, attained by an explicit one-pass minimiser, for rectangular layers, with a complete treatment of degeneracies and non-attainment. The optimum can be arbitrarily larger than the Lipschitz constant of the network itself, because passing to envelopes destroys sign cancellation. Second, we give a constructive spline discretisation theorem preserving the budget up to a controlled slack, with an explicit grid threshold. Conversely, for linear spline-valued operators that preserve the budget exactly, we prove budget-compatible minimax lower bounds on classes constrained simultaneously in the first and third derivative norms -- a constraint pair that is forced by the problem and that rules out the usual scaling escapes. Finally, we show that the corresponding layer errors need not cancel under composition: for every operator of the class there is a stable depth-L tower realising a constant fraction of the accumulated error, so the linear-in-depth accumulation of the upper bound is not a proof artefact.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

7 of 27 references.

References · 7

  1. 2016Benefits of depth in neural networkscited by 250
  2. 2015Path-SGD: Path-Normalized Optimization in Deep Neural Networkscited by 120
  3. 2019Equi-normalization of Neural Networkscited by 16
  4. 2024Generalization Bounds and Model Complexity for Kolmogorov-Arnold Networkscited by 11
  5. 2018The Perron-Frobenius theorem for multi-homogeneous mappingscited by 2
  6. 2017The Collatz-Wielandt quotient for pairs of nonnegative operatorscited by 1
  7. 2026Layer-wise Lipschitz-Product Control for Deep Kolmogorov--Arnold Network Representations of Compositionally Structured Functionscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Approximation Rates in Besov Norms and Sample-Complexity of Kolmogorov-Arnold Networks with Residual Connections
  2. 2026Sharp Stability Threshold and Certification for Designing Stable Residual Architectures
  3. 2021Polynomial-Spline Neural Networks with Exact Integrals
  4. 2026Compositional Approximation Can Strictly Outperform Superpositional Approximation
  5. 2025GS-KAN: Parameter-Efficient Kolmogorov-Arnold Networks via Sprecher-Type Shared Basis Functions
  6. 2024On the Complexity of Neural Computation in Superposition
  7. 2024Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices
  8. 2026Arbitrary-Accuracy Neural Approximation with Optimal Neuron Count and Near-Optimal Bit Complexity