Draining Fictitious Knots: Restoring Distance-Awareness Guarantees for High-Dimensional Spline Networks
Not on the map. Why?
Abstract (arXiv)
Kolmogorov-Arnold Networks (KANs) with spline activations have recently shown promise for interpretable function approximation. Distance-Aware Error for Kolmogorov Networks (DAREK) introduces a computationally efficient bottom-up approach to uncertainty quantification by equipping KANs with distance-aware error bounds; yet, in high-dimensional settings, the theoretical guarantees can be weakened by the emergence of fictitious knots. Inspired by the Kolmogorov-Arnold representation theorem, DAREK adopts a componentwise formulation in which each input dimension is treated separately; as a result, induced knot locations may appear in the combined input space without corresponding to actual training data. These fictitious knots mislead the DAREK uncertainty estimator into reporting low uncertainty far from any real observation, violating the distance-awareness guarantee. We identify this failure mode precisely, characterize its geometric structure, and propose a drainage uncertainty mechanism that restores distance-awareness by constructing a monotonically decreasing uncertainty path from any fictitious knot region toward the nearest real knot. The proposed drainage method provides a practical heuristic correction that mitigates the fictitious-knot failure mode while restoring theoretical distance-awareness in high-dimensional settings. Experiments on a 2D synthetic benchmark and a 100-dimensional face dataset show that drainage raises sampled distance-awareness (SDA) from 85% to 98-99%, matching Gaussian processes at lower computational cost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
10 of 19 references.
References · 10
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2024KAN: Kolmogorov-Arnold Networkscited by 649
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 445
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2020The Kolmogorov-Arnold representation theorem revisitedcited by 89
- 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
- 2024KKANs: Kurkova-Kolmogorov-Arnold Networks and Their Learning Dynamicscited by 13
- 2025Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertaintycited by 2
Built on by
Not cited yet.