mlsanityData to 14 Oct 2026

Monotonic Kolmogorov-Arnold Networks: A Theoretical and Empirical Study of Monotonicity as an Inductive Bias

arXiv 2606.17886 ↗First posted 16 Jun 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Monotonicity has been a long-running architectural inductive bias for neural networks, motivated by tabular, scientific, and economic settings where outputs are known to respond monotonically to certain inputs. Existing approaches are MLP- or flow-based and lack per-edge functional transparency; the only Kolmogorov--Arnold Network (KAN) variant with monotonicity, MonoKAN, enforces the constraint only on a restricted parameter subset and requires a projection-style training procedure. We close this gap with MKAN, a KAN with hard monotonicity guaranteed for all parameter values via exponential reparameterization of B-spline coefficients, positive edge weights, and a monotone base activation. Training reduces to standard unconstrained gradient descent. Our headline theoretical contribution is a representation-cost theorem: any CK, K >0 feature extractor inducing a ball-shaped semantic-neighborhood partition admits a monotone realization of the equivalent neighborhood structure at N' = N^* + k ≤ 2N^*, where k is the number of non-monotone coordinates of the original. The bound is architecture-agnostic and gives a principled sizing rule for monotone encoders. Empirically, MKAN is competitive with state-of-the-art monotone NNs on the SMM/ICML-2024 benchmark while being the only method that combines hard unconstrained monotonicity with KAN's per-edge functional transparency; the 2N^* prediction is validated in a self-supervised feature-size sweep on four real datasets, and on a controlled monotone-generative dataset MKAN recovers ground-truth factors with substantially higher Spearman alignment than KAN, MLP, and linear baselines.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

25 of 39 references.

References · 25

  1. 2024KAN: Kolmogorov-Arnold Networkscited by 649
  2. 2018Gradient Descent Finds Global Minima of Deep Neural Networkscited by 574
  3. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 367
  4. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
  5. 2018Neural Autoregressive Flowscited by 208
  6. 2018A Convergence Analysis of Gradient Descent for Deep Linear Neural Networkscited by 184
  7. 2019Unconstrained Monotonic Neural Networkscited by 92
  8. 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 92
  9. 2024A Survey on Kolmogorov-Arnold Networkcited by 68
  10. 2017Deep Lattice Networks and Partial Monotonic Functionscited by 63
  11. 2019Block Neural Autoregressive Flowcited by 62
  12. 2020Certified Monotonic Neural Networkscited by 51
13 more
  1. 2015Monotonic Calibrated Interpolated Look-Up Tablescited by 35
  2. 2022Constrained Monotonic Neural Networkscited by 32
  3. 2022Convergence of gradient descent for deep neural networkscited by 24
  4. 2018Monotonic classification: an overview on algorithms, performance measures and data setscited by 18
  5. 2020Deontological Ethics By Monotonicity Shape Constraintscited by 16
  6. 2023Principled Weight Initialisation for Input-Convex Neural Networkscited by 12
  7. 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networkscited by 9
  8. 2025Advancing Constrained Monotonic Neural Networks: Achieving Universal Approximation Beyond Bounded Activationscited by 8
  9. 2020Semantic Neighborhood-Aware Deep Facial Expression Recognitioncited by 5
  10. 2023Smooth Min-Max Monotonic Networkscited by 5
  11. 2019Avoiding Resentment Via Monotonic Fairnesscited by 4
  12. 2024MonoKAN: Certified Monotonic Kolmogorov-Arnold Networkcited by 4
  13. 2023Monotone Cubic B-Splines with a Neural-Network Generatorcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.