mlsanityData to 14 Oct 2026

How fine a change can moments see? A scale law for detecting distribution shift, with a kernel calibration rule

arXiv 2608.01268 ↗First posted 2 Aug 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Detecting that a stream of high-dimensional embeddings has changed is usually framed as a choice of statistic. We give a scale law that constrains any moment-based choice and test it against topological alternatives. The law: certifying a feature of spatial scale eps carrying mass fraction f requires polynomial tests of degree N* >= log(1/f)/(2 eps), proved via the Chebyshev extremal problem; a Gauss-quadrature construction gives N* >= 4b-1 for a b-scale topology, so cost is set by feature fineness, not feature count. The law is one-sided: we exhibit an annulus whose mean, covariance and all fourth-order moments equal those of a filled disk, yet H_1 is nonzero. Its practical content is a calibration rule. The upper bound is attained by Gaussian test functions, the RKHS witness of an RBF kernel, so the law predicts which bandwidth an MMD test should use: the feature scale. On real embedding streams we measure sigma*/eps with median 1.12 (IQR 1.01-1.52, n=26) over three settings and three scales, and a data-driven bandwidth reaches AUC >= 0.95. Against an adversary optimised against the defender's statistics (mean, covariance, k-NN, kurtosis), only a bandwidth-matched kernel test still detects. For persistent homology the verdict is mixed and depends on choices usually left implicit. The summary matters more than the filtration: total persistence attains recall 0.75 at FPR 1% where the first persistence landscape attains 0.00. What survives is a cost gap, not a power gap: where persistence works it costs 116x kurtosis, which works at least as well. We conclude not that topological summaries are useless, but that on this task a kernel test whose bandwidth the law sets dominates them.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

9 of 21 references.

References · 9

  1. 2018Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionalitycited by 282
  2. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  3. 2018Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shiftcited by 243
  4. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
  5. 2020Learning Deep Kernels for Non-Parametric Two-Sample Testscited by 130
  6. 2020Topology of deep neural networkscited by 112
  7. 2018DTM-based Filtrationscited by 16
  8. 2017Adversary Detection in Neural Networks via Persistent Homologycited by 12
  9. 2023Topological Data Analysis for Neural Network Analysis: A Comprehensive Surveycited by 9

Built on by

Not cited yet.