mlsanityData to 14 Oct 2026

The Price of Self-Calibration: Exact Evidence Budgets and Manufactured Blind Sets in Adaptive Monitoring

arXiv 2609.23254 ↗First posted 19 Sep 2026cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-calibrating monitors adapt their threshold online to guarantee a prescribed long-run false-alarm rate under arbitrary drift. We compute the price of that guarantee, stating every law with its exact domain of validity. First, the guarantee is an accounting identity, insensitive to what the monitor is meant to detect. Two evidence identities make the cost exact for the online quantile tracker: a persistent step of height δ yields excess alarm mass within one alarm of δ/η, and exactly δ/η pathwise when δ is a lattice multiple of the gain η; a ramp of slope c yields a stationary excess rate of exactly c/η, independent of accumulated size, up to a boundary c=η(1-α) coinciding with the alarm-rate cap. Second, the certificate's own fluctuation obeys an exact law: the windowed alarm rate has standard deviation of order 1/L, not the binomial 1/√L, since the windowed mass telescopes to a difference of a tight internal state; the closed-form constant is validated with no fitted parameter. Detectors calibrated on the binomial scale are miscalibrated by √ηvarphi(q0)L, and correct calibration turns detection windows from quadratic to linear in the inverse fault speed. Third, any monitor required to tolerate a drift class D is blind, at any horizon and for any rule, to every fault in D-D; the proof is a deliberately elementary two-point argument and the contribution is the object it identifies: for speed-bounded classes the blind set is exactly the doubled-speed class, and the tracker absorbs a speed class fixed by its own gain, so that under a certification regime declaring absorbed drift normal, the monitor manufactures D. An exact Gaussian projection bound, sharper than Pinsker and never vacuous, quantifies power outside it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

7 of 26 references.

References · 7

  1. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  2. 2022Game-theoretic statistics and safe anytime-valid inferencecited by 155
  3. 2023Conformal PID Control for Time Series Predictioncited by 88
  4. 2026Testing For Distribution Shifts with Conditional Conformal Test Martingalescited by 4
  5. 2026Between Resolution Collapse and Variance Inflation: Weighted Conformal Anomaly Detection in Low-Data Regimescited by 4
  6. 2026The Boiling Frog Threshold: Criticality and Blindness in World Model-Based Anomaly Detection Under Gradual Driftcited by 1
  7. 2026Data-Driven Probabilistic Fault Detection and Identification via Density Flow Matchingcited by 1

Built on by

Not cited yet.