mlsanityData to 14 Oct 2026

Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales

arXiv 2610.17343 ↗First posted 12 Oct 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Conditional conformal test martingales provide sequential tests for detecting distribution shifts, using a fixed reference dataset to avoid contamination from test-time samples. Prior work used a penalized betting function via online optimization with smoothing, clipping, and other hyperparameters, which can adapt slowly when a shift occurs after a long stationary period. In this work, we introduce an approach that requires no hyperparameters and provably adapts quickly to shifts occurring at unknown times. Our key idea is to frame the penalized betting problem as portfolio selection in a three-asset market. Then, we use a restarting universal portfolio, with a heavy-tailed wealth allocation over time. We establish anytime false-alarm control and derive optimal finite-sample bounds on detection delay under detectable alternatives. We also develop an FFT-based implementation that computes the portfolio sequence over T rounds in O(T2ln T) time, instead of O(T3) of the naive implementation. Synthetic and real-world experiments suggest that the proposed approach adapts rapidly after long periods of null samples, with detection delays depending substantially less on shift time than prior baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 51 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

24 of 51 references.

References · 24

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  3. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  4. 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
  5. 2022Game-theoretic statistics and safe anytime-valid inferencecited by 155
  6. 2021Testing for Outliers with Conformal p-valuescited by 134
  7. 2016Coin Betting and Parameter-Free Online Learningcited by 133
  8. 2018Black-Box Reductions for Parameter-free Online Learning in Banach Spacescited by 125
  9. 2015Strongly Adaptive Online Learningcited by 107
  10. 2024Hypothesis testing with e-valuescited by 74
  11. 2021There are natural scores: Full comment on Shafer, "Testing by betting: A strategy for statistical and scientific communication"cited by 53
  12. 2020Admissible anytime-valid sequential inference must rely on nonnegative martingalescited by 48
12 more
  1. 2021Tight Concentrations and Confidence Sequences from the Regret of Universal Portfoliocited by 43
  2. 2021Tracking the risk of a deployed model and detecting harmful distribution shiftscited by 40
  3. 2019Testing randomnesscited by 34
  4. 2021Testing exchangeability: fork-convexity, supermartingales, and e-processescited by 32
  5. 2021Retrain or not retrain: Conformal test martingales for change-point detectioncited by 32
  6. 2022E-detectors: a nonparametric framework for sequential change detectioncited by 32
  7. 2017Inductive Conformal Martingales for Change-Point Detectioncited by 19
  8. 2025WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingalescited by 16
  9. 2017Online Learning for Changing Environments using Coin Bettingcited by 13
  10. 2026Testing For Distribution Shifts with Conditional Conformal Test Martingalescited by 4
  11. 2013Switching Portfolioscited by 3
  12. 2024The power of forgetting in statistical hypothesis testingcited by 2

Built on by

Not cited yet.