mlsanityData to 14 Oct 2026

Learning under Distributional Drift: Prequential Reproducibility as an Intrinsic Statistical Resource

arXiv 2512.13506 ↗First posted 15 Dec 2025cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Statistical learning under distributional drift remains poorly characterized, especially in closed-loop settings where learning alters the data-generating law. We introduce an intrinsic drift budget CT that quantifies cumulative information-geometric motion of the data distribution along the realized learner-environment trajectory, measured in Fisher-Rao distance. The budget separates exogenous environmental change from policy-sensitive feedback induced by the learner's actions. This gives a rate-based characterization of prequential reproducibility: when performance on the realized stream is used to predict one-step-ahead performance under the next distribution, the drift contribution enters through the average motion rate CT/T, not through cumulative drift alone. We prove a drift-feedback bound of order T-1/2+CT/T, up to controlled second-order remainder terms, and establish a matching sharpness lower bound for the same prequential reproducibility gap on a canonical regular subclass. Thus the dependence on the average Fisher-Rao motion rate is tight up to constants: CT/T is sufficient for upper control and unavoidable on regular hard subclasses. We further prove an information-theoretic indistinguishability result showing that order-C/T effects on the one-step-ahead target need not be identifiable from the realized performance stream alone. Finally, we show that fixed monitoring channels induce contracted observable Fisher motion, and experiments, including a misspecified real-data feedback setting, indicate that appropriately chosen channels can retain risk-relevant drift signal when the intrinsic data-generating law is unavailable. The resulting theory treats exogenous drift, adaptive data analysis, and performative feedback as different sources of Fisher-Rao motion along the same learner-environment trajectory.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 42 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

12 of 42 references.

References · 12

  1. 2020Performative Predictioncited by 327
  2. 2017Information-theoretic analysis of generalization capability of learning algorithmscited by 303
  3. 2017Domain Generalization by Marginal Transfer Learningcited by 180
  4. 2013Non-stationary Stochastic Optimizationcited by 175
  5. 2015Algorithmic Stability for Adaptive Data Analysiscited by 88
  6. 2015Generalization in Adaptive Data Analysis and Holdout Reusecited by 83
  7. 2021How to Learn when Data Reacts to Your Model: Performative Gradient Descentcited by 71
  8. 2021Adaptivity and Non-stationarity: Problem-dependent Dynamic Regret for Online Convex Optimizationcited by 66
  9. 2013Dynamical Models and Tracking Regret in Online Convex Programmingcited by 43
  10. 2018Fisher Information and Natural Gradient Learning of Random Deep Networkscited by 28
  11. 2019Guaranteed Validity for Empirical Approaches to Adaptive Data Analysiscited by 7
  12. 2024Optimal Adaptive Experimental Design for Estimating Treatment Effectcited by 5

Built on by

Not cited yet.