mlsanityData to 7 Oct 2026

Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption

arXiv 2606.18778 ↗First posted 17 Jun 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Online learning in non-stationary streams is often formulated as tracking a point estimate, but many applications require predicting the full data-generating distribution. We study online distributional prediction under drift and adversarial corruption. Our approach represents each candidate law through a latent cluster geometry: a variable-size configuration of centers that organizes probability mass and induces a predictive distribution. A Gibbs quasi-posterior over these configurations yields an online predictor by posterior averaging, and the resulting variable-dimensional posterior can be sampled with reversible-jump MCMC. The method therefore avoids specifying a parametric streaming law while retaining a structured latent space for uncertainty, regularization, and comparison. We evaluate performance by cumulative Wasserstein-1 regret against the time-varying true law. The analysis separates two effects: corruption perturbs the loss-based posterior update, whereas drift makes long-horizon posterior memory stale. We address the latter with a restarted variant that temporally localizes the same quasi-Bayesian update. The resulting high-probability bounds decompose into a PAC-Bayesian complexity term, a corruption-sensitive posterior perturbation term, and a dynamic optimal-transport term driven by (ATOT=sumt=2T W22(pt-1^*,pt^*)). Under bounded support, stable latent geometry, predictive-map regularity, oracle realizability, localized restart windows, sublinear transport action, and sublinear corruption budget, the restarted predictor achieves sublinear cumulative Wasserstein regret. These guarantees require no parametric model for the stream, drift mechanism, or corruption process.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

10 of 25 references.

References · 10

  1. 2013Non-stationary Stochastic Optimizationcited by 173
  2. 2019Time-Series Anomaly Detection Service at Microsoftcited by 163
  3. 2018Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detectioncited by 121
  4. 2020Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clippingcited by 104
  5. 2021Optimal Dynamic Regret in Exp-Concave Online Learningcited by 39
  6. 2019Algorithms of Robust Stochastic Optimization Based on Mirror Descent Methodcited by 32
  7. 2022Mirror Descent Strikes Again: Optimal Stochastic Convex Optimization under Infinite Noise Variancecited by 22
  8. 2023Stochastic Nonsmooth Convex Optimization with Heavy-Tailed Noises: High-Probability Bound, In-Expectation Rate and Initial Distance Adaptationcited by 20
  9. 2021Heavy-tailed Streaming Statistical Estimationcited by 10
  10. 2021Robust Online Convex Optimization in the Presence of Outlierscited by 4

Built on by

Not cited yet.