mlsanityData to 7 Oct 2026

Tight Concentrations and Confidence Sequences from the Regret of Universal Portfolio

arXiv 2110.14099 ↗First posted 27 Oct 2021stat.ML cs.IT cs.LGcited by 42

Not on the map. Why?

Abstract (arXiv)

A classic problem in statistics is the estimation of the expectation of random variables from samples. This gives rise to the tightly connected problems of deriving concentration inequalities and confidence sequences, that is confidence intervals that hold uniformly over time. Previous work has shown how to easily convert the regret guarantee of an online betting algorithm into a time-uniform concentration inequality. In this paper, we show that we can go even further: We show that the regret of universal portfolio algorithms give rise to new implicit time-uniform concentrations and state-of-the-art empirically calculated confidence sequences. In particular, our numerically obtained confidence sequences can never be vacuous, even with a single sample, and satisfy the law of iterated logarithm.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 15 of its 88 references that are in the map. First posted on arXiv 27 Oct 2021.

Builds on

15 of 88 references.

References · 15

  1. 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 407
  2. 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
  3. 2020Estimating means of bounded random variables by bettingcited by 164
  4. 2016Coin Betting and Parameter-Free Online Learningcited by 131
  5. 2018Black-Box Reductions for Parameter-free Online Learning in Banach Spacescited by 124
  6. 2019Safe Testingcited by 98
  7. 2020Lipschitz and Comparator-Norm Adaptivity in Online Learningcited by 57
  8. 2021There are natural scores: Full comment on Shafer, "Testing by betting: A strategy for statistical and scientific communication"cited by 49
  9. 2014Unconstrained Online Linear Learning in Hilbert Spaces: Minimax Algorithms and Normal Approximationscited by 46
  10. 2017Online Learning Without Prior Informationcited by 36
  11. 2019PAC-Bayes Un-Expected Bernstein Inequalitycited by 36
  12. 2019Parameter-Free Online Convex Optimization with Sub-Exponential Noisecited by 28
3 more
  1. 2015On Equivalence of Martingale Tail Bounds and Deterministic Regret Inequalitiescited by 27
  2. 2021Off-policy Confidence Sequencescited by 15
  3. 2018Test Martingales for bounded random variablescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 6; 2024: 12; 2025: 11; 2026: 11.

42 papers.

Sort:

  1. 2024Mitigating LLM Hallucinations via Conformal Abstentioncited by 56
  2. 2024Active Statistical Inferencecited by 46
  3. 2022Parameter-free Regret in High Probability with Heavy Tailscited by 26
  4. 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
  5. 2025E-Values Expand the Scope of Conformal Predictioncited by 23
  6. 2023Online-to-PAC Conversions: Generalization Bounds via Regret Analysiscited by 14
  7. 2023Tighter PAC-Bayes Bounds Through Coin-Bettingcited by 13
  8. 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Bettingcited by 11
  9. 2023Likelihood Ratio Confidence Sets for Sequential Decision Makingcited by 10
  10. 2024Fully Unconstrained Online Learningcited by 10
  11. 2023Reducing sequential change detection to sequential estimationcited by 9
  12. 2023On the near-optimality of betting confidence sets for bounded meanscited by 9
30 more
  1. 2025Confidence Sequences for Generalized Linear Models via Regret Analysiscited by 9
  2. 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guaranteescited by 9
  3. 2024Treatment of Statistical Estimation Problems in Randomized Smoothing for Adversarial Robustnesscited by 8
  4. 2025Probably Approximately Correct Labelscited by 7
  5. 2022Nonparametric extensions of randomized response for private confidence setscited by 6
  6. 2024Noise-Adaptive Confidence Sets for Linear Bandits and Application to Bayesian Optimizationcited by 6
  7. 2025On Stopping Times of Power-one Sequential Tests: Tight Lower and Upper Boundscited by 5
  8. 2024Better-than-KL PAC-Bayes Boundscited by 4
  9. 2025Optimistic Interior Point Methods for Sequential Hypothesis Testing by Bettingcited by 4
  10. 2024Generalization Bounds via Conditional f-Informationcited by 3
  11. 2025Improved Offline Contextual Bandits with Second-Order Bounds: Betting and Freezingcited by 3
  12. 2024Online-to-PAC generalization bounds under graph-mixing dependenciescited by 2
  13. 2024Sharp Matrix Empirical Bernstein Inequalitiescited by 2
  14. 2025Eventually LIL Regret: Almost Sure lnln T Regret for a sub-Gaussian Mixture on Unbounded Datacited by 2
  15. 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learningcited by 1
  16. 2025STaR-Bets: Sequential Target-Recalculating Bets for Tighter Confidence Intervalscited by 1
  17. 2025Differentially Private E-Valuescited by 1
  18. 2026Global Sequential Testing for Multi-Stream Auditingcited by 1
  19. 2026Multi-Armed Sequential Hypothesis Testing by Bettingcited by 1
  20. 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regressioncited by 1
  21. 2026Bandit Convex Optimization with Gradient Prediction Adaptivitycited by 1
  22. 2024Variational Bayes Portfolio Constructioncited by 0
  23. 2025Second-Order Bounds for [0,1]-Valued Regression via Betting Losscited by 0
  24. 2026Operationalizing Stein's Method for Online Linear Optimization: CLT-Based Optimal Tradeoffscited by 0
  25. 2026Learning to Bet for Horizon-Aware Anytime-Valid Testingcited by 0
  26. 2026Cover meets Robbins while Betting on Bounded Data: ln n Regret and Almost Sure lnln n Regretcited by 0
  27. 2026Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Meanscited by 0
  28. 2026From Betting to Empirical Bernstein LILcited by 0
  29. 2026Correcting Split Selection in Online Decision Trees via Anytime-Valid Inferencecited by 0
  30. 2026Always-On Experimentationcited by 0