Tight Concentrations and Confidence Sequences from the Regret of Universal Portfolio
Not on the map. Why?
Abstract (arXiv)
A classic problem in statistics is the estimation of the expectation of random variables from samples. This gives rise to the tightly connected problems of deriving concentration inequalities and confidence sequences, that is confidence intervals that hold uniformly over time. Previous work has shown how to easily convert the regret guarantee of an online betting algorithm into a time-uniform concentration inequality. In this paper, we show that we can go even further: We show that the regret of universal portfolio algorithms give rise to new implicit time-uniform concentrations and state-of-the-art empirically calculated confidence sequences. In particular, our numerically obtained confidence sequences can never be vacuous, even with a single sample, and satisfy the law of iterated logarithm.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 15 of its 88 references that are in the map. First posted on arXiv 27 Oct 2021.
Builds on
15 of 88 references.
References · 15
- 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 407
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
- 2020Estimating means of bounded random variables by bettingcited by 164
- 2016Coin Betting and Parameter-Free Online Learningcited by 131
- 2018Black-Box Reductions for Parameter-free Online Learning in Banach Spacescited by 124
- 2019Safe Testingcited by 98
- 2020Lipschitz and Comparator-Norm Adaptivity in Online Learningcited by 57
- 2021There are natural scores: Full comment on Shafer, "Testing by betting: A strategy for statistical and scientific communication"cited by 49
- 2014Unconstrained Online Linear Learning in Hilbert Spaces: Minimax Algorithms and Normal Approximationscited by 46
- 2017Online Learning Without Prior Informationcited by 36
- 2019PAC-Bayes Un-Expected Bernstein Inequalitycited by 36
- 2019Parameter-Free Online Convex Optimization with Sub-Exponential Noisecited by 28
3 more
- 2015On Equivalence of Martingale Tail Bounds and Deterministic Regret Inequalitiescited by 27
- 2021Off-policy Confidence Sequencescited by 15
- 2018Test Martingales for bounded random variablescited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 12; 2025: 11; 2026: 11.
42 papers.
Sort:
- 2024Mitigating LLM Hallucinations via Conformal Abstentioncited by 56
- 2024Active Statistical Inferencecited by 46
- 2022Parameter-free Regret in High Probability with Heavy Tailscited by 26
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2025E-Values Expand the Scope of Conformal Predictioncited by 23
- 2023Online-to-PAC Conversions: Generalization Bounds via Regret Analysiscited by 14
- 2023Tighter PAC-Bayes Bounds Through Coin-Bettingcited by 13
- 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Bettingcited by 11
- 2023Likelihood Ratio Confidence Sets for Sequential Decision Makingcited by 10
- 2024Fully Unconstrained Online Learningcited by 10
- 2023Reducing sequential change detection to sequential estimationcited by 9
- 2023On the near-optimality of betting confidence sets for bounded meanscited by 9
30 more
- 2025Confidence Sequences for Generalized Linear Models via Regret Analysiscited by 9
- 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guaranteescited by 9
- 2024Treatment of Statistical Estimation Problems in Randomized Smoothing for Adversarial Robustnesscited by 8
- 2025Probably Approximately Correct Labelscited by 7
- 2022Nonparametric extensions of randomized response for private confidence setscited by 6
- 2024Noise-Adaptive Confidence Sets for Linear Bandits and Application to Bayesian Optimizationcited by 6
- 2025On Stopping Times of Power-one Sequential Tests: Tight Lower and Upper Boundscited by 5
- 2024Better-than-KL PAC-Bayes Boundscited by 4
- 2025Optimistic Interior Point Methods for Sequential Hypothesis Testing by Bettingcited by 4
- 2024Generalization Bounds via Conditional f-Informationcited by 3
- 2025Improved Offline Contextual Bandits with Second-Order Bounds: Betting and Freezingcited by 3
- 2024Online-to-PAC generalization bounds under graph-mixing dependenciescited by 2
- 2024Sharp Matrix Empirical Bernstein Inequalitiescited by 2
- 2025Eventually LIL Regret: Almost Sure lnln T Regret for a sub-Gaussian Mixture on Unbounded Datacited by 2
- 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learningcited by 1
- 2025STaR-Bets: Sequential Target-Recalculating Bets for Tighter Confidence Intervalscited by 1
- 2025Differentially Private E-Valuescited by 1
- 2026Global Sequential Testing for Multi-Stream Auditingcited by 1
- 2026Multi-Armed Sequential Hypothesis Testing by Bettingcited by 1
- 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regressioncited by 1
- 2026Bandit Convex Optimization with Gradient Prediction Adaptivitycited by 1
- 2024Variational Bayes Portfolio Constructioncited by 0
- 2025Second-Order Bounds for [0,1]-Valued Regression via Betting Losscited by 0
- 2026Operationalizing Stein's Method for Online Linear Optimization: CLT-Based Optimal Tradeoffscited by 0
- 2026Learning to Bet for Horizon-Aware Anytime-Valid Testingcited by 0
- 2026Cover meets Robbins while Betting on Bounded Data: ln n Regret and Almost Sure lnln n Regretcited by 0
- 2026Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Meanscited by 0
- 2026From Betting to Empirical Bernstein LILcited by 0
- 2026Correcting Split Selection in Online Decision Trees via Anytime-Valid Inferencecited by 0
- 2026Always-On Experimentationcited by 0
- 2026Always-On Experimentation30 Sep 2026
- 2026Correcting Split Selection in Online Decision Trees via Anytime-Valid Inference29 May 2026
- 2026Bandit Convex Optimization with Gradient Prediction Adaptivity21 May 2026
- 2026From Betting to Empirical Bernstein LIL21 May 2026
- 2026Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means8 May 2026
- 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression2 May 2026
- 2026Cover meets Robbins while Betting on Bounded Data: ln n Regret and Almost Sure lnln n Regret22 Apr 2026
- 2026Learning to Bet for Horizon-Aware Anytime-Valid Testing20 Mar 2026
- 2026Multi-Armed Sequential Hypothesis Testing by Betting18 Mar 2026
- 2026Global Sequential Testing for Multi-Stream Auditing25 Feb 2026
- 2026Operationalizing Stein's Method for Online Linear Optimization: CLT-Based Optimal Tradeoffs6 Feb 2026
- 2025Eventually LIL Regret: Almost Sure lnln T Regret for a sub-Gaussian Mixture on Unbounded Data13 Dec 2025
30 more
- 2025Differentially Private E-Values21 Oct 2025
- 2025Second-Order Bounds for [0,1]-Valued Regression via Betting Loss16 Jul 2025
- 2025Probably Approximately Correct Labels12 Jun 2025
- 2025STaR-Bets: Sequential Target-Recalculating Bets for Tighter Confidence Intervals28 May 2025
- 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guarantees24 May 2025
- 2025On Stopping Times of Power-one Sequential Tests: Tight Lower and Upper Bounds28 Apr 2025
- 2025Confidence Sequences for Generalized Linear Models via Regret Analysis23 Apr 2025
- 2025E-Values Expand the Scope of Conformal Prediction17 Mar 2025
- 2025Improved Offline Contextual Bandits with Second-Order Bounds: Betting and Freezing15 Feb 2025
- 2025Optimistic Interior Point Methods for Sequential Hypothesis Testing by Betting11 Feb 2025
- 2024Sharp Matrix Empirical Bernstein Inequalities14 Nov 2024
- 2024Variational Bayes Portfolio Construction9 Nov 2024
- 2024Generalization Bounds via Conditional f-Information30 Oct 2024
- 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Betting29 Oct 2024
- 2024Online-to-PAC generalization bounds under graph-mixing dependencies11 Oct 2024
- 2024Treatment of Statistical Estimation Problems in Randomized Smoothing for Adversarial Robustness25 Jun 2024
- 2024Fully Unconstrained Online Learning30 May 2024
- 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learning18 May 2024
- 2024Mitigating LLM Hallucinations via Conformal Abstention4 Apr 2024
- 2024Active Statistical Inference5 Mar 2024
- 2024Better-than-KL PAC-Bayes Bounds14 Feb 2024
- 2024Noise-Adaptive Confidence Sets for Linear Bandits and Application to Bayesian Optimization12 Feb 2024
- 2023Likelihood Ratio Confidence Sets for Sequential Decision Making8 Nov 2023
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversion28 Oct 2023
- 2023On the near-optimality of betting confidence sets for bounded means2 Oct 2023
- 2023Reducing sequential change detection to sequential estimation16 Sep 2023
- 2023Online-to-PAC Conversions: Generalization Bounds via Regret Analysis31 May 2023
- 2023Tighter PAC-Bayes Bounds Through Coin-Betting12 Feb 2023
- 2022Parameter-free Regret in High Probability with Heavy Tails25 Oct 2022
- 2022Nonparametric extensions of randomized response for private confidence sets17 Feb 2022
- 2024Mitigating LLM Hallucinations via Conformal Abstentioncited by 56
- 2024Active Statistical Inferencecited by 46
- 2022Parameter-free Regret in High Probability with Heavy Tailscited by 26
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2025E-Values Expand the Scope of Conformal Predictioncited by 23
- 2023Online-to-PAC Conversions: Generalization Bounds via Regret Analysiscited by 14
- 2023Tighter PAC-Bayes Bounds Through Coin-Bettingcited by 13
- 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Bettingcited by 11
- 2023Likelihood Ratio Confidence Sets for Sequential Decision Makingcited by 10
- 2024Fully Unconstrained Online Learningcited by 10
- 2023Reducing sequential change detection to sequential estimationcited by 9
- 2023On the near-optimality of betting confidence sets for bounded meanscited by 9
12 most cited of 42 All 42 (JSON)
- 2026Always-On Experimentation30 Sep 2026
- 2026Correcting Split Selection in Online Decision Trees via Anytime-Valid Inference29 May 2026
- 2026Bandit Convex Optimization with Gradient Prediction Adaptivity21 May 2026
- 2026From Betting to Empirical Bernstein LIL21 May 2026
- 2026Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means8 May 2026
- 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression2 May 2026
- 2026Cover meets Robbins while Betting on Bounded Data: ln n Regret and Almost Sure lnln n Regret22 Apr 2026
- 2026Learning to Bet for Horizon-Aware Anytime-Valid Testing20 Mar 2026
- 2026Multi-Armed Sequential Hypothesis Testing by Betting18 Mar 2026
- 2026Global Sequential Testing for Multi-Stream Auditing25 Feb 2026
- 2026Operationalizing Stein's Method for Online Linear Optimization: CLT-Based Optimal Tradeoffs6 Feb 2026
- 2025Eventually LIL Regret: Almost Sure lnln T Regret for a sub-Gaussian Mixture on Unbounded Data13 Dec 2025
12 newest of 42 All 42 (JSON)