Nearly Optimal Regret for Stochastic Linear Bandits with Heavy-Tailed Payoffs
Not on the map. Why?
Abstract (arXiv)
In this paper, we study the problem of stochastic linear bandits with finite action sets. Most of existing work assume the payoffs are bounded or sub-Gaussian, which may be violated in some scenarios such as financial markets. To settle this issue, we analyze the linear bandits with heavy-tailed payoffs, where the payoffs admit finite 1+ε moments for some ε∈(0,1]. Through median of means and dynamic truncation, we propose two novel algorithms which enjoy a sublinear regret bound of widetildeO(d^frac12T^frac11+ε), where d is the dimension of contextual information and T is the time horizon. Meanwhile, we provide an Omega(d^fracε1+εT^frac11+ε) lower bound, which implies our upper bound matches the lower bound up to polylogarithmic factors in the order of d and T when ε=1. Finally, we conduct numerical experiments to demonstrate the effectiveness of our algorithms and the empirical results strongly support our theoretical guarantees.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 5; 2024: 1; 2025: 3; 2026: 4.
25 papers.
Sort:
By area:
- 2021Topology-Imbalance Learning for Semi-Supervised Node Classificationcited by 56
- 2022Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Modelscited by 35
- 2021Imbalanced Graph Classification via Graph-of-Graph Neural Networkscited by 27
- 2023Towards Robust Offline Reinforcement Learning under Diverse Data Corruptioncited by 24
- 2022Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Banditscited by 17
- 2021Graph Classification by Mixture of Diverse Expertscited by 16
- 2023Tackling Heavy-Tailed Rewards in Reinforcement Learning with Function Approximation: Minimax Optimal and Instance-Dependent Regret Boundscited by 13
- 2022Knowledge Learning with Crowdsourcing: A Brief Review and Systematic Perspectivecited by 11
- 2023Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed Rewardscited by 11
- 2021Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed Payoffscited by 8
- 2023Variance-aware robust reinforcement learning with linear function approximation under heavy-tailed rewardscited by 8
- 2023Quantum Heavy-tailed Banditscited by 7
13 more
- 2024Low-rank Matrix Bandits with Heavy-tailed Rewardscited by 6
- 2021Tackling the Imbalance for GNNscited by 5
- 2022NodeTrans: A Graph Transfer Learning Approach for Traffic Predictioncited by 5
- 2025Heavy-Tailed Linear Bandits: Huber Regression with One-Pass Updatecited by 5
- 2025Improved Regret Bounds for Linear Bandits with Heavy-Tailed Rewardscited by 4
- 2025Catoni Contextual Bandits are Robust to Heavy-tailed Rewardscited by 3
- 2022Graph Convolutional Network for Multi-Target Multi-Camera Vehicle Trackingcited by 2
- 2026Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noisecited by 2
- 2021Fast and Accurate Graph Learning for Huge Data via Minipatch Ensemblescited by 1
- 2026Best-of-Both-Worlds for Heavy-Tailed Markov Decision Processescited by 1
- 2022Graph Decipher: A transparent dual-attention graph neural network to understand the message-passing mechanism for the node classificationcited by 0
- 2026Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noisecited by 0
- 2026Breaking the Total Variance Barrier: Sharp Sample Complexity for Linear Heteroscedastic Bandits with Fixed Action Setcited by 0
- 2026Breaking the Total Variance Barrier: Sharp Sample Complexity for Linear Heteroscedastic Bandits with Fixed Action Set26 Jul 2026
- 2026Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise18 May 2026
- 2026Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noise16 Mar 2026
- 2026Best-of-Both-Worlds for Heavy-Tailed Markov Decision Processes1 Feb 2026
- 2025Improved Regret Bounds for Linear Bandits with Heavy-Tailed Rewards5 Jun 2025
- 2025Heavy-Tailed Linear Bandits: Huber Regression with One-Pass Update1 Mar 2025
- 2025Catoni Contextual Bandits are Robust to Heavy-tailed Rewards4 Feb 2025
- 2024Low-rank Matrix Bandits with Heavy-tailed Rewards26 Apr 2024
- 2023Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed Rewards28 Oct 2023
- 2023Towards Robust Offline Reinforcement Learning under Diverse Data Corruption19 Oct 2023
- 2023Tackling Heavy-Tailed Rewards in Reinforcement Learning with Function Approximation: Minimax Optimal and Instance-Dependent Regret Bounds12 Jun 2023
- 2023Variance-aware robust reinforcement learning with linear function approximation under heavy-tailed rewards9 Mar 2023
13 more
- 2023Quantum Heavy-tailed Bandits23 Jan 2023
- 2022Graph Convolutional Network for Multi-Target Multi-Camera Vehicle Tracking28 Nov 2022
- 2022NodeTrans: A Graph Transfer Learning Approach for Traffic Prediction4 Jul 2022
- 2022Knowledge Learning with Crowdsourcing: A Brief Review and Systematic Perspective19 Jun 2022
- 2022Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Models9 Feb 2022
- 2022Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Bandits28 Jan 2022
- 2022Graph Decipher: A transparent dual-attention graph neural network to understand the message-passing mechanism for the node classification4 Jan 2022
- 2021Imbalanced Graph Classification via Graph-of-Graph Neural Networks1 Dec 2021
- 2021Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed Payoffs26 Oct 2021
- 2021Fast and Accurate Graph Learning for Huge Data via Minipatch Ensembles22 Oct 2021
- 2021Tackling the Imbalance for GNNs17 Oct 2021
- 2021Topology-Imbalance Learning for Semi-Supervised Node Classification8 Oct 2021
- 2021Graph Classification by Mixture of Diverse Experts29 Mar 2021
- 2021Topology-Imbalance Learning for Semi-Supervised Node Classificationcited by 56
- 2022Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Modelscited by 35
- 2021Imbalanced Graph Classification via Graph-of-Graph Neural Networkscited by 27
- 2022Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Banditscited by 17
- 2021Graph Classification by Mixture of Diverse Expertscited by 16
- 2023Tackling Heavy-Tailed Rewards in Reinforcement Learning with Function Approximation: Minimax Optimal and Instance-Dependent Regret Boundscited by 13
- 2022Knowledge Learning with Crowdsourcing: A Brief Review and Systematic Perspectivecited by 11
- 2023Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed Rewardscited by 11
- 2021Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed Payoffscited by 8
- 2023Variance-aware robust reinforcement learning with linear function approximation under heavy-tailed rewardscited by 8
- 2023Quantum Heavy-tailed Banditscited by 7
- 2024Low-rank Matrix Bandits with Heavy-tailed Rewardscited by 6
12 most cited of 24 All 24 (JSON)
- 2026Breaking the Total Variance Barrier: Sharp Sample Complexity for Linear Heteroscedastic Bandits with Fixed Action Set26 Jul 2026
- 2026Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise18 May 2026
- 2026Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noise16 Mar 2026
- 2026Best-of-Both-Worlds for Heavy-Tailed Markov Decision Processes1 Feb 2026
- 2025Improved Regret Bounds for Linear Bandits with Heavy-Tailed Rewards5 Jun 2025
- 2025Heavy-Tailed Linear Bandits: Huber Regression with One-Pass Update1 Mar 2025
- 2025Catoni Contextual Bandits are Robust to Heavy-tailed Rewards4 Feb 2025
- 2024Low-rank Matrix Bandits with Heavy-tailed Rewards26 Apr 2024
- 2023Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed Rewards28 Oct 2023
- 2023Tackling Heavy-Tailed Rewards in Reinforcement Learning with Function Approximation: Minimax Optimal and Instance-Dependent Regret Bounds12 Jun 2023
- 2023Variance-aware robust reinforcement learning with linear function approximation under heavy-tailed rewards9 Mar 2023
- 2023Quantum Heavy-tailed Bandits23 Jan 2023
12 newest of 24 All 24 (JSON)