Stochastic Linear Bandits Robust to Adversarial Attacks
Not on the map. Why?
Abstract (arXiv)
We consider a stochastic linear bandit problem in which the rewards are not only subject to random noise, but also adversarial attacks subject to a suitable budget C (i.e., an upper bound on the sum of corruption magnitudes across the time horizon). We provide two variants of a Robust Phased Elimination algorithm, one that knows C and one that does not. Both variants are shown to attain near-optimal regret in the non-corrupted case C = 0, while incurring additional additive terms respectively having a linear and quadratic dependency on C in general. We present algorithm independent lower bounds showing that these additive terms are near-optimal. In addition, in a contextual setting, we revisit a setup of diverse contexts, and show that a simple greedy algorithm is provably robust with a near-optimal additive regret term, despite performing no explicit exploration and not knowing C.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 10; 2023: 15; 2024: 10; 2025: 4; 2026: 8.
65 papers.
Sort:
By area:
- 2021Federated Linear Contextual Banditscited by 61
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptionscited by 51
- 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
- 2021A Model Selection Approach for Corruption Robust Reinforcement Learningcited by 45
- 2021Robust Stochastic Linear Contextual Bandits Under Adversarial Attackscited by 33
- 2022Corruption-Robust Algorithms with Uncertainty Weighting for Nonlinear Contextual Bandits and Markov Decision Processescited by 33
- 2023Corruption-Robust Offline Reinforcement Learning with General Function Approximationcited by 30
- 2021Linear Contextual Bandits with Adversarial Corruptionscited by 21
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learningcited by 21
- 2021Defense Against Reward Poisoning Attacks in Reinforcement Learningcited by 20
- 2021Improved Corruption Robust Algorithms for Episodic Reinforcement Learningcited by 20
- 2021Exploiting Heterogeneity in Robust Federated Best-Arm Identificationcited by 20
38 more
- 2021On Optimal Robustness to Adversarial Corruption in Online Decision Problemscited by 20
- 2022Reward Poisoning Attacks on Offline Multi-Agent Reinforcement Learningcited by 19
- 2022Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithmscited by 19
- 2023Robust Lipschitz Bandits to Adversarial Corruptionscited by 15
- 2023Best-of-Three-Worlds Linear Bandit Algorithm with Variance-Adaptive Regret Boundscited by 13
- 2024Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruptioncited by 12
- 2021Bias-Robust Bayesian Optimization via Dueling Banditscited by 11
- 2022A Robust Phased Elimination Algorithm for Corruption-Tolerant Gaussian Process Banditscited by 11
- 2023Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithmcited by 11
- 2021Syndicated Bandits: A Framework for Auto Tuning Hyper-parameters in Contextual Bandit Algorithmscited by 10
- 2021When Are Linear Stochastic Bandits Attackable?cited by 10
- 2023Best-of-Both-Worlds Algorithms for Linear Contextual Banditscited by 10
- 2021Saving Stochastic Bandits from Poisoning Attacks via Limited Data Verificationcited by 9
- 2024Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedbackcited by 9
- 2021Game Redesign in No-regret Game Playingcited by 8
- 2021Combinatorial Bandits under Strategic Manipulationscited by 6
- 2022Federated Multi-Armed Bandits Under Byzantine Attackscited by 6
- 2023Adversarial Attacks on Adversarial Banditscited by 6
- 2023Adversarial Attacks on Online Learning to Rank with Stochastic Click Modelscited by 6
- 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecificationcited by 6
- 2021Cooperative Stochastic Multi-agent Multi-armed Bandits Robust to Adversarial Corruptionscited by 5
- 2021Adversarial Attacks on Gaussian Process Banditscited by 5
- 2026Provably Efficient Regularized Online RLHF with Generalized Bilinear Preferencescited by 5
- 2022Collaborative Linear Bandits with Adversarial Agents: Near-Optimal Regret Boundscited by 4
- 2022Robust Contextual Linear Banditscited by 4
- 2023Optimal Sample Selection Through Uncertainty Estimation and Its Application in Deep Learningcited by 4
- 2023Robust Causal Bandits for Linear Modelscited by 4
- 2024Strategic Linear Contextual Banditscited by 4
- 2021Efficient Action Poisoning Attacks on Linear Contextual Banditscited by 3
- 2023Online Corrupted User Detection and Regret Minimizationcited by 3
- 2023Online Robust Mean Estimationcited by 3
- 2025Linear Bandits with Partially Observable Featurescited by 3
- 2025Augmenting Online RL with Offline Data is All You Need: A Unified Hybrid RL Algorithm Design and Analysiscited by 3
- 2025Practical Adversarial Attacks on Stochastic Bandits via Fake Data Injectioncited by 3
- 2022Distributed Stochastic Bandit Learning with Delayed Context Observationcited by 2
- 2024Stealthy Adversarial Attacks on Stochastic Multi-Armed Banditscited by 2
- 2024Improved Bound for Robust Causal Bandits with Linear Modelscited by 2
- 2024Learning from Imperfect Human Feedback: a Tale from Corruption-Robust Duelingcited by 2
50 most cited of 65 All 65 (JSON)
- 2026Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity29 Sep 2026
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraints29 May 2026
- 2026Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noise16 Mar 2026
- 2026Mixing Makes Markovian Contexts Cheap for Linear Bandits13 Mar 2026
- 2026Learning When to Trust in Contextual Social Bandits9 Mar 2026
- 2026Provably Efficient Regularized Online RLHF with Generalized Bilinear Preferences26 Feb 2026
- 2026Truly Adapting to Adversarial Constraints in Constrained MABs16 Feb 2026
- 2026A Jointly Efficient and Optimal Algorithm for Heteroskedastic Generalized Linear Bandits with Adversarial Corruptions11 Feb 2026
- 2025Corruption-Tolerant Asynchronous Q-Learning with Near-Optimal Rates10 Sep 2025
- 2025Practical Adversarial Attacks on Stochastic Bandits via Fake Data Injection28 May 2025
- 2025Augmenting Online RL with Offline Data is All You Need: A Unified Hybrid RL Algorithm Design and Analysis19 May 2025
- 2025Linear Bandits with Partially Observable Features10 Feb 2025
38 more
- 2024Robust Thompson Sampling Algorithms Against Reward Poisoning Attacks25 Oct 2024
- 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecification10 Oct 2024
- 2024Robust Q-Learning under Corrupted Rewards5 Sep 2024
- 2024Stochastic Bandits Robust to Adversarial Attacks16 Aug 2024
- 2024Strategic Linear Contextual Bandits1 Jun 2024
- 2024Learning from Imperfect Human Feedback: a Tale from Corruption-Robust Dueling18 May 2024
- 2024Improved Bound for Robust Causal Bandits with Linear Models13 May 2024
- 2024Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedback16 Apr 2024
- 2024Stealthy Adversarial Attacks on Stochastic Multi-Armed Bandits21 Feb 2024
- 2024Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruption14 Feb 2024
- 2023Best-of-Both-Worlds Algorithms for Linear Contextual Bandits24 Dec 2023
- 2023Robust Best-arm Identification in Linear Bandits8 Nov 2023
- 2023Robust Causal Bandits for Linear Models30 Oct 2023
- 2023Online Robust Mean Estimation24 Oct 2023
- 2023Corruption-Robust Offline Reinforcement Learning with General Function Approximation23 Oct 2023
- 2023Online Corrupted User Detection and Regret Minimization7 Oct 2023
- 2023Optimal Sample Selection Through Uncertainty Estimation and Its Application in Deep Learning5 Sep 2023
- 2023Corruption-Robust Lipschitz Contextual Search26 Jul 2023
- 2023Adversarial Attacks on Online Learning to Rank with Stochastic Click Models30 May 2023
- 2023Robust Lipschitz Bandits to Adversarial Corruptions29 May 2023
- 2023Learning to Seek: Multi-Agent Online Source Seeking Against Non-Stochastic Disturbances29 Apr 2023
- 2023Robust and differentially private stochastic linear bandits23 Apr 2023
- 2023Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithm13 Mar 2023
- 2023Best-of-Three-Worlds Linear Bandit Algorithm with Variance-Adaptive Regret Bounds24 Feb 2023
- 2023Adversarial Attacks on Adversarial Bandits30 Jan 2023
- 2022Corruption-Robust Algorithms with Uncertainty Weighting for Nonlinear Contextual Bandits and Markov Decision Processes12 Dec 2022
- 2022Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithms8 Nov 2022
- 2022Robust Contextual Linear Bandits26 Oct 2022
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learning29 Aug 2022
- 2022Distributed Stochastic Bandit Learning with Delayed Context Observation28 Jul 2022
- 2022Collaborative Linear Bandits with Adversarial Agents: Near-Optimal Regret Bounds6 Jun 2022
- 2022Reward Poisoning Attacks on Offline Multi-Agent Reinforcement Learning4 Jun 2022
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptions13 May 2022
- 2022Federated Multi-Armed Bandits Under Byzantine Attacks9 May 2022
- 2022A Robust Phased Elimination Algorithm for Corruption-Tolerant Gaussian Process Bandits3 Feb 2022
- 2021Efficient Action Poisoning Attacks on Linear Contextual Bandits10 Dec 2021
- 2021Federated Linear Contextual Bandits27 Oct 2021
- 2021Linear Contextual Bandits with Adversarial Corruptions25 Oct 2021
50 newest of 65 All 65 (JSON)
- 2021Federated Linear Contextual Banditscited by 61
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptionscited by 51
- 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
- 2021A Model Selection Approach for Corruption Robust Reinforcement Learningcited by 45
- 2021Robust Stochastic Linear Contextual Bandits Under Adversarial Attackscited by 33
- 2022Corruption-Robust Algorithms with Uncertainty Weighting for Nonlinear Contextual Bandits and Markov Decision Processescited by 33
- 2021Linear Contextual Bandits with Adversarial Corruptionscited by 21
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learningcited by 21
- 2021Defense Against Reward Poisoning Attacks in Reinforcement Learningcited by 20
- 2021Improved Corruption Robust Algorithms for Episodic Reinforcement Learningcited by 20
- 2021Exploiting Heterogeneity in Robust Federated Best-Arm Identificationcited by 20
- 2021On Optimal Robustness to Adversarial Corruption in Online Decision Problemscited by 20
12 most cited of 59 All 59 (JSON)
- 2026Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity29 Sep 2026
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraints29 May 2026
- 2026Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noise16 Mar 2026
- 2026Mixing Makes Markovian Contexts Cheap for Linear Bandits13 Mar 2026
- 2026Learning When to Trust in Contextual Social Bandits9 Mar 2026
- 2026Truly Adapting to Adversarial Constraints in Constrained MABs16 Feb 2026
- 2026A Jointly Efficient and Optimal Algorithm for Heteroskedastic Generalized Linear Bandits with Adversarial Corruptions11 Feb 2026
- 2025Corruption-Tolerant Asynchronous Q-Learning with Near-Optimal Rates10 Sep 2025
- 2025Practical Adversarial Attacks on Stochastic Bandits via Fake Data Injection28 May 2025
- 2025Augmenting Online RL with Offline Data is All You Need: A Unified Hybrid RL Algorithm Design and Analysis19 May 2025
- 2025Linear Bandits with Partially Observable Features10 Feb 2025
- 2024Robust Thompson Sampling Algorithms Against Reward Poisoning Attacks25 Oct 2024
12 newest of 59 All 59 (JSON)