mlsanityData to 7 Oct 2026

Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions

arXiv 2605.01752 ↗First posted 3 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study linear dueling bandits in volatile environments characterized by the simultaneous presence of post-serving contexts, delayed feedback, and adversarial corruption. Feedback is subject to unknown stochastic or adversarial delays and a cumulative corruption budget C. To address these challenges, we propose e RCDP-UCB, which integrates a learned approximator that predicts post-serving contexts from pre-serving information. It further employs an adaptive weighting strategy that clips feature vectors to mitigate the impact of corrupted and delayed observations simultaneously. Under standard regularity conditions and a parametric post-serving mapping, we rigorously establish that our algorithm is delay-regime-agnostic, achieving a regret upper bound of widetildeO(d(√T + C + D)), where d is the total feature dimension and D encapsulates the delay complexity. Crucially, our analysis reveals an additive cost structure between corruption and delay, avoiding the multiplicative degradation typical of prior works. We further establish lower bounds that nearly match our upper bounds up to a √d factor for adversarial delays in the absence of post-serving contexts. Code is available at https://github.com/youngmin0oh/rcdp-public.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 3 May 2026.

Builds on

20 of 41 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2015Contextual Dueling Banditscited by 101
  5. 2019Better Algorithms for Stochastic Bandits with Adversarial Corruptionscited by 91
  6. 2018Linear Bandits with Stochastic Delayed Feedbackcited by 55
  7. 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptionscited by 51
  8. 2022Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Modelscited by 35
  9. 2022Corruption-Robust Algorithms with Uncertainty Weighting for Nonlinear Contextual Bandits and Markov Decision Processescited by 33
  10. 2022Delayed Feedback in Generalised Linear Bandits Revisitedcited by 23
  11. 2024Feel-Good Thompson Sampling for Contextual Dueling Banditscited by 23
  12. 2023Variance-Aware Regret Bounds for Stochastic Contextual Dueling Banditscited by 22
8 more
  1. 2023A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPscited by 15
  2. 2021Analysis of Thompson Sampling for Partially Observable Contextual Multi-Armed Banditscited by 10
  3. 2024Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedbackcited by 9
  4. 2021Robust Bandit Learning with Imperfect Contextcited by 8
  5. 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecificationcited by 6
  6. 2022Robust Contextual Linear Banditscited by 4
  7. 2025Neural Variance-aware Dueling Bandits with Deep Representation and Shallow Explorationcited by 2
  8. 2023Follow-ups Also Matter: Improving Contextual Bandits via Post-serving Contextscited by 1

Built on by

Not cited yet.