mlsanityData to 7 Oct 2026

Randomized Allocation with Nonparametric Estimation for Contextual Multi-Armed Bandits with Delayed Rewards

arXiv 1902.00819 ↗First posted 3 Feb 2019stat.ML cs.LG math.STcited by 15

Not on the map. Why?

Abstract (arXiv)

We study a multi-armed bandit problem with covariates in a setting where there is a possible delay in observing the rewards. Under some mild assumptions on the probability distributions for the delays and using an appropriate randomization to select the arms, the proposed strategy is shown to be strongly consistent.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Feb 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 4; 2023: 4; 2024: 2; 2025: 3.

15 papers.

Sort:

  1. 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
  2. 2023Tracking Most Significant Shifts in Nonparametric Contextual Banditscited by 10
  3. 2022BandMaxSAT: A Local Search MaxSAT Solver with Multi-armed Banditcited by 6
  4. 2025Contextual Linear Bandits with Delay as Payoffcited by 6
  5. 2023Nearest Neighbour with Bandit Feedbackcited by 5
  6. 2024Adaptive Smooth Non-Stationary Banditscited by 4
  7. 2024Batched Nonparametric Contextual Banditscited by 3
  8. 2022Multi-Armed Bandit Problem with Temporally-Partitioned Rewards: When Partial Feedback Countscited by 2
  9. 2025Lipschitz Bandits with Stochastic Delayed Feedbackcited by 1
  10. 2021On Learning to Rank Long Sequences with Contextual Banditscited by 0
  11. 2022Sales Channel Optimization via Simulations Based on Observational Data with Delayed Rewards: A Case Study at LinkedIncited by 0
  12. 2022Incorporating Multi-armed Bandit with Local Search for MaxSATcited by 0
3 more
  1. 2023Multi-Armed Bandits with Generalized Temporally-Partitioned Rewardscited by 0
  2. 2023Kernel ε-Greedy for Multi-Armed Bandits with Covariatescited by 0
  3. 2025Non-Linear Model-Based Sequential Decision-Making in Agriculturecited by 0