mlsanityData to 7 Oct 2026

A Survey on Contextual Multi-armed Bandits

arXiv 1508.03326 ↗First posted 13 Aug 2015cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

In this survey we cover a few stochastic and adversarial contextual bandit algorithms. We analyze each algorithm's assumption and regret bound.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 5; 2023: 6; 2024: 7; 2025: 6; 2026: 6.

34 papers.

Sort:

By area:

  1. 2023Lero: A Learning-to-Rank Query Optimizercited by 26
  2. 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
  3. 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlookcited by 10
  4. 2022Personalized Reward Learning with Interaction-Grounded Learning (IGL)cited by 9
  5. 2023Learning Action Embeddings for Off-Policy Evaluationcited by 7
  6. 2024LASeR: Learning to Adaptively Select Reward Models with Multi-Armed Banditscited by 7
  7. 2021Knowledge Infused Policy Gradients with Upper Confidence Bound for Relational Banditscited by 6
  8. 2024Contextual Restless Multi-Armed Bandits with Application to Demand Response Decision-Makingcited by 6
  9. 2023Pricing with Contextual Elasticity and Heteroscedastic Valuationcited by 5
  10. 2021Dealing with Expert Bias in Collective Decision-Makingcited by 4
  11. 2021Doubly Robust Interval Estimation for Optimal Policy Evaluation in Online Learningcited by 4
  12. 2022Coordinated Attacks against Contextual Bandits: Fundamental Limits and Defense Mechanismscited by 4
22 more
  1. 2023Geometry-Aware Approaches for Balancing Performance and Theoretical Guarantees in Linear Banditscited by 3
  2. 2025Reward Model Routing in Alignmentcited by 3
  3. 2023Approximate information for efficient exploration-exploitation strategiescited by 2
  4. 2024Multi-Excitation Projective Simulation with a Many-Body Physics Inspired Inductive Biascited by 2
  5. 2022A Scalable Recommendation Engine for New Users and Itemscited by 1
  6. 2022Sequential Decision Making on Unmatched Data using Bayesian Kernel Embeddingscited by 1
  7. 2024Hierarchical Upper Confidence Bounds for Constrained Online Learningcited by 1
  8. 2026Learning to Orchestrate Agents under Uncertaintycited by 1
  9. 2026JailbreakOPT: Tool-Assisted Iterative Jailbreak Prompt Optimizationcited by 1
  10. 2023Design Principles of Robust Multi-Armed Bandit Framework in Video Recommendationscited by 0
  11. 2024Identifiable Latent Bandits: Leveraging observational data for personalized decision-makingcited by 0
  12. 2024Reciprocal Learningcited by 0
  13. 2024Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristicscited by 0
  14. 2025Information maximization for a broad variety of multi-armed bandit gamescited by 0
  15. 2025In-Domain African Languages Translation Using LLMs and Multi-armed Banditscited by 0
  16. 2025Scalable and Interpretable Contextual Bandits: A Literature Review and Retail Offer Prototypecited by 0
  17. 2025BanditWare: A Contextual Bandit-based Framework for Hardware Predictioncited by 0
  18. 2025Latent Preference Banditscited by 0
  19. 2026Piece of CAKE: Adaptive Execution Engines via Microsecond-Scale Learningcited by 0
  20. 2026Towards Noise-Resilient Quantum Multi-Armed and Stochastic Linear Banditscited by 0
  21. 2026Reward-Based Online LLM Routing via NeuralUCBcited by 0
  22. 2026Latent Order Banditscited by 0