Efficient Contextual Bandits with Continuous Actions
Not on the map. Why?
Abstract (arXiv)
We create a computationally tractable algorithm for contextual bandits with continuous actions having unknown structure. Our reduction-style algorithm composes with most supervised learning representations. We prove that it works in a general sense and verify the new functionality with large-scale experiments.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 6; 2024: 4; 2025: 3; 2026: 3.
24 papers.
Sort:
By area:
- 2021Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networkscited by 52
- 2022Contextual Bandits with Large Action Spaces: Made Practicalcited by 32
- 2021Lipschitz Bandits with Batched Feedbackcited by 21
- 2022Deep Hierarchy in Banditscited by 18
- 2022Contextual Bandits with Smooth Regret: Efficient Learning in Continuous Action Spacescited by 17
- 2023Oracle-Efficient Pessimism: Offline Policy Optimization in Contextual Banditscited by 14
- 2021Top-k eXtreme Contextual Bandits with Arm Hierarchycited by 8
- 2024Probabilities of Causation for Continuous and Vector Variablescited by 8
- 2023Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimizationcited by 7
- 2024Information Capacity Regret Bounds for Bandits with Mediator Feedbackcited by 4
- 2021Optimal Regret Algorithm for Pseudo-1d Bandit Convex Optimizationcited by 3
- 2023Optimal Exploration is no harder than Thompson Samplingcited by 3
12 more
- 2024DISCO: An End-to-End Bandit Framework for Personalised Discount Allocationcited by 3
- 2023Learning to Generate All Feasible Actionscited by 2
- 2023Infinite Action Contextual Bandits with Reusable Data Exhaustcited by 2
- 2024Batched Stochastic Bandit for Nondegenerate Functionscited by 2
- 2026Taming the Monster Every Context: Complexity Measure and Unified Framework for Offline-Oracle Efficient Contextual Banditscited by 2
- 2022Reducing Learning Difficulties: One-Step Two-Critic Deep Reinforcement Learning for Inverter-based Volt-Var Controlcited by 0
- 2023Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instancescited by 0
- 2025Learn to Bid as a Price-Maker Wind Power Producercited by 0
- 2025A General Approach of Automated Environment Design for Learning the Optimal Power Flowcited by 0
- 2025Batched Bandits with Heavy-Tailed Rewardscited by 0
- 2026Online Adaptation of Visual Odometry Frontends with Image-Conditioned Reinforcement Learningcited by 0
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actionscited by 0
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions27 Aug 2026
- 2026Online Adaptation of Visual Odometry Frontends with Image-Conditioned Reinforcement Learning23 Mar 2026
- 2026Taming the Monster Every Context: Complexity Measure and Unified Framework for Offline-Oracle Efficient Contextual Bandits10 Feb 2026
- 2025Batched Bandits with Heavy-Tailed Rewards4 Oct 2025
- 2025A General Approach of Automated Environment Design for Learning the Optimal Power Flow1 May 2025
- 2025Learn to Bid as a Price-Maker Wind Power Producer20 Mar 2025
- 2024DISCO: An End-to-End Bandit Framework for Personalised Discount Allocation10 Jun 2024
- 2024Probabilities of Causation for Continuous and Vector Variables30 May 2024
- 2024Batched Stochastic Bandit for Nondegenerate Functions9 May 2024
- 2024Information Capacity Regret Bounds for Bandits with Mediator Feedback15 Feb 2024
- 2023Optimal Exploration is no harder than Thompson Sampling9 Oct 2023
- 2023Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instances3 Oct 2023
12 more
- 2023Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimization5 Jul 2023
- 2023Oracle-Efficient Pessimism: Offline Policy Optimization in Contextual Bandits13 Jun 2023
- 2023Infinite Action Contextual Bandits with Reusable Data Exhaust16 Feb 2023
- 2023Learning to Generate All Feasible Actions26 Jan 2023
- 2022Contextual Bandits with Smooth Regret: Efficient Learning in Continuous Action Spaces12 Jul 2022
- 2022Contextual Bandits with Large Action Spaces: Made Practical12 Jul 2022
- 2022Reducing Learning Difficulties: One-Step Two-Critic Deep Reinforcement Learning for Inverter-based Volt-Var Control30 Mar 2022
- 2022Deep Hierarchy in Bandits3 Feb 2022
- 2021Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks27 Oct 2021
- 2021Lipschitz Bandits with Batched Feedback19 Oct 2021
- 2021Top-k eXtreme Contextual Bandits with Arm Hierarchy15 Feb 2021
- 2021Optimal Regret Algorithm for Pseudo-1d Bandit Convex Optimization15 Feb 2021
- 2021Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networkscited by 52
- 2022Contextual Bandits with Large Action Spaces: Made Practicalcited by 32
- 2021Lipschitz Bandits with Batched Feedbackcited by 21
- 2022Deep Hierarchy in Banditscited by 18
- 2022Contextual Bandits with Smooth Regret: Efficient Learning in Continuous Action Spacescited by 17
- 2021Top-k eXtreme Contextual Bandits with Arm Hierarchycited by 8
- 2024Probabilities of Causation for Continuous and Vector Variablescited by 8
- 2023Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimizationcited by 7
- 2024Information Capacity Regret Bounds for Bandits with Mediator Feedbackcited by 4
- 2021Optimal Regret Algorithm for Pseudo-1d Bandit Convex Optimizationcited by 3
- 2023Optimal Exploration is no harder than Thompson Samplingcited by 3
- 2024DISCO: An End-to-End Bandit Framework for Personalised Discount Allocationcited by 3
12 most cited of 23 All 23 (JSON)
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions27 Aug 2026
- 2026Online Adaptation of Visual Odometry Frontends with Image-Conditioned Reinforcement Learning23 Mar 2026
- 2026Taming the Monster Every Context: Complexity Measure and Unified Framework for Offline-Oracle Efficient Contextual Bandits10 Feb 2026
- 2025Batched Bandits with Heavy-Tailed Rewards4 Oct 2025
- 2025A General Approach of Automated Environment Design for Learning the Optimal Power Flow1 May 2025
- 2025Learn to Bid as a Price-Maker Wind Power Producer20 Mar 2025
- 2024DISCO: An End-to-End Bandit Framework for Personalised Discount Allocation10 Jun 2024
- 2024Probabilities of Causation for Continuous and Vector Variables30 May 2024
- 2024Batched Stochastic Bandit for Nondegenerate Functions9 May 2024
- 2024Information Capacity Regret Bounds for Bandits with Mediator Feedback15 Feb 2024
- 2023Optimal Exploration is no harder than Thompson Sampling9 Oct 2023
- 2023Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instances3 Oct 2023
12 newest of 23 All 23 (JSON)