mlsanityData to 14 Oct 2026

Adaptive Action Duration with Contextual Bandits for Deep Reinforcement Learning in Dynamic Environments

arXiv 2507.00030 ↗First posted 17 Jun 2025cs.LG cs.AIcited by 0

On the map: Deep reinforcement learning methods → Deep RL algorithms and representations

Abstract (arXiv)

Deep Reinforcement Learning (DRL) has achieved remarkable success in complex sequential decision-making tasks, such as playing Atari 2600 games and mastering board games. A critical yet underexplored aspect of DRL is the temporal scale of action execution. We propose a novel paradigm that integrates contextual bandits with DRL to adaptively select action durations, enhancing policy flexibility and computational efficiency. Our approach augments a Deep Q-Network (DQN) with a contextual bandit module that learns to choose optimal action repetition rates based on state contexts. Experiments on Atari 2600 games demonstrate significant performance improvements over static duration baselines, highlighting the efficacy of adaptive temporal abstractions in DRL. This paradigm offers a scalable solution for real-time applications like gaming and robotics, where dynamic action durations are critical.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Deep RL algorithms and representations, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 10 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

2 of 10 references.

References · 2

  1. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  2. 2021Temporal Abstraction in Reinforcement Learning with the Successor Representationcited by 54

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Efficient Exploration in Deep Reinforcement Learning: A Novel Bayesian Actor-Critic Algorithm
  2. 2024FDQN: A Flexible Deep Q-Network Framework for Game Automation
  3. 2025Improving planning and MBRL with temporally-extended actions
  4. 2024Dynamic Learning Rate for Deep Reinforcement Learning: A Bandit Approach
  5. 2025Context-Sensitive Abstractions for Reinforcement Learning with Parameterized Actions
  6. 2025A Practical Introduction to Deep Reinforcement Learning
  7. 2022Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization
  8. 2024A Comparative Study of Deep Reinforcement Learning Models: DQN vs PPO vs A2C