mlsanityData to 14 Oct 2026

Learnings Options End-to-End for Continuous Action Tasks

arXiv 1712.00004 ↗First posted 30 Nov 2017cs.LG cs.AIcited by 24

Not on the map. Why?

Abstract (arXiv)

We present new results on learning temporally extended actions for continuoustasks, using the options framework (Suttonet al.[1999b], Precup [2000]). In orderto achieve this goal we work with the option-critic architecture (Baconet al.[2017])using a deliberation cost and train it with proximal policy optimization (Schulmanet al.[2017]) instead of vanilla policy gradient. Results on Mujoco domains arepromising, but lead to interesting questions aboutwhena given option should beused, an issue directly connected to the use of initiation sets.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 5; 2022: 2; 2023: 2; 2024: 5; 2025: 5; 2026: 4.

24 papers.

Sort:

By area:

  1. 2021Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Taskscited by 78
  2. 2021Hierarchical Reinforcement Learning By Discovering Intrinsic Optionscited by 58
  3. 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 26
  4. 2021Flexible Option Learningcited by 25
  5. 2024Strategy and Skill Learning for Physics-based Table Tennis Animationcited by 20
  6. 2026HiPER: Hierarchical Reinforcement Learning with Explicit Credit Assignment for Large Language Model Agentscited by 18
  7. 2022Leveraging Sequentiality in Reinforcement Learning from a Single Demonstrationcited by 6
  8. 2025Scalable Option Learning in High-Throughput Environmentscited by 5
  9. 2020oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actionscited by 3
  10. 2023PEAR: Primitive Enabled Adaptive Relabeling for Boosting Hierarchical Reinforcement Learningcited by 3
  11. 2024PIPER: Primitive-Informed Preference-based Hierarchical Reinforcement Learning via Hindsight Relabelingcited by 3
  12. 2023CRISP: Curriculum Inducing Primitive Informed Subgoal Prediction for Hierarchical Reinforcement Learningcited by 2
12 more
  1. 2024DIPPER: Direct Preference Optimization to Accelerate Primitive-Enabled Hierarchical Reinforcement Learningcited by 1
  2. 2024SOAP-RL: Sequential Option Advantage Propagation for Reinforcement Learning in POMDP Environmentscited by 1
  3. 2025Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robotscited by 1
  4. 2025Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learningcited by 1
  5. 2021Interpretable Reinforcement Learning Inspired by Piaget's Theory of Cognitive Developmentcited by 0
  6. 2022Coordinating Policies Among Multiple Agents via an Intelligent Communication Channelcited by 0
  7. 2024Accelerating Task Generalisation with Multi-Level Skill Hierarchiescited by 0
  8. 2025Enter the Void - Planning to Seek Entropy When Reward is Scarcecited by 0
  9. 2025Learning Temporal Abstractions via Variational Homomorphisms in Option-Induced Abstract MDPscited by 0
  10. 2026Enabling Option Learning in Sparse Rewards with Hindsight Experience Replaycited by 0
  11. 2026Hierarchical Behaviour Spacescited by 0
  12. 2026Hierarchical Reinforcement Learning for Sparse-Reward Search in Commutative Algebracited by 0