mlsanityData to 14 Oct 2026

Hybrid Actor-Critic Reinforcement Learning in Parameterized Action Space

arXiv 1903.01344 ↗First posted 4 Mar 2019cs.LG cs.AI stat.MLcited by 54

Not on the map. Why?

Abstract (arXiv)

In this paper we propose a hybrid architecture of actor-critic algorithms for reinforcement learning in parameterized action space, which consists of multiple parallel sub-actor networks to decompose the structured action space into simpler action spaces along with a critic network to guide the training of all sub-actor networks. While this paper is mainly focused on parameterized action space, the proposed architecture, which we call hybrid actor-critic, can be extended for more general action spaces which has a hierarchical structure. We present an instance of the hybrid actor-critic architecture based on proximal policy optimization (PPO), which we refer to as hybrid proximal policy optimization (H-PPO). Our experiments test H-PPO on a collection of tasks with parameterized action space, where H-PPO demonstrates superior performance over previous methods of parameterized action reinforcement learning.

Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 6; 2022: 7; 2023: 8; 2024: 6; 2025: 15; 2026: 12.

54 papers.

Sort:

By area:

  1. 2021Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Taskscited by 78
  2. 2021Accelerating Robotic Reinforcement Learning via Parameterized Action Primitivescited by 65
  3. 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 55
  4. 2023LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automationcited by 40
  5. 2021HyAR: Addressing Discrete-Continuous Action Reinforcement Learning via Hybrid Action Representationcited by 35
  6. 2021Deep hierarchical reinforcement agents for automated penetration testingcited by 19
  7. 2022Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Learningcited by 12
  8. 2022Multi-user Co-inference with Batch Processing Capable Edge Servercited by 11
  9. 2022Flowsheet synthesis through hierarchical reinforcement learning and graph neural networkscited by 10
  10. 2024RELIEF: Reinforcement Learning Empowered Graph Feature Prompt Tuningcited by 9
  11. 2024Model-based Reinforcement Learning for Parameterized Action Spacescited by 8
  12. 2022Meta-Learning Parameterized Skillscited by 7
38 more
  1. 2021Generalising Discrete Action Spaces with Conditional Action Treescited by 6
  2. 2021One model Packs Thousands of Items with Recurrent Conditional Query Learningcited by 5
  3. 2022Reinforcement learning for traffic signal control in hybrid action spacecited by 5
  4. 2023Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learningcited by 4
  5. 2024Exploiting Hybrid Policy in Reinforcement Learning for Interpretable Temporal Logic Manipulationcited by 3
  6. 2024A semi-centralized multi-agent RL framework for efficient irrigation schedulingcited by 2
  7. 2025Optimizing Navigation And Chemical Application in Precision Agriculture With Deep Reinforcement Learning And Conditional Action Treecited by 2
  8. 2026TRIDENT: Breaking the Hybrid-Safety-Physics Coupling for Provably Safe Multi-Agent Reinforcement Learningcited by 2
  9. 2022A Survey of Learning on Small Data: Generalization, Optimization, and Challengecited by 1
  10. 2023Diverse Policy Optimization for Structured Action Spacecited by 1
  11. 2023Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learningcited by 1
  12. 2024Integrating Reinforcement Learning and Model Predictive Control with Applications to Microgridscited by 1
  13. 2025AOAD-MAT: Transformer-based multi-agent deep reinforcement learning model considering agents' order of action decisionscited by 1
  14. 2025Logic-informed reinforcement learning for cross-domain optimization of large-scale cyber-physical systemscited by 1
  15. 2025Large-scale automatic carbon ion treatment planning for head and neck cancers via parallel multi-agent reinforcement learningcited by 1
  16. 2026Dmsh: A Multi-Agent Reinforcement Learning Framework for All-Quad Mesh Generationcited by 1
  17. 2022SAGE: Generating Symbolic Goals for Myopic Models in Deep Reinforcement Learningcited by 0
  18. 2023Mixed-Integer Optimal Control via Reinforcement Learning: A Case Study on Hybrid Electric Vehicle Energy Managementcited by 0
  19. 2023DCT: Dual Channel Training of Action Embeddings for Reinforcement Learning with Large Discrete Action Spacescited by 0
  20. 2023Position control of an acoustic cavitation bubble by reinforcement learningcited by 0
  21. 2024Scheduling Drone and Mobile Charger via Hybrid-Action Deep Reinforcement Learningcited by 0
  22. 2025Learn A Flexible Exploration Model for Parameterized Action Markov Decision Processescited by 0
  23. 2025Distributions as Actions: A Unified Framework for Diverse Action Spacescited by 0
  24. 2025Pose-RFT: Enhancing MLLMs for 3D Pose Generation via Hybrid Action Reinforcement Fine-Tuningcited by 0
  25. 2025TransLLM: A Unified Multi-Task Foundation Framework for Urban Transportation via Learnable Promptingcited by 0
  26. 2025Joint AoI and Handover Optimization in Space-Air-Ground Integrated Networkcited by 0
  27. 2025Integrated Communication and Control for Energy-Efficient UAV Swarms: A Multi-Agent Reinforcement Learning Approachcited by 0
  28. 2025Learning to Drive Safely with Hybrid Optionscited by 0
  29. 2025Hybrid DQN-TD3 Reinforcement Learning for Autonomous Navigation in Dynamic Environmentscited by 0
  30. 2025A Hybrid Proactive And Predictive Framework For Edge Cloud Resource Managementcited by 0
  31. 2025FM-EAC: Feature Model-based Enhanced Actor-Critic for Multi-Task Control in Dynamic Environmentscited by 0
  32. 2025Context-Sensitive Abstractions for Reinforcement Learning with Parameterized Actionscited by 0
  33. 2026CHDP: Cooperative Hybrid Diffusion Policies for Reinforcement Learning in Parameterized Action Spacecited by 0
  34. 2026Cross-reality location privacy protection in 6G-enabled vehicular metaverses: an LLM-enhanced hybrid generative diffusion model-based approachcited by 0
  35. 2026RulePlanner: All-in-One Reinforcement Learner for Unifying Design Rules in 3D Floorplanningcited by 0
  36. 2026Breaking the Grid: Distance-Guided Reinforcement Learning in Large Discrete Action Spacescited by 0
  37. 2026Temporal Action Representation Learning for Tactical Resource Control and Subsequent Maneuver Generationcited by 0
  38. 2026Revisiting Action Factorization for Complex Action Spacescited by 0

50 most cited of 54 All 54 (JSON)