Quantum Policy Gradient Algorithm with Optimized Action Decoding
Not on the map. Why?
Abstract (arXiv)
Quantum machine learning implemented by variational quantum circuits (VQCs) is considered a promising concept for the noisy intermediate-scale quantum computing era. Focusing on applications in quantum reinforcement learning, we propose a specific action decoding procedure for a quantum policy gradient approach. We introduce a novel quality measure that enables us to optimize the classical post-processing required for action selection, inspired by local and global quantum measurements. The resulting algorithm demonstrates a significant performance improvement in several benchmark environments. With this technique, we successfully execute a full training routine on a 5-qubit hardware device. Our method introduces only negligible classical overhead and has the potential to improve VQC-based algorithms beyond the field of quantum reinforcement learning.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 22 of its 63 references that are in the map. First posted on arXiv 13 Dec 2022.
Builds on
22 of 63 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016OpenAI Gymcited by 1,684
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2019On the Convergence of Adam and Beyondcited by 834
- 2020Variational Quantum Algorithmscited by 687
- 2018Barren plateaus in quantum neural network training landscapescited by 624
- 2020The power of quantum neural networkscited by 377
- 2019Parameterized quantum circuits as machine learning modelscited by 330
- 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 328
- 2020A rigorous and robust quantum speed-up in supervised machine learningcited by 270
- 2020Predicting Many Properties of a Quantum System from Very Few Measurementscited by 229
- 2021Supervised quantum machine learning models are kernel methodscited by 199
10 more
- 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 165
- 2021Parametrized quantum policies for reinforcement learningcited by 87
- 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
- 2020On the Quantum versus Classical Learnability of Discrete Distributionscited by 57
- 2022A Survey on Quantum Reinforcement Learningcited by 50
- 2020Universal Approximation Property of Quantum Machine Learning Models in Quantum-Enhanced Feature Spacescited by 44
- 2020Quantum reinforcement learning in continuous action spacecited by 27
- 2021Introduction to Quantum Reinforcement Learning: Theory and PennyLane-based Implementationcited by 23
- 2022Uncovering Instabilities in Variational-Quantum Deep Q-Networkscited by 14
- 2022Incremental Data-Uploading for Full-Quantum Classificationcited by 13
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 10; 2025: 6.
21 papers.
Sort:
- 2023Asynchronous training of quantum reinforcement learningcited by 20
- 2022Quantum policy gradient algorithmscited by 15
- 2024Quantum Advantage Actor-Critic for Reinforcement Learningcited by 9
- 2025Benchmarking Quantum Reinforcement Learningcited by 9
- 2025A Primer on Quantum Machine Learningcited by 9
- 2024Qiskit-Torch-Module: Fast Prototyping of Quantum Neural Networkscited by 8
- 2023Quantum Natural Policy Gradients: Towards Sample-Efficient Reinforcement Learningcited by 6
- 2024Warm-Start Variational Quantum Policy Iterationcited by 4
- 2024Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rulecited by 4
- 2024Trainability issues in quantum policy gradientscited by 4
- 2024Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularizationcited by 4
- 2024Fourier Analysis of Variational Quantum Circuits for Supervised Learningcited by 4
9 more
- 2023BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploadingcited by 3
- 2025Predictive Performance of Deep Quantum Data Re-uploading Modelscited by 3
- 2023Quantum deep Q learning with distributed prioritized experience replaycited by 2
- 2024Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimizationcited by 2
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Modelscited by 2
- 2025Dissecting Quantum Reinforcement Learning: A Systematic Evaluation of Key Componentscited by 2
- 2024Hype or Heuristic? Quantum Reinforcement Learning for Join Order Optimisationcited by 1
- 2024On Quantum Natural Policy Gradientscited by 0
- 2025CutReg: A loss regularizer for enhancing the scalability of QML via adaptive circuit cuttingcited by 0
- 2025Dissecting Quantum Reinforcement Learning: A Systematic Evaluation of Key Components21 Nov 2025
- 2025A Primer on Quantum Machine Learning20 Nov 2025
- 2025CutReg: A loss regularizer for enhancing the scalability of QML via adaptive circuit cutting17 Jun 2025
- 2025Predictive Performance of Deep Quantum Data Re-uploading Models24 May 2025
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Models15 May 2025
- 2025Benchmarking Quantum Reinforcement Learning27 Jan 2025
- 2024Fourier Analysis of Variational Quantum Circuits for Supervised Learning5 Nov 2024
- 2024Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization28 Oct 2024
- 2024Trainability issues in quantum policy gradients13 Jun 2024
- 2024Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimization13 May 2024
- 2024Hype or Heuristic? Quantum Reinforcement Learning for Join Order Optimisation13 May 2024
- 2024Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rule24 Apr 2024
9 more
- 2024Warm-Start Variational Quantum Policy Iteration16 Apr 2024
- 2024Qiskit-Torch-Module: Fast Prototyping of Quantum Neural Networks9 Apr 2024
- 2024On Quantum Natural Policy Gradients16 Jan 2024
- 2024Quantum Advantage Actor-Critic for Reinforcement Learning13 Jan 2024
- 2023BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploading27 Apr 2023
- 2023Quantum Natural Policy Gradients: Towards Sample-Efficient Reinforcement Learning26 Apr 2023
- 2023Quantum deep Q learning with distributed prioritized experience replay19 Apr 2023
- 2023Asynchronous training of quantum reinforcement learning12 Jan 2023
- 2022Quantum policy gradient algorithms19 Dec 2022
- 2023Asynchronous training of quantum reinforcement learningcited by 20
- 2022Quantum policy gradient algorithmscited by 15
- 2024Quantum Advantage Actor-Critic for Reinforcement Learningcited by 9
- 2025Benchmarking Quantum Reinforcement Learningcited by 9
- 2025A Primer on Quantum Machine Learningcited by 9
- 2024Qiskit-Torch-Module: Fast Prototyping of Quantum Neural Networkscited by 8
- 2023Quantum Natural Policy Gradients: Towards Sample-Efficient Reinforcement Learningcited by 6
- 2024Warm-Start Variational Quantum Policy Iterationcited by 4
- 2024Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rulecited by 4
- 2024Trainability issues in quantum policy gradientscited by 4
- 2024Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularizationcited by 4
- 2024Fourier Analysis of Variational Quantum Circuits for Supervised Learningcited by 4
12 most cited of 21 All 21 (JSON)
- 2025Dissecting Quantum Reinforcement Learning: A Systematic Evaluation of Key Components21 Nov 2025
- 2025A Primer on Quantum Machine Learning20 Nov 2025
- 2025CutReg: A loss regularizer for enhancing the scalability of QML via adaptive circuit cutting17 Jun 2025
- 2025Predictive Performance of Deep Quantum Data Re-uploading Models24 May 2025
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Models15 May 2025
- 2025Benchmarking Quantum Reinforcement Learning27 Jan 2025
- 2024Fourier Analysis of Variational Quantum Circuits for Supervised Learning5 Nov 2024
- 2024Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization28 Oct 2024
- 2024Trainability issues in quantum policy gradients13 Jun 2024
- 2024Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimization13 May 2024
- 2024Hype or Heuristic? Quantum Reinforcement Learning for Join Order Optimisation13 May 2024
- 2024Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rule24 Apr 2024
12 newest of 21 All 21 (JSON)