Asynchronous training of quantum reinforcement learning
Not on the map. Why?
Abstract (arXiv)
The development of quantum machine learning (QML) has received a lot of interest recently thanks to developments in both quantum computing (QC) and machine learning (ML). One of the ML paradigms that can be utilized to address challenging sequential decision-making issues is reinforcement learning (RL). It has been demonstrated that classical RL can successfully complete many difficult tasks. A leading method of building quantum RL agents relies on the variational quantum circuits (VQC). However, training QRL algorithms with VQCs requires significant amount of computational resources. This issue hurdles the exploration of various QRL applications. In this paper, we approach this challenge through asynchronous training QRL agents. Specifically, we choose the asynchronous training of advantage actor-critic variational quantum policies. We demonstrate the results via numerical simulations that within the tasks considered, the asynchronous training of QRL agents can reach performance comparable to or superior than classical agents with similar model sizes and architectures.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 12 Jan 2023.
Builds on
29 of 47 references.
References · 29
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2016OpenAI Gymcited by 1,684
- 2020Variational Quantum Algorithmscited by 687
- 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 165
- 2020Quantum Long Short-Term Memorycited by 118
- 2021Federated Quantum Machine Learningcited by 82
- 2021Noisy intermediate-scale quantum (NISQ) algorithmscited by 79
- 2020Reinforcement Learning with Quantum Variational Circuitscited by 74
- 2020Quantum Convolutional Neural Networks for High Energy Physics Data Analysiscited by 64
- 2021The Dawn of Quantum Natural Language Processingcited by 60
- 2020Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognitioncited by 56
- 2021Quantum Federated Learning with Quantum Datacited by 53
17 more
- 2021Variational Quantum Reinforcement Learning via Evolutionary Optimizationcited by 50
- 2022A Survey on Quantum Reinforcement Learningcited by 50
- 2021An end-to-end trainable hybrid classical-quantum classifiercited by 49
- 2022When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computingcited by 40
- 2020Quantum reinforcement learning in continuous action spacecited by 27
- 2021QTN-VQC: An End-to-End Learning framework for Quantum Neural Networkscited by 27
- 2022Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Designcited by 25
- 2022Quantum Multi-Agent Meta Reinforcement Learningcited by 23
- 2022Quantum deep recurrent reinforcement learningcited by 23
- 2022Quantum Policy Iteration via Amplitude Estimation and Grover Search -- Towards Quantum Advantage for Reinforcement Learningcited by 21
- 2022Quantum Policy Gradient Algorithm with Optimized Action Decodingcited by 21
- 2022Quantum Reinforcement Learning via Policy Iterationcited by 19
- 2022Quantum policy gradient algorithmscited by 15
- 2021Variational Quantum Soft Actor-Criticcited by 14
- 2022Quantum Deep Reinforcement Learning for Robot Navigation Taskscited by 14
- 2022Reservoir Computing via Quantum Recurrent Neural Networkscited by 14
- 2022Variational Quantum Soft Actor-Critic for Robotic Arm Controlcited by 7
Built on by
Citing papers per year: 2023: 2; 2024: 9; 2025: 6; 2026: 3.
20 papers.
Sort:
- 2024Quantum Architecture Search: A Surveycited by 31
- 2024Learning to Program Variational Quantum Circuits with Fast Weightscited by 23
- 2023Efficient quantum recurrent reinforcement learning via quantum reservoir computingcited by 14
- 2024Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learningcited by 13
- 2024Quantum Advantage Actor-Critic for Reinforcement Learningcited by 9
- 2024Evolutionary Optimization for Designing Variational Quantum Circuits with High Model Capacitycited by 9
- 2024eQMARL: Entangled Quantum Multi-Agent Reinforcement Learning for Distributed Cooperation over Quantum Channelscited by 7
- 2024An Introduction to Quantum Reinforcement Learning (QRL)cited by 7
- 2025Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generationcited by 7
- 2025Learning to Program Quantum Measurements for Machine Learningcited by 7
- 2025Quantum Reinforcement Learning by Adaptive Non-local Observablescited by 5
- 2024Machine Learning Applications of Quantum Computing: A Reviewcited by 4
8 more
- 2025Q-Fusion: Diffusing Quantum Circuitscited by 4
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learningcited by 4
- 2025Introduction to Quantum Machine Learning and Quantum Architecture Searchcited by 3
- 2023Quantum deep Q learning with distributed prioritized experience replaycited by 2
- 2024Quantum Machine Learning: An Interplay Between Quantum Computing and Machine Learningcited by 2
- 2026Quantum Hierarchical Reinforcement Learning via Variational Quantum Circuitscited by 2
- 2025Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Tradingcited by 1
- 2026Diagonal Adaptive Non-local Observables on Quantum Neural Networkscited by 0
- 2026Diagonal Adaptive Non-local Observables on Quantum Neural Networks14 May 2026
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning7 May 2026
- 2026Quantum Hierarchical Reinforcement Learning via Variational Quantum Circuits5 May 2026
- 2025Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Trading11 Sep 2025
- 2025Quantum Reinforcement Learning by Adaptive Non-local Observables25 Jul 2025
- 2025Learning to Program Quantum Measurements for Machine Learning18 May 2025
- 2025Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generation13 May 2025
- 2025Q-Fusion: Diffusing Quantum Circuits29 Apr 2025
- 2025Introduction to Quantum Machine Learning and Quantum Architecture Search21 Apr 2025
- 2024Evolutionary Optimization for Designing Variational Quantum Circuits with High Model Capacity17 Dec 2024
- 2024Quantum Machine Learning: An Interplay Between Quantum Computing and Machine Learning14 Nov 2024
- 2024An Introduction to Quantum Reinforcement Learning (QRL)9 Sep 2024
8 more
- 2024Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learning25 Jul 2024
- 2024Machine Learning Applications of Quantum Computing: A Review19 Jun 2024
- 2024Quantum Architecture Search: A Survey10 Jun 2024
- 2024eQMARL: Entangled Quantum Multi-Agent Reinforcement Learning for Distributed Cooperation over Quantum Channels24 May 2024
- 2024Learning to Program Variational Quantum Circuits with Fast Weights27 Feb 2024
- 2024Quantum Advantage Actor-Critic for Reinforcement Learning13 Jan 2024
- 2023Efficient quantum recurrent reinforcement learning via quantum reservoir computing13 Sep 2023
- 2023Quantum deep Q learning with distributed prioritized experience replay19 Apr 2023
- 2024Quantum Architecture Search: A Surveycited by 31
- 2024Learning to Program Variational Quantum Circuits with Fast Weightscited by 23
- 2023Efficient quantum recurrent reinforcement learning via quantum reservoir computingcited by 14
- 2024Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learningcited by 13
- 2024Quantum Advantage Actor-Critic for Reinforcement Learningcited by 9
- 2024Evolutionary Optimization for Designing Variational Quantum Circuits with High Model Capacitycited by 9
- 2024eQMARL: Entangled Quantum Multi-Agent Reinforcement Learning for Distributed Cooperation over Quantum Channelscited by 7
- 2024An Introduction to Quantum Reinforcement Learning (QRL)cited by 7
- 2025Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generationcited by 7
- 2025Learning to Program Quantum Measurements for Machine Learningcited by 7
- 2025Quantum Reinforcement Learning by Adaptive Non-local Observablescited by 5
- 2024Machine Learning Applications of Quantum Computing: A Reviewcited by 4
12 most cited of 20 All 20 (JSON)
- 2026Diagonal Adaptive Non-local Observables on Quantum Neural Networks14 May 2026
- 2026Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning7 May 2026
- 2026Quantum Hierarchical Reinforcement Learning via Variational Quantum Circuits5 May 2026
- 2025Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Trading11 Sep 2025
- 2025Quantum Reinforcement Learning by Adaptive Non-local Observables25 Jul 2025
- 2025Learning to Program Quantum Measurements for Machine Learning18 May 2025
- 2025Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generation13 May 2025
- 2025Q-Fusion: Diffusing Quantum Circuits29 Apr 2025
- 2025Introduction to Quantum Machine Learning and Quantum Architecture Search21 Apr 2025
- 2024Evolutionary Optimization for Designing Variational Quantum Circuits with High Model Capacity17 Dec 2024
- 2024Quantum Machine Learning: An Interplay Between Quantum Computing and Machine Learning14 Nov 2024
- 2024An Introduction to Quantum Reinforcement Learning (QRL)9 Sep 2024
12 newest of 20 All 20 (JSON)