Quantum Reinforcement Learning Trading Agent for Sector Rotation in the Taiwan Stock Market
On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance
Abstract (arXiv)
We propose a hybrid quantum-classical reinforcement learning framework for sector rotation in the Taiwan stock market. Our system employs Proximal Policy Optimization (PPO) as the backbone algorithm and integrates both classical architectures (LSTM, Transformer) and quantum-enhanced models (QNN, QRWKV, QASA) as policy and value networks. An automated feature engineering pipeline extracts financial indicators from capital share data to ensure consistent model input across all configurations. Empirical backtesting reveals a key finding: although quantum-enhanced models consistently achieve higher training rewards, they underperform classical models in real-world investment metrics such as cumulative return and Sharpe ratio. This discrepancy highlights a core challenge in applying reinforcement learning to financial domains -- namely, the mismatch between proxy reward signals and true investment objectives. Our analysis suggests that current reward designs may incentivize overfitting to short-term volatility rather than optimizing risk-adjusted returns. This issue is compounded by the inherent expressiveness and optimization instability of quantum circuits under Noisy Intermediate-Scale Quantum (NISQ) constraints. We discuss the implications of this reward-performance gap and propose directions for future improvement, including reward shaping, model regularization, and validation-based early stopping. Our work offers a reproducible benchmark and critical insights into the practical challenges of deploying quantum reinforcement learning in real-world finance.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 7 of its 14 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
7 of 14 references.
References · 7
- 2017Attention Is All You Needcited by 60,361
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016Quantum Machine Learningcited by 326
- 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 167
- 2021Quantum Architecture Search via Deep Reinforcement Learningcited by 60
- 2021Variational Quantum Reinforcement Learning via Evolutionary Optimizationcited by 50
- 2025Quantum Adaptive Self-Attention for Quantum Transformer Modelscited by 14
Built on by
Citing papers per year: 2025: 5.
5 papers.
- 2025Benchmarking Quantum and Classical Sequential Models for Urban Telecommunication Forecastingcited by 5
- 2025Quantum Reinforcement Learning-Guided Diffusion Model for Image Synthesis via Hybrid Quantum-Classical Generative Model Architecturescited by 2
- 2025Q-DPTS: Quantum Differentially Private Time Series Forecasting via Variational Quantum Circuitscited by 1
- 2025Quantum Temporal Convolutional Neural Networks for Cross-Sectional Equity Return Prediction: A Comparative Benchmark Studycited by 1
- 2025Quantum and Classical Machine Learning in Decentralized Finance: Comparative Evidence from Multi-Asset Backtesting of Automated Market Makerscited by 0
- 2025Quantum Temporal Convolutional Neural Networks for Cross-Sectional Equity Return Prediction: A Comparative Benchmark Study7 Dec 2025
- 2025Quantum Reinforcement Learning-Guided Diffusion Model for Image Synthesis via Hybrid Quantum-Classical Generative Model Architectures17 Sep 2025
- 2025Quantum and Classical Machine Learning in Decentralized Finance: Comparative Evidence from Multi-Asset Backtesting of Automated Market Makers14 Sep 2025
- 2025Q-DPTS: Quantum Differentially Private Time Series Forecasting via Variational Quantum Circuits7 Aug 2025
- 2025Benchmarking Quantum and Classical Sequential Models for Urban Telecommunication Forecasting6 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Trading
- 2026Variational Quantum Circuit-Based Reinforcement Learning for Dynamic Portfolio Optimization
- 2024QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction
- 2026Titans-QFWP: A Regime-Aware Hybrid Quantum Fast Weight Programmer for Portfolio Optimization
- 2026Mitigating Bias in Low-SNR Financial Reinforcement Learning via Quantum Representations
- 2026The Enhanced Physics-Informed Kolmogorov-Arnold Networks: Applications of Newton's Laws in Financial Deep Reinforcement Learning (RL) Algorithms
- 2024The Evolution of Reinforcement Learning in Quantitative Finance: A Survey
- 2025Financial Decision Making using Reinforcement Learning with Dirichlet Priors and Quantum-Inspired Genetic Optimization