mlsanityData to 14 Oct 2026

Stock Trading Optimization through Model-based Reinforcement Learning with Resistance Support Relative Strength

arXiv 2205.15056 ↗First posted 30 May 2022q-fin.MF cs.LG q-fin.PMcited by 0

Not on the map. Why?

Abstract (arXiv)

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems. Most of the current financial applications using RL algorithms are based on model-free method, which still faces stability and adaptivity challenges. As lots of cutting-edge model-based reinforcement learning (MBRL) algorithms mature in applications such as video games or robotics, we design a new approach that leverages resistance and support (RS) level as regularization terms for action in MBRL, to improve the algorithm's efficiency and stability. From the experiment results, we can see RS level, as a market timing technique, enhances the performance of pure MBRL models in terms of various measurements and obtains better profit gain with less riskiness. Besides, our proposed method even resists big drop (less maximum drawdown) during COVID-19 pandemic period when the financial market got unpredictable crisis. Explanations on why control of resistance and support level can boost MBRL is also investigated through numerical experiments, such as loss of actor-critic network and prediction error of the transition dynamical model. It shows that RS indicators indeed help the MBRL algorithms to converge faster at early stage and obtain smaller critic loss as training episodes increase.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 30 May 2022.

Builds on

18 of 33 references.

References · 18

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2015Continuous control with deep reinforcement learningcited by 3,407
  4. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  5. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  6. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  7. 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
  8. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
  9. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 773
  10. 2018Model-Based Value Estimation for Efficient Model-Free Reinforcement Learningcited by 156
  11. 2018Practical Deep Reinforcement Learning Approach for Stock Tradingcited by 49
  12. 2020Bidirectional Model-based Policy Optimizationcited by 38
6 more
  1. 2020Trust the Model When It Is Confident: Masked Model-based Actor-Criticcited by 36
  2. 2019Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimizationcited by 22
  3. 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
  4. 2020Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithmscited by 17
  5. 2019Global Stock Market Prediction Based on Stock Chart Images Using Deep Q-Networkcited by 3
  6. 2016Modelling Stock-market Investors as Reinforcement Learning Agents [Correction]cited by 1

Built on by

Not cited yet.