# Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning

arXiv: https://arxiv.org/abs/2210.03469 · HTML: https://mlsanity.com/paper/2210.03469/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 2 of its 28 references that are in the map.
- First posted on arXiv 7 Oct 2022.

## Builds on (most cited first, 2 of 2)

- [Addressing Function Approximation Error in Actor-Critic Methods](https://mlsanity.com/paper/1802.09477/) (2018)
- [An Application of Deep Reinforcement Learning to Algorithmic Trading](https://mlsanity.com/paper/2004.06627/) (2020)

## Built on by (most cited first, 4 of 4)

- [On-line reinforcement learning for optimization of real-life energy trading strategy](https://mlsanity.com/paper/2303.16266/) (2023)
- [A Deep Reinforcement Learning Approach for Trading Optimization in the Forex Market with Multi-Agent Asynchronous Distribution](https://mlsanity.com/paper/2405.19982/) (2024)
- [A Multisource Fusion Framework for Cryptocurrency Price Movement Prediction](https://mlsanity.com/paper/2409.18895/) (2024)
- [Technical Indicator Networks (TINs): An Interpretable Neural Architecture Modernizing Classic al Technical Analysis for Adaptive Algorithmic Trading](https://mlsanity.com/paper/2507.20202/) (2025)

## Abstract (arXiv)

Price movement prediction has always been one of the traders' concerns in financial market trading. In order to increase their profit, they can analyze the historical data and predict the price movement. The large size of the data and complex relations between them lead us to use algorithmic trading and artificial intelligence. This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Unlike previous studies using a discrete action space reinforcement learning algorithm, the TD3 is continuous, offering both position and the number of trading shares. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm. The achieved strategy using the TD3 is compared with some algorithms using technical analysis, reinforcement learning, stochastic, and deterministic strategies through two standard metrics, Return and Sharpe ratio. The results indicate that employing both position and the number of trading shares can improve the performance of a trading system based on the mentioned metrics.