Deep Reinforcement Learning for Trading
Not on the map. Why?
Abstract (arXiv)
We adopt Deep Reinforcement Learning algorithms to design trading strategies for continuous futures contracts. Both discrete and continuous action spaces are considered and volatility scaling is incorporated to create reward functions which scale trade positions based on market volatility. We test our algorithms on the 50 most liquid futures contracts from 2011 to 2019, and investigate how performance varies across different asset classes including commodities, equity indices, fixed income and FX markets. We compare our algorithms against classical time series momentum strategies, and show that our method outperforms such baseline models, delivering positive profits despite heavy transaction costs. The experiments show that the proposed algorithms can follow large market trends without changing positions and can also scale down, or hold, through consolidation periods.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 14; 2023: 13; 2024: 11; 2025: 13; 2026: 7.
73 papers.
Sort:
By area:
- 2021Recent Advances in Reinforcement Learning in Financecited by 102
- 2021FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Financecited by 57
- 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?cited by 43
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2021Reinforcement Learning for Quantitative Tradingcited by 24
- 2025FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Tradingcited by 23
- 2021Deep Reinforcement Learning for Active High Frequency Tradingcited by 21
- 2022Offline Reinforcement Learning with Differential Privacycited by 19
- 2021Deep Reinforcement Learning in Quantitative Algorithmic Trading: A Reviewcited by 17
- 2023Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approachcited by 17
- 2021Trading with the Momentum Transformer: An Intelligent and Interpretable Architecturecited by 16
- 2022GALOIS: Boosting Deep Reinforcement Learning via Generalizable Logic Synthesiscited by 16
38 more
- 2023Dynamic Datasets and Market Environments for Financial Reinforcement Learningcited by 15
- 2025Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategycited by 15
- 2021DeepScalper: A Risk-Aware Reinforcement Learning Framework to Capture Fleeting Intraday Trading Opportunitiescited by 14
- 2022A Novel Deep Reinforcement Learning Based Automated Stock Trading System Using Cascaded LSTM Networkscited by 12
- 2024The Evolution of Reinforcement Learning in Quantitative Finance: A Surveycited by 11
- 2021Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Unitscited by 10
- 2021Deep Learning for Market by Order Datacited by 8
- 2021Realised Volatility Forecasting: Machine Learning via Financial Word Embeddingcited by 7
- 2021Quantum Machine Learning for Financecited by 7
- 2024MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Tradingcited by 7
- 2024In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminatescited by 7
- 2023The AI Revolution: Opportunities and Challenges for the Finance Sectorcited by 6
- 2022Deep Reinforcement Learning for Cryptocurrency Trading: Practical Approach to Address Backtest Overfittingcited by 5
- 2023PRUDEX-Compass: Towards Systematic Evaluation of Reinforcement Learning in Financial Marketscited by 5
- 2025TRADES: Generating Realistic Market Simulations with Diffusion Modelscited by 5
- 2022The Recurrent Reinforcement Learning Crypto Agentcited by 4
- 2024Advancing Investment Frontiers: Industry-grade Deep Reinforcement Learning for Portfolio Optimizationcited by 4
- 2025TLOB: A Novel Transformer Model with Dual Attention for Price Trend Prediction with Limit Order Book Datacited by 4
- 2026Can Blindfolded LLMs Still Trade? An Anonymization-First Framework for Portfolio Optimizationcited by 4
- 2021Reinforcement Learning with Expert Trajectory For Quantitative Tradingcited by 3
- 2021Reinforcement Learning for Systematic FX Tradingcited by 3
- 2023Neuro-symbolic Meta Reinforcement Learning for Tradingcited by 3
- 2024CNN-DRL with Shuffled Features in Financecited by 3
- 2024Explainable Post hoc Portfolio Management Financial Policy of a Deep Reinforcement Learning agentcited by 3
- 2025FlowHFT: Imitation Learning via Flow Matching Policy for Optimal High-Frequency Trading under Diverse Market Conditionscited by 3
- 2021A Reinforcement Learning Based Encoder-Decoder Framework for Learning Stock Trading Rulescited by 2
- 2021High-Dimensional Stock Portfolio Trading with Deep Reinforcement Learningcited by 2
- 2022ARLO: A Framework for Automated Reinforcement Learningcited by 2
- 2022Markov Decision Processes under Model Uncertaintycited by 2
- 2022Applications of Reinforcement Learning in Finance -- Trading with a Double Deep Q-Networkcited by 2
- 2024FinLLM-B: When Large Language Models Meet Financial Breakout Tradingcited by 2
- 2025Predicting Liquidity-Aware Bond Yields using Causal GANs and Deep Reinforcement Learning with LLM Evaluationcited by 2
- 2026Deep Reinforcement Learning for Optimal Portfolio Allocation: A Comparative Study with Mean-Variance Optimizationcited by 2
- 2022Financial Vision Based Reinforcement Learning Trading Strategycited by 1
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learningcited by 1
- 2023Improving International Climate Policy via Mutually Conditional Binding Commitmentscited by 1
- 2023Conservative Predictions on Noisy Financial Datacited by 1
- 2024Reinforcement Learning Pair Trading: A Dynamic Scaling approachcited by 1
50 most cited of 73 All 73 (JSON)
- 2026ViperQ: Order Flow Pattern Recognition via Auction Market Theory for Reinforcement Learning Trading12 Sep 2026
- 2026Self-Supervised Auxiliary Task Discovery for Stable Reinforcement Learning in Stock Trading16 Aug 2026
- 2026AlgoEvolve: LLM-driven Meta-evolution of Algorithmic Trading Programs24 Jun 2026
- 2026Optimal Stop-Loss and Take-Profit Parameterization for Autonomous Trading Agent Swarm29 Apr 2026
- 2026Can Blindfolded LLMs Still Trade? An Anonymization-First Framework for Portfolio Optimization18 Mar 2026
- 2026Deep Reinforcement Learning for Optimal Portfolio Allocation: A Comparative Study with Mean-Variance Optimization19 Feb 2026
- 2026Variational Quantum Circuit-Based Reinforcement Learning for Dynamic Portfolio Optimization20 Jan 2026
- 2025Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy15 Nov 2025
- 2025Deep reinforcement learning for optimal trading with partial information31 Oct 2025
- 2025Hierarchical AI Multi-Agent Fundamental Investing: Evidence from China's A-Share Market24 Oct 2025
- 2025Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets22 Oct 2025
- 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?2 Oct 2025
38 more
- 2025FlowHFT: Imitation Learning via Flow Matching Policy for Optimal High-Frequency Trading under Diverse Market Conditions9 May 2025
- 2025Bridging Econometrics and AI: VaR Estimation via Reinforcement Learning and GARCH Models23 Apr 2025
- 2025Predicting Liquidity-Aware Bond Yields using Causal GANs and Deep Reinforcement Learning with LLM Evaluation24 Feb 2025
- 2025FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Trading17 Feb 2025
- 2025TLOB: A Novel Transformer Model with Dual Attention for Price Trend Prediction with Limit Order Book Data12 Feb 2025
- 2025TRADES: Generating Realistic Market Simulations with Diffusion Models31 Jan 2025
- 2025Revisiting Ensemble Methods for Stock Trading and Crypto Trading Tasks at ACM ICAIF FinRL Contest 2023-202418 Jan 2025
- 2025Risk-averse policies for natural gas futures trading using distributional reinforcement learning8 Jan 2025
- 2024Trading Devil RL: Backdoor attack via Stock market, Bayesian Optimization and Reinforcement Learning23 Dec 2024
- 2024Robot See, Robot Do: Imitation Reward for Noisy Financial Environments13 Nov 2024
- 2024In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminates21 Oct 2024
- 2024The Evolution of Reinforcement Learning in Quantitative Finance: A Survey20 Aug 2024
- 2024Reinforcement Learning Pair Trading: A Dynamic Scaling approach23 Jul 2024
- 2024Explainable Post hoc Portfolio Management Financial Policy of a Deep Reinforcement Learning agent19 Jul 2024
- 2024MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Trading20 Jun 2024
- 2024A review on data-driven constitutive laws for solids6 May 2024
- 2024Advancing Investment Frontiers: Industry-grade Deep Reinforcement Learning for Portfolio Optimization27 Feb 2024
- 2024FinLLM-B: When Large Language Models Meet Financial Breakout Trading12 Feb 2024
- 2024CNN-DRL with Shuffled Features in Finance16 Jan 2024
- 2023Conservative Predictions on Noisy Financial Data18 Oct 2023
- 2023The AI Revolution: Opportunities and Challenges for the Finance Sector31 Aug 2023
- 2023Commodities Trading through Deep Policy Gradient Methods10 Aug 2023
- 2023An Ensemble Method of Deep Reinforcement Learning for Automated Cryptocurrency Trading27 Jul 2023
- 2023Improving International Climate Policy via Mutually Conditional Binding Commitments26 Jul 2023
- 2023Improving International Climate Policy via Mutually Conditional Binding Commitments26 Jul 2023
- 2023Deep Reinforcement Learning for Robust Goal-Based Wealth Management25 Jul 2023
- 2023LLQL: Logistic Likelihood Q-Learning for Reinforcement Learning5 Jul 2023
- 2023Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approach28 May 2023
- 2023Dynamic Datasets and Market Environments for Financial Reinforcement Learning25 Apr 2023
- 2023Can Perturbations Help Reduce Investment Risks? Risk-Aware Stock Recommendation via Split Variational Adversarial Training20 Apr 2023
- 2023Neuro-symbolic Meta Reinforcement Learning for Trading15 Jan 2023
- 2023PRUDEX-Compass: Towards Systematic Evaluation of Reinforcement Learning in Financial Markets14 Jan 2023
- 2022A Novel Deep Reinforcement Learning Based Automated Stock Trading System Using Cascaded LSTM Networks6 Dec 2022
- 2022Deep Reinforcement Learning for Cryptocurrency Trading: Practical Approach to Address Backtest Overfitting12 Sep 2022
- 2022An intelligent algorithmic trading based on a risk-return reinforcement learning algorithm23 Aug 2022
- 2022Applications of Reinforcement Learning in Finance -- Trading with a Double Deep Q-Network28 Jun 2022
- 2022Markov Decision Processes under Model Uncertainty13 Jun 2022
- 2022Offline Reinforcement Learning with Differential Privacy2 Jun 2022
50 newest of 73 All 73 (JSON)
- 2021Recent Advances in Reinforcement Learning in Financecited by 102
- 2021FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Financecited by 57
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2021Reinforcement Learning for Quantitative Tradingcited by 24
- 2021Deep Reinforcement Learning for Active High Frequency Tradingcited by 21
- 2021Deep Reinforcement Learning in Quantitative Algorithmic Trading: A Reviewcited by 17
- 2023Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approachcited by 17
- 2021Trading with the Momentum Transformer: An Intelligent and Interpretable Architecturecited by 16
- 2022GALOIS: Boosting Deep Reinforcement Learning via Generalizable Logic Synthesiscited by 16
- 2023Dynamic Datasets and Market Environments for Financial Reinforcement Learningcited by 15
- 2025Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategycited by 15
- 2021DeepScalper: A Risk-Aware Reinforcement Learning Framework to Capture Fleeting Intraday Trading Opportunitiescited by 14
12 most cited of 65 All 65 (JSON)
- 2026ViperQ: Order Flow Pattern Recognition via Auction Market Theory for Reinforcement Learning Trading12 Sep 2026
- 2026Self-Supervised Auxiliary Task Discovery for Stable Reinforcement Learning in Stock Trading16 Aug 2026
- 2026AlgoEvolve: LLM-driven Meta-evolution of Algorithmic Trading Programs24 Jun 2026
- 2026Optimal Stop-Loss and Take-Profit Parameterization for Autonomous Trading Agent Swarm29 Apr 2026
- 2026Can Blindfolded LLMs Still Trade? An Anonymization-First Framework for Portfolio Optimization18 Mar 2026
- 2026Deep Reinforcement Learning for Optimal Portfolio Allocation: A Comparative Study with Mean-Variance Optimization19 Feb 2026
- 2026Variational Quantum Circuit-Based Reinforcement Learning for Dynamic Portfolio Optimization20 Jan 2026
- 2025Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy15 Nov 2025
- 2025Deep reinforcement learning for optimal trading with partial information31 Oct 2025
- 2025Hierarchical AI Multi-Agent Fundamental Investing: Evidence from China's A-Share Market24 Oct 2025
- 2025Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets22 Oct 2025
- 2025Bridging Econometrics and AI: VaR Estimation via Reinforcement Learning and GARCH Models23 Apr 2025
12 newest of 65 All 65 (JSON)