JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading
Not on the map. Why?
Abstract (arXiv)
Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been implemented in the context of agent-based models (ABMs), reinforcement learning (RL) environments, and generative models, processing order flows from historical data sets and hand-crafted agents alike. For many applications, there is a requirement for processing multiple books, either for the calibration of ABMs or for the training of RL agents. We showcase the first GPU-enabled LOB simulator designed to process thousands of books in parallel, with a notably reduced per-message processing time. The implementation of our simulator - JAX-LOB - is based on design choices that aim to best exploit the powers of JAX without compromising on the realism of LOB-related mechanisms. We integrate JAX-LOB with other JAX packages, to provide an example of how one may address an optimal execution problem with reinforcement learning, and to share some preliminary results from end-to-end RL training on GPUs.
Key facts. Cited by 13 papers in the map (data through 13 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
15 of 45 references.
References · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2017Proximal Policy Optimization Algorithmscited by 14,592
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,710
- 2021Machine learning accelerated computational fluid dynamicscited by 465
- 2022Discovered Policy Optimisationcited by 103
- 2018Market Making via Reinforcement Learningcited by 45
- 2018Double Deep Q-Learning for Optimal Executioncited by 41
- 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 41
- 2019Reinforcement Learning for Market Making in a Multi-agent Dealer Marketcited by 35
- 2021ABIDES-Gym: Gym Environments for Multi-Agent Discrete Event Simulation and Application to Financial Marketscited by 34
- 2020Fast Agent-Based Simulation Framework with Applications to Reinforcement Learning and the Study of Trading Latency Effectscited by 5
- 2022Market Making with Scaled Beta Policiescited by 5
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 5; 2026: 3.
13 papers.
Sort:
By area:
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAXcited by 61
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
- 2023minimax: Efficient Baselines for Autocurricula in JAXcited by 9
- 2025StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Marketscited by 8
- 2024Deep Limit Order Book Forecastingcited by 7
- 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Datacited by 4
- 2026FinEvo: From Isolated Backtests to Ecological Market Games for Multi-Agent Financial Strategy Evolutioncited by 2
- 2025Reinforcement Learning-Based Market Making as a Stochastic Control on Non-Stationary Limit Order Book Dynamicscited by 1
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learningcited by 0
- 2025Revisiting Ensemble Methods for Stock Trading and Crypto Trading Tasks at ACM ICAIF FinRL Contest 2023-2024cited by 0
- 2025PB2: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learningcited by 0
- 2026ReLOBGen: Replayable Limit Order Book Message Generationcited by 0
- 2026Mixture-of-Experts for Cryptocurrency Order Execution: Training Stability, Tail Risk, and Failure Modes2 Oct 2026
- 2026ReLOBGen: Replayable Limit Order Book Message Generation26 Sep 2026
- 2026FinEvo: From Isolated Backtests to Ecological Market Games for Multi-Agent Financial Strategy Evolution1 Feb 2026
- 2025Reinforcement Learning-Based Market Making as a Stochastic Control on Non-Stationary Limit Order Book Dynamics15 Sep 2025
- 2025StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets12 Jul 2025
- 2025PB2: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learning16 Jun 2025
- 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Data13 Feb 2025
- 2025Revisiting Ensemble Methods for Stock Trading and Crypto Trading Tasks at ACM ICAIF FinRL Contest 2023-202418 Jan 2025
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learning22 Dec 2024
- 2024Deep Limit Order Book Forecasting14 Mar 2024
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX19 Dec 2023
- 2023minimax: Efficient Baselines for Autocurricula in JAX21 Nov 2023
1 more
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAX16 Nov 2023
- 2025Reinforcement Learning-Based Market Making as a Stochastic Control on Non-Stationary Limit Order Book Dynamicscited by 1
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learningcited by 0
- 2025Revisiting Ensemble Methods for Stock Trading and Crypto Trading Tasks at ACM ICAIF FinRL Contest 2023-2024cited by 0
- 2025PB2: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learningcited by 0
- 2025Reinforcement Learning-Based Market Making as a Stochastic Control on Non-Stationary Limit Order Book Dynamics15 Sep 2025
- 2025PB2: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learning16 Jun 2025
- 2025Revisiting Ensemble Methods for Stock Trading and Crypto Trading Tasks at ACM ICAIF FinRL Contest 2023-202418 Jan 2025
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learning22 Dec 2024
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAXcited by 61
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
- 2023minimax: Efficient Baselines for Autocurricula in JAXcited by 9
- 2024Deep Limit Order Book Forecastingcited by 7
- 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Datacited by 4
- 2026ReLOBGen: Replayable Limit Order Book Message Generationcited by 0
- 2026ReLOBGen: Replayable Limit Order Book Message Generation26 Sep 2026
- 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Data13 Feb 2025
- 2024Deep Limit Order Book Forecasting14 Mar 2024
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX19 Dec 2023
- 2023minimax: Efficient Baselines for Autocurricula in JAX21 Nov 2023
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAX16 Nov 2023