mlsanityData to 13 Oct 2026

JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading

arXiv 2308.13289 ↗First posted 25 Aug 2023q-fin.TR cs.AI cs.CEcited by 13

Not on the map. Why?

Abstract (arXiv)

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been implemented in the context of agent-based models (ABMs), reinforcement learning (RL) environments, and generative models, processing order flows from historical data sets and hand-crafted agents alike. For many applications, there is a requirement for processing multiple books, either for the calibration of ABMs or for the training of RL agents. We showcase the first GPU-enabled LOB simulator designed to process thousands of books in parallel, with a notably reduced per-message processing time. The implementation of our simulator - JAX-LOB - is based on design choices that aim to best exploit the powers of JAX without compromising on the realism of LOB-related mechanisms. We integrate JAX-LOB with other JAX packages, to provide an example of how one may address an optimal execution problem with reinforcement learning, and to share some preliminary results from end-to-end RL training on GPUs.

Key facts. Cited by 13 papers in the map (data through 13 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 25 Aug 2023.

Builds on

15 of 45 references.

References · 15

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  2. 2017Proximal Policy Optimization Algorithmscited by 14,592
  3. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,710
  4. 2021Machine learning accelerated computational fluid dynamicscited by 465
  5. 2022Discovered Policy Optimisationcited by 103
  6. 2018Market Making via Reinforcement Learningcited by 45
  7. 2018Double Deep Q-Learning for Optimal Executioncited by 41
  8. 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 41
  9. 2019Reinforcement Learning for Market Making in a Multi-agent Dealer Marketcited by 35
  10. 2021ABIDES-Gym: Gym Environments for Multi-Agent Discrete Event Simulation and Application to Financial Marketscited by 34
  11. 2020Fast Agent-Based Simulation Framework with Applications to Reinforcement Learning and the Study of Trading Latency Effectscited by 5
  12. 2022Market Making with Scaled Beta Policiescited by 5
3 more
  1. 2022Model-based gym environments for limit order book tradingcited by 3
  2. 2023Some challenges of calibrating differentiable agent-based modelscited by 2
  3. 2022Imitate then Transcend: Multi-Agent Optimal Execution with Dual-Window Denoise PPOcited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2023: 3; 2024: 2; 2025: 5; 2026: 3.

13 papers.

Sort:

By area: