mlsanityData to 14 Oct 2026

ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility

arXiv 2508.16589 ↗First posted 7 Aug 2025q-fin.TR cs.AI econ.GNcited by 2

On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance

Abstract (arXiv)

We advance market-making strategies by integrating Adversarial Reinforcement Learning (ARL), Hawkes Processes, and variable volatility levels while also expanding the action space available to market makers (MMs). To enhance the adaptability and robustness of these strategies -- which can quote always, quote only on one side of the market or not quote at all -- we shift from the commonly used Poisson process to the Hawkes process, which better captures real market dynamics and self-exciting behaviors. We then train and evaluate strategies under volatility levels of 2 and 200. Our findings show that the 4-action MM trained in a low-volatility environment effectively adapts to high-volatility conditions, maintaining stable performance and providing two-sided quotes at least 92% of the time. This indicates that incorporating flexible quoting mechanisms and realistic market simulations significantly enhances the effectiveness of market-making strategies.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 33 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

2 of 33 references.

References · 2

  1. 2018Market Making via Reinforcement Learningcited by 47
  2. 2020Robust Market Making via Adversarial Reinforcement Learningcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Multi-Agent Reinforcement Learning for Market Making: Competition without Collusioncited by 2
  2. 2026Robust Market Making with Hawkes Order Flow and Price Impact via Adversarial Reinforcement Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Robust Market Making: To Quote, or not To Quote
  2. 2026Reinforcement Learning with Hawkes-Structured Networks for Market Making
  3. 2025Generative Market Equilibrium Models with Stable Adversarial Learning via Reinforcement
  4. 2026Can Reinforcement Learning Efficiently Discover Price Manipulation?
  5. 2023IMM: An Imitative Reinforcement Learning Approach with Predictive Representation Learning for Automatic Market Making
  6. 2025Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios
  7. 2025When AI Trading Agents Compete: Adverse Selection of Meta-Orders by Reinforcement Learning-Based Market Making
  8. 2025Reinforcement Learning-Based Market Making as a Stochastic Control on Non-Stationary Limit Order Book Dynamics