# Policy gradient learning methods for stochastic control with exit time and applications to share repurchase pricing

arXiv: https://arxiv.org/abs/2302.07320 · HTML: https://mlsanity.com/paper/2302.07320/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Feb 2023.

## Built on by (most cited first, 3 of 3)

- [Fast Policy Learning for Linear Quadratic Control with Entropy Regularization](https://mlsanity.com/paper/2311.14168/) (2023)
- [Entropy annealing for policy mirror descent in continuous time and space](https://mlsanity.com/paper/2405.20250/) (2024)
- [Stock Volume Forecasting with Advanced Information by Conditional Variational Auto-Encoder](https://mlsanity.com/paper/2406.19414/) (2024)

## Abstract (arXiv)

We develop policy gradients methods for stochastic control with exit time in a model-free setting. We propose two types of algorithms for learning either directly the optimal policy or by learning alternately the value function (critic) and the optimal control (actor). The use of randomized policies is crucial for overcoming notably the issue related to the exit time in the gradient computation. We demonstrate the effectiveness of our approach by implementing our numerical schemes in the application to the problem of share repurchase pricing. Our results show that the proposed policy gradient methods outperform PDE or other neural networks techniques in a model-based setting. Furthermore, our algorithms are flexible enough to incorporate realistic market conditions like e.g. price impact or transaction costs.
