# A statistical learning strategy for closed-loop control of fluid flows

arXiv: https://arxiv.org/abs/1604.03392 · HTML: https://mlsanity.com/paper/1604.03392/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Apr 2016.

## Built on by (most cited first, 4 of 4)

- [Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamics](https://mlsanity.com/paper/2104.05437/) (2021)
- [Comparative analysis of machine learning methods for active flow control](https://mlsanity.com/paper/2202.11664/) (2022)
- [Learning swimming escape patterns for larval fish under energy constraints](https://mlsanity.com/paper/2105.00771/) (2021)
- [Stabilising viscous extensional flows using Reinforcement Learning](https://mlsanity.com/paper/2110.14677/) (2021)

## Abstract (arXiv)

This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system's dynamics. A control strategy is then learned using reinforcement learning once rewards relevant with respect to the control objective are identified. This method is designed for experimental configurations, requiring no computations nor prior knowledge of the system, and enjoys intrinsic robustness. It is illustrated on two systems: the control of the transitions of a Lorenz 63 dynamical system, and the control of the drag of a cylinder flow. The method is shown to perform well.