Optimal adaptive control with separable drift uncertainty
Not on the map. Why?
Abstract (arXiv)
We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state Yu is multiplicatively influenced by an unknown random variable λ, while admissible controls u are required to be adapted to the observation filtration. Choosing a control actively influences the state and information acquisition simultaneously and comes with a learning effect. The problem, initially non-Markovian, is embedded into a higher-dimensional Markovian, full information control problem with control-dependent filtration and noise. To that problem, we apply the stochastic Perron method to characterize the value function as the unique viscosity solution to the HJB equation, explicitly construct varepsilon-optimal controls and show that the values of strong and weak formulations agree. Numerical illustrations show a significant difference between the adaptive control and the certainty equivalence control.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Sep 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.