Model-free stochastic linear quadratic design by semidefinite programming
On the map: Deep reinforcement learning methods → RL for games and combinatorial optimization
Abstract (arXiv)
In this article, we study a model-free design approach for stochastic linear quadratic (SLQ) controllers. Based on the convexity of the SLQ dual problem and the Karush-Kuhn-Tucker (KKT) conditions, we find the relationship between the optimal point of the dual problem and the Q-function, which can be used to develop a novel model-free semidefinite programming (SDP) algorithm for deriving optimal control gain. This study provides a new optimization perspective for understanding Q-learning algorithms and lays a theoretical foundation for effective reinforcement learning (RL) algorithms. Finally, the effectiveness of the proposed model-free SDP algorithm is demonstrated by two case simulations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for games and combinatorial optimization, one of 15 directions in Deep reinforcement learning methods. Builds on 0 of its 26 references that are in the map. First posted on arXiv 23 Dec 2024.
Builds on
0 of 26 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Model-free stochastic linear quadratic control for discrete-time systems with multiplicative and additive noises via semidefinite programming
- 2025Learning-based primal-dual optimal control of discrete-time stochastic systems with multiplicative noise
- 2025Primal-dual policy learning for mean-field stochastic LQR problem ↗
- 2026Model-Free Q-Learning for Infinite-Horizon Stochastic Linear Quadratic Problems with Regime Switching
- 2025Sample-Efficient Model-Free Policy Gradient Methods for Stochastic LQR via Robust Linear Regression
- 2025Computing stabilizing feedback gains for stochastic linear systems via policy iteration method ↗
- 2026(Cheap) Stochastic Policy Gradient Converges with High Probability for Linear Quadratic Regulator
- 2024Convergence of Policy Gradient for Stochastic Linear-Quadratic Control Problem in Infinite Horizon