Differentiable Quantum Computing for Large-scale Linear Control
Not on the map. Why?
Abstract (arXiv)
As industrial models and designs grow increasingly complex, the demand for optimal control of large-scale dynamical systems has significantly increased. However, traditional methods for optimal control incur significant overhead as problem dimensions grow. In this paper, we introduce an end-to-end quantum algorithm for linear-quadratic control with provable speedups. Our algorithm, based on a policy gradient method, incorporates a novel quantum subroutine for solving the matrix Lyapunov equation. Specifically, we build a quantum-assisted differentiable simulator for efficient gradient estimation that is more accurate and robust than classical methods relying on stochastic approximation. Compared to the classical approaches, our method achieves a super-quadratic speedup. To the best of our knowledge, this is the first end-to-end quantum application to linear control problems with provable quantum advantage.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 59 references that are in the map. First posted on arXiv 3 Nov 2024.
Builds on
23 of 59 references.
References · 23
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2018Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulatorcited by 211
- 2018Learning Without Mixing: Towards A Sharp Analysis of Linear System Identificationcited by 158
- 2017On the Sample Complexity of the Linear Quadratic Regulatorcited by 151
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2022Accelerated Policy Learning with Parallel Differentiable Simulationcited by 92
- 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 83
- 2018Online Linear Quadratic Controlcited by 55
- 2021An End-to-End Differentiable Framework for Contact-Aware Robot Designcited by 53
- 2021Efficient Differentiable Simulation of Articulated Bodiescited by 38
- 2023FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulationcited by 37
- 2019Convergence and sample complexity of gradient methods for the model-free linear quadratic regulator problemcited by 35
11 more
- 2018The power of block-encoded matrix powers: improved regression techniques via faster Hamiltonian simulationcited by 30
- 2017Quantum SDP-Solvers: Better upper and lower boundscited by 27
- 2022Quantum Policy Iteration via Amplitude Estimation and Grover Search -- Towards Quantum Advantage for Reinforcement Learningcited by 21
- 2022Rethinking Optimization with Differentiable Simulation from a Global Perspectivecited by 21
- 2022Quantum Reinforcement Learning via Policy Iterationcited by 19
- 2021Near-Optimal Quantum Algorithms for Multivariate Mean Estimationcited by 16
- 2022Differentiable Hybrid Traffic Simulationcited by 8
- 2021Quantum Interior Point Methods for Semidefinite Optimizationcited by 6
- 2022Differentiable Analog Quantum Computing for Optimization and Controlcited by 4
- 2022Improved quantum algorithms for linear and nonlinear differential equationscited by 3
- 2023Efficient Quantum Algorithms for Quantum Optimal Controlcited by 1
Built on by
Not cited yet.