Hessian informed mirror descent
Not on the map. Why?
Abstract (arXiv)
Inspired by the recent paper (L. Ying, Mirror descent algorithms for minimizing interacting free energy, Journal of Scientific Computing, 84 (2020), pp. 1-14),we explore the relationship between the mirror descent and the variable metric method. When the metric in the mirror decent is induced by a convex function, whose Hessian is close to the Hessian of the objective function, this method enjoys both robustness from the mirror descent and superlinear convergence for Newton type methods. When applied to a linearly constrained minimization problem, we prove the global and local convergence, both in the continuous and discrete settings. As applications, we compute the Wasserstein gradient flows and Cahn-Hillard equation with degenerate mobility. When formulating these problems using a minimizing movement scheme with respect to a variable metric, our mirror descent algorithm offers a fast convergent speed for the underlining optimization problem while maintaining the total mass and bounds of the solution.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jun 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 1; 2025: 0; 2026: 1.
6 papers.
- 2022Geometry and convergence of natural policy gradient methodscited by 12
- 2023Achieving High Accuracy with PINNs via Energy Natural Gradientscited by 10
- 2024Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradientscited by 5
- 2021Approximate Newton policy gradient algorithmscited by 3
- 2022Conjugate Natural Selectioncited by 0
- 2026Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solverscited by 0
- 2026Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers24 Jul 2026
- 2024Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients28 Mar 2024
- 2023Achieving High Accuracy with PINNs via Energy Natural Gradients25 Feb 2023
- 2022Geometry and convergence of natural policy gradient methods3 Nov 2022
- 2022Conjugate Natural Selection29 Aug 2022
- 2021Approximate Newton policy gradient algorithms5 Oct 2021