Hessian Riemannian gradient flows in convex programming
Not on the map. Why?
Abstract (arXiv)
Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on convex sets as those metrics that have a specific integration property with respect to variational inequalities, giving a new motivation for the introduction of Bregman-type distances. Then, the general evolution problem is introduced and a differential inclusion reformulation is given. A general existence result is proved and global convergence is established under quasi-convexity conditions, with interesting refinements in the case of convex minimization. Some explicit examples of these gradient flows are discussed. Dual trajectories are identified and sufficient conditions for dual convergence are examined for a convex program with positivity and equality constraints. Some convergence rate results are established. In the case of a linear objective function, several optimality characterizations of the orbits are given: optimal path of viscosity methods, continuous-time model of Bregman-type proximal algorithms, geodesics for some adequate metrics and projections of dot q-trajectories of some Lagrange equations and completely integrable Hamiltonian systems.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 2; 2024: 5; 2025: 8; 2026: 4.
25 papers.
Sort:
By area:
- 2022Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descentcited by 38
- 2021The Last-Iterate Convergence Rate of Optimistic Mirror Descent in Stochastic Variational Inequalitiescited by 12
- 2022Geometry and convergence of natural policy gradient methodscited by 12
- 2024Mask in the Mirror: Implicit Sparsificationcited by 12
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?cited by 10
- 2024Embedding Safety into RL: A New Take on Trust Region Methodscited by 9
- 2023Riemannian stochastic optimization methods avoid strict saddle pointscited by 8
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
- 2025Landing with the Score: Riemannian Optimization through Denoisingcited by 7
- 2021Zeroth-order non-convex learning via hierarchical dual averagingcited by 6
- 2024Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradientscited by 5
- 2021First-Order Methods for Convex Optimizationcited by 4
13 more
- 2025Central Path Proximal Policy Optimizationcited by 3
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problemcited by 3
- 2024Optimization Insights into Deep Diagonal Linear Networkscited by 2
- 2025The impact of uncertainty on regularized learning in gamescited by 2
- 2025Towards understanding Accelerated Stein Variational Gradient Flow -- Analysis of Generalized Bilinear Kernels for Gaussian target distributionscited by 2
- 2026Never Saddle for Reparameterized Steepest Descent as Mirror Flowcited by 2
- 2024Optimal Rates of Convergence for Entropy Regularization in Discounted Markov Decision Processescited by 1
- 2025The Geometry of Nonlinear Reinforcement Learningcited by 1
- 2026Non-KKT Accumulation in Entropic Mirror Descentcited by 1
- 2022Multilevel Geometric Optimization for Regularised Constrained Linear Inverse Problemscited by 0
- 2025Spike-timing-dependent Hebbian learning as noisy gradient descentcited by 0
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterizationcited by 0
- 2026The Dually Flat Geometry of Planning as Inferencecited by 0
- 2026The Dually Flat Geometry of Planning as Inference3 Sep 2026
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization7 Aug 2026
- 2026Non-KKT Accumulation in Entropic Mirror Descent3 Aug 2026
- 2026Never Saddle for Reparameterized Steepest Descent as Mirror Flow2 Mar 2026
- 2025Landing with the Score: Riemannian Optimization through Denoising27 Sep 2025
- 2025Towards understanding Accelerated Stein Variational Gradient Flow -- Analysis of Generalized Bilinear Kernels for Gaussian target distributions4 Sep 2025
- 2025The Geometry of Nonlinear Reinforcement Learning1 Sep 2025
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
- 2025The impact of uncertainty on regularized learning in games16 Jun 2025
- 2025Central Path Proximal Policy Optimization31 May 2025
- 2025Spike-timing-dependent Hebbian learning as noisy gradient descent15 May 2025
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?17 Apr 2025
13 more
- 2024Optimization Insights into Deep Diagonal Linear Networks21 Dec 2024
- 2024Embedding Safety into RL: A New Take on Trust Region Methods5 Nov 2024
- 2024Mask in the Mirror: Implicit Sparsification19 Aug 2024
- 2024Optimal Rates of Convergence for Entropy Regularization in Discounted Markov Decision Processes6 Jun 2024
- 2024Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients28 Mar 2024
- 2023Riemannian stochastic optimization methods avoid strict saddle points4 Nov 2023
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning26 Jun 2023
- 2022Geometry and convergence of natural policy gradient methods3 Nov 2022
- 2022Multilevel Geometric Optimization for Regularised Constrained Linear Inverse Problems11 Jul 2022
- 2022Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent8 Jul 2022
- 2021Zeroth-order non-convex learning via hierarchical dual averaging13 Sep 2021
- 2021The Last-Iterate Convergence Rate of Optimistic Mirror Descent in Stochastic Variational Inequalities5 Jul 2021
- 2021First-Order Methods for Convex Optimization4 Jan 2021
- 2022Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descentcited by 38
- 2021The Last-Iterate Convergence Rate of Optimistic Mirror Descent in Stochastic Variational Inequalitiescited by 12
- 2022Geometry and convergence of natural policy gradient methodscited by 12
- 2024Mask in the Mirror: Implicit Sparsificationcited by 12
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?cited by 10
- 2024Embedding Safety into RL: A New Take on Trust Region Methodscited by 9
- 2023Riemannian stochastic optimization methods avoid strict saddle pointscited by 8
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
- 2021Zeroth-order non-convex learning via hierarchical dual averagingcited by 6
- 2024Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradientscited by 5
- 2021First-Order Methods for Convex Optimizationcited by 4
- 2025Central Path Proximal Policy Optimizationcited by 3
12 most cited of 24 All 24 (JSON)
- 2026The Dually Flat Geometry of Planning as Inference3 Sep 2026
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization7 Aug 2026
- 2026Non-KKT Accumulation in Entropic Mirror Descent3 Aug 2026
- 2026Never Saddle for Reparameterized Steepest Descent as Mirror Flow2 Mar 2026
- 2025Towards understanding Accelerated Stein Variational Gradient Flow -- Analysis of Generalized Bilinear Kernels for Gaussian target distributions4 Sep 2025
- 2025The Geometry of Nonlinear Reinforcement Learning1 Sep 2025
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
- 2025The impact of uncertainty on regularized learning in games16 Jun 2025
- 2025Central Path Proximal Policy Optimization31 May 2025
- 2025Spike-timing-dependent Hebbian learning as noisy gradient descent15 May 2025
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?17 Apr 2025
- 2024Optimization Insights into Deep Diagonal Linear Networks21 Dec 2024
12 newest of 24 All 24 (JSON)