Momentum-based minimization of the Ginzburg-Landau functional on Euclidean spaces and graphs
Not on the map. Why?
Abstract (arXiv)
We study the momentum-based minimization of a diffuse perimeter functional on Euclidean spaces and on graphs with applications to semi-supervised classification tasks in machine learning. While the gradient flow in the task at hand is a parabolic partial differential equation, the momentum method corresponds to a damped hyperbolic PDE, leading to qualitatively and quantitatively different trajectories. Using a convex-concave splitting-based FISTA-type time discretization, we demonstrate empirically that momentum can lead to faster convergence if the time step size is large but not too large. With large time steps, the PDE analysis offers only limited insight into the geometric behavior of solutions and typical hyperbolic phenomena like loss of regularity are not be observed in sample simulations. We obtain the singular limit of the evolution equations as the length parameter of the phase fields tends to zero by formal expansions and numerically confirm its validity for circles in two dimensions. Our analysis is complemented by numerical experiments for planar curves, surfaces in three-dimensional space, and semi-supervised learning tasks on graphs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 76 references that are in the map. First posted on arXiv 31 Dec 2024.
Builds on
14 of 76 references.
References · 14
- 2015A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insightscited by 203
- 2014Analysis and Design of Optimization Algorithms via Integral Quadratic Constraintscited by 105
- 2020Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label Ratescited by 49
- 2021Convergence of stochastic gradient descent schemes for Lojasiewicz-landscapescited by 27
- 2018Properly-weighted graph Laplacian for semi-supervised learningcited by 19
- 2023Provable non-accelerations of the heavy-ball methodcited by 11
- 2024Nesterov acceleration in benignly non-convex landscapescited by 6
- 2023A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spacescited by 3
- 2024Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex casecited by 3
- 2016Generalizing diffuse interface methods on graphs: non-smooth potentials and hypergraphscited by 2
- 2018PDE Acceleration: A convergence rate analysis and applications to obstacle problemscited by 2
- 2022Joint reconstruction-segmentation on graphscited by 2
Built on by
Not cited yet.