Splitting methods with variable metric for KL functions
Not on the map. Why?
Abstract (arXiv)
We study the convergence of general abstract descent methods applied to a lower semicontinuous nonconvex function f that satisfies the Kurdyka-Lojasiewicz inequality in a Hilbert space. We prove that any precompact sequence converges to a critical point of f and obtain new convergence rates both for the values and the iterates. The analysis covers alternating versions of the forward-backward method with variable metric and relative errors. As an example, a nonsmooth and nonconvex version of the Levenberg-Marquardt algorithm is detailled.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 May 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 5; 2024: 3; 2025: 2; 2026: 6.
26 papers.
Sort:
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2021Proximal Gradient Descent-Ascent: Variable Convergence under KL Geometrycited by 17
- 2021Convergence of Random Reshuffling Under The Kurdyka-Lojasiewicz Inequalitycited by 16
- 2021A Scalable Second Order Method for Ill-Conditioned Matrix Completion from Few Samplescited by 13
- 2022Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysiscited by 12
- 2022Cyclic Block Coordinate Descent With Variance Reduction for Composite Nonconvex Optimizationcited by 9
- 2022A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimizationcited by 7
- 2023Convergence Analysis of Mean Shiftcited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2022Gradient descent provably escapes saddle points in the training of shallow ReLU networkscited by 5
- 2023A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Propertiescited by 5
- 2022Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networkscited by 4
14 more
- 2022Convergence Rates of Training Deep Neural Networks via Alternating Minimization Methodscited by 4
- 2023A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimizationcited by 4
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problemscited by 4
- 2023Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methodscited by 2
- 2021WARPd: A linearly convergent first-order method for inverse problems with approximate sharpness conditionscited by 1
- 2024Convergence Analysis of Blurring Mean Shiftcited by 1
- 2025A first-order method for nonconvex-nonconcave minimax problems under a local Kurdyka-Lojasiewicz conditioncited by 1
- 2024Stochastic Gradient Descent Revisitedcited by 0
- 2026A block-coordinate descent framework for non-convex composite optimization. Application to sparse precision matrix estimationcited by 0
- 2026Dynamic Proximal Gradient Algorithms for Schatten-p Quasi-Norm Regularized Problemscited by 0
- 2026Memory-Computation Tradeoffs in Semi Amortized Parametric Optimizationcited by 0
- 2026A proximal subgradient method for nonconvex stochastic optimization under the Kurdyka-Lojasiewicz conditioncited by 0
- 2026Information Bottleneck under Perfect Privacycited by 0
- 2026GCA: Global Centroid Alignment in Federated Learningcited by 0
- 2026GCA: Global Centroid Alignment in Federated Learning23 Aug 2026
- 2026Information Bottleneck under Perfect Privacy11 Aug 2026
- 2026A proximal subgradient method for nonconvex stochastic optimization under the Kurdyka-Lojasiewicz condition5 Aug 2026
- 2026Memory-Computation Tradeoffs in Semi Amortized Parametric Optimization22 Jul 2026
- 2026Dynamic Proximal Gradient Algorithms for Schatten-p Quasi-Norm Regularized Problems27 Feb 2026
- 2026A block-coordinate descent framework for non-convex composite optimization. Application to sparse precision matrix estimation29 Jan 2026
- 2025A first-order method for nonconvex-nonconcave minimax problems under a local Kurdyka-Lojasiewicz condition2 Jul 2025
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problems13 May 2025
- 2024Stochastic Gradient Descent Revisited8 Dec 2024
- 2024Convergence Analysis of Blurring Mean Shift23 Feb 2024
- 2024Learning pseudo-contractive denoisers for inverse problems8 Feb 2024
- 2023A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimization2 Dec 2023
14 more
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problems22 Oct 2023
- 2023Convergence Analysis of Mean Shift15 May 2023
- 2023A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Properties10 May 2023
- 2023Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methods5 Jan 2023
- 2022Cyclic Block Coordinate Descent With Variance Reduction for Composite Nonconvex Optimization9 Dec 2022
- 2022Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysis22 Sep 2022
- 2022Convergence Rates of Training Deep Neural Networks via Alternating Minimization Methods30 Aug 2022
- 2022Gradient descent provably escapes saddle points in the training of shallow ReLU networks3 Aug 2022
- 2022Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networks25 Apr 2022
- 2022A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization30 Mar 2022
- 2021WARPd: A linearly convergent first-order method for inverse problems with approximate sharpness conditions24 Oct 2021
- 2021Convergence of Random Reshuffling Under The Kurdyka-Lojasiewicz Inequality10 Oct 2021
- 2021A Scalable Second Order Method for Ill-Conditioned Matrix Completion from Few Samples3 Jun 2021
- 2021Proximal Gradient Descent-Ascent: Variable Convergence under KL Geometry9 Feb 2021
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2021Proximal Gradient Descent-Ascent: Variable Convergence under KL Geometrycited by 17
- 2021Convergence of Random Reshuffling Under The Kurdyka-Lojasiewicz Inequalitycited by 16
- 2021A Scalable Second Order Method for Ill-Conditioned Matrix Completion from Few Samplescited by 13
- 2022Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysiscited by 12
- 2022Cyclic Block Coordinate Descent With Variance Reduction for Composite Nonconvex Optimizationcited by 9
- 2022A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimizationcited by 7
- 2023Convergence Analysis of Mean Shiftcited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2022Gradient descent provably escapes saddle points in the training of shallow ReLU networkscited by 5
- 2023A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Propertiescited by 5
- 2022Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networkscited by 4
12 most cited of 26 All 26 (JSON)
- 2026GCA: Global Centroid Alignment in Federated Learning23 Aug 2026
- 2026Information Bottleneck under Perfect Privacy11 Aug 2026
- 2026A proximal subgradient method for nonconvex stochastic optimization under the Kurdyka-Lojasiewicz condition5 Aug 2026
- 2026Memory-Computation Tradeoffs in Semi Amortized Parametric Optimization22 Jul 2026
- 2026Dynamic Proximal Gradient Algorithms for Schatten-p Quasi-Norm Regularized Problems27 Feb 2026
- 2026A block-coordinate descent framework for non-convex composite optimization. Application to sparse precision matrix estimation29 Jan 2026
- 2025A first-order method for nonconvex-nonconcave minimax problems under a local Kurdyka-Lojasiewicz condition2 Jul 2025
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problems13 May 2025
- 2024Stochastic Gradient Descent Revisited8 Dec 2024
- 2024Convergence Analysis of Blurring Mean Shift23 Feb 2024
- 2024Learning pseudo-contractive denoisers for inverse problems8 Feb 2024
- 2023A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimization2 Dec 2023
12 newest of 26 All 26 (JSON)