Subgradient methods for sharp weakly convex functions
Not on the map. Why?
Abstract (arXiv)
Subgradient methods converge linearly on a convex function that grows sharply away from its solution set. In this work, we show that the same is true for sharp functions that are only weakly convex, provided that the subgradient methods are initialized within a fixed tube around the solution set. A variety of statistical and signal processing tasks come equipped with good initialization, and provably lead to formulations that are both weakly convex and sharp. Therefore, in such settings, subgradient methods can serve as inexpensive local search procedures. We illustrate the proposed techniques on phase retrieval and covariance estimation problems.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 2; 2023: 8; 2024: 9; 2025: 6; 2026: 3.
33 papers.
Sort:
By area:
- 2021Amortized Implicit Differentiation for Stochastic Bilevel Optimizationcited by 62
- 2021Stochastic Mirror Descent: Convergence Analysis and Adaptive Variants via the Mirror Stochastic Polyak Stepsizecited by 22
- 2024Adam with model exponential moving average is effective for nonconvex optimizationcited by 22
- 2022Beyond Uniform Lipschitz Condition in Differentially Private Optimizationcited by 19
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradientscited by 15
- 2024General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimizationcited by 14
- 2024Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performancecited by 13
- 2024Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisationcited by 12
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimizationcited by 11
- 2025New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Resultscited by 6
- 2023Smoothing ADMM for Sparse-Penalized Quantile Regression with Non-Convex Penaltiescited by 4
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
21 more
- 2023ReSync: Riemannian Subgradient-based Robust Rotation Synchronizationcited by 3
- 2024Stochastic Weakly Convex Optimization Beyond Lipschitz Continuitycited by 3
- 2024Disentangled Representation Learning with the Gromov-Monge Gapcited by 3
- 2021Coordinate Descent Methods for DC Minimization: Optimality Conditions and Global Convergencecited by 2
- 2022Coordinate Descent Methods for Fractional Minimizationcited by 2
- 2023A Unified Analysis on the Subgradient Upper Bounds for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functionscited by 2
- 2025Anchored Langevin Algorithmscited by 2
- 2025Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradientscited by 2
- 2021Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programmingcited by 1
- 2023Decentralized Weakly Convex Optimization Over the Stiefel Manifoldcited by 1
- 2023A New Inexact Proximal Linear Algorithm with Adaptive Stopping Criteria for Robust Phase Retrievalcited by 1
- 2026Convergence of Spectral Descent for Non-smooth Optimizationcited by 1
- 2026Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Schedulercited by 1
- 2021Complexity of Inexact Proximal Point Algorithm for minimizing convex functions with Holderian Growthcited by 0
- 2023An inexact LPA for DC composite optimization and application to matrix completions with outlierscited by 0
- 2024Multi-task learning via robust regularized clustering with non-convex group penaltiescited by 0
- 2024Smoothed Robust Phase Retrievalcited by 0
- 2024ℓ1-norm rank-one symmetric matrix factorization has no spurious second-order stationary pointscited by 0
- 2025Smoothing ADMM for Non-convex and Non-smooth Hierarchical Federated Learningcited by 0
- 2025Simplifying Optimal Transport through Schatten-p Regularizationcited by 0
- 2026Global Optimality for Constrained Exploration via Penalty Regularizationcited by 0
- 2026Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler1 Jun 2026
- 2026Convergence of Spectral Descent for Non-smooth Optimization26 May 2026
- 2026Global Optimality for Constrained Exploration via Penalty Regularization30 Apr 2026
- 2025Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients2 Dec 2025
- 2025Simplifying Optimal Transport through Schatten-p Regularization13 Oct 2025
- 2025Anchored Langevin Algorithms23 Sep 2025
- 2025New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Results26 May 2025
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients6 May 2025
- 2025Smoothing ADMM for Non-convex and Non-smooth Hierarchical Federated Learning11 Mar 2025
- 2024General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization11 Nov 2024
- 2024ℓ1-norm rank-one symmetric matrix factorization has no spurious second-order stationary points7 Oct 2024
- 2024Smoothed Robust Phase Retrieval3 Sep 2024
21 more
- 2024Disentangled Representation Learning with the Gromov-Monge Gap10 Jul 2024
- 2024Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance6 Jun 2024
- 2024Adam with model exponential moving average is effective for nonconvex optimization28 May 2024
- 2024Multi-task learning via robust regularized clustering with non-convex group penalties4 Apr 2024
- 2024Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation1 Feb 2024
- 2024Stochastic Weakly Convex Optimization Beyond Lipschitz Continuity25 Jan 2024
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularization9 Oct 2023
- 2023Smoothing ADMM for Sparse-Penalized Quantile Regression with Non-Convex Penalties4 Sep 2023
- 2023A Unified Analysis on the Subgradient Upper Bounds for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions30 Aug 2023
- 2023ReSync: Riemannian Subgradient-based Robust Rotation Synchronization24 May 2023
- 2023A New Inexact Proximal Linear Algorithm with Adaptive Stopping Criteria for Robust Phase Retrieval25 Apr 2023
- 2023Decentralized Weakly Convex Optimization Over the Stiefel Manifold31 Mar 2023
- 2023An inexact LPA for DC composite optimization and application to matrix completions with outliers29 Mar 2023
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimization30 Jan 2023
- 2022Beyond Uniform Lipschitz Condition in Differentially Private Optimization21 Jun 2022
- 2022Coordinate Descent Methods for Fractional Minimization30 Jan 2022
- 2021Amortized Implicit Differentiation for Stochastic Bilevel Optimization29 Nov 2021
- 2021Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programming10 Nov 2021
- 2021Stochastic Mirror Descent: Convergence Analysis and Adaptive Variants via the Mirror Stochastic Polyak Stepsize28 Oct 2021
- 2021Coordinate Descent Methods for DC Minimization: Optimality Conditions and Global Convergence9 Sep 2021
- 2021Complexity of Inexact Proximal Point Algorithm for minimizing convex functions with Holderian Growth10 Aug 2021
- 2021Amortized Implicit Differentiation for Stochastic Bilevel Optimizationcited by 62
- 2021Stochastic Mirror Descent: Convergence Analysis and Adaptive Variants via the Mirror Stochastic Polyak Stepsizecited by 22
- 2024Adam with model exponential moving average is effective for nonconvex optimizationcited by 22
- 2022Beyond Uniform Lipschitz Condition in Differentially Private Optimizationcited by 19
- 2024General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimizationcited by 14
- 2024Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performancecited by 13
- 2024Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisationcited by 12
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimizationcited by 11
- 2025New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Resultscited by 6
- 2023Smoothing ADMM for Sparse-Penalized Quantile Regression with Non-Convex Penaltiescited by 4
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
- 2023ReSync: Riemannian Subgradient-based Robust Rotation Synchronizationcited by 3
12 most cited of 32 All 32 (JSON)
- 2026Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler1 Jun 2026
- 2026Convergence of Spectral Descent for Non-smooth Optimization26 May 2026
- 2026Global Optimality for Constrained Exploration via Penalty Regularization30 Apr 2026
- 2025Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients2 Dec 2025
- 2025Simplifying Optimal Transport through Schatten-p Regularization13 Oct 2025
- 2025Anchored Langevin Algorithms23 Sep 2025
- 2025New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Results26 May 2025
- 2025Smoothing ADMM for Non-convex and Non-smooth Hierarchical Federated Learning11 Mar 2025
- 2024General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization11 Nov 2024
- 2024ℓ1-norm rank-one symmetric matrix factorization has no spurious second-order stationary points7 Oct 2024
- 2024Smoothed Robust Phase Retrieval3 Sep 2024
- 2024Disentangled Representation Learning with the Gromov-Monge Gap10 Jul 2024
12 newest of 32 All 32 (JSON)