"Active-set complexity" of proximal gradient: How long does it take to find the sparsity pattern?
Not on the map. Why?
Abstract (arXiv)
Proximal gradient methods have been found to be highly effective for solving minimization problems with non-negative constraints or L1-regularization. Under suitable nondegeneracy conditions, it is known that these algorithms identify the optimal sparsity pattern for these types of problems in a finite number of iterations. However, it is not known how many iterations this may take. We introduce the notion of the "active-set complexity", which in these cases is the number of iterations before an algorithm is guaranteed to have identified the final sparsity pattern. We further give a bound on the active-set complexity of proximal gradient methods in the common case of minimizing the sum of a strongly-convex smooth function and a separable convex non-smooth function.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 1; 2024: 0; 2025: 0; 2026: 2.
7 papers.
- 2021Implicit differentiation for fast hyperparameter selection in non-smooth convex learningcited by 22
- 2022Accelerating Frank-Wolfe via Averaging Step Directionscited by 2
- 2021Screening for a Reweighted Penalized Conditional Gradient Methodcited by 0
- 2022Faster Accelerated First-order Methods for Convex Optimization with Strongly Convex Function Constraintscited by 0
- 2023Reducing Discretization Error in the Frank-Wolfe Methodcited by 0
- 2026Complexity of Classical Acceleration for ℓ1-Regularized PageRankcited by 0
- 2026Trajectory-Restricted Optimization Conditions and Geometry-Aware Linear Convergencecited by 0
- 2026Trajectory-Restricted Optimization Conditions and Geometry-Aware Linear Convergence18 Apr 2026
- 2026Complexity of Classical Acceleration for ℓ1-Regularized PageRank24 Feb 2026
- 2023Reducing Discretization Error in the Frank-Wolfe Method4 Apr 2023
- 2022Faster Accelerated First-order Methods for Convex Optimization with Strongly Convex Function Constraints21 Dec 2022
- 2022Accelerating Frank-Wolfe via Averaging Step Directions24 May 2022
- 2021Screening for a Reweighted Penalized Conditional Gradient Method2 Jul 2021
- 2021Implicit differentiation for fast hyperparameter selection in non-smooth convex learning4 May 2021