# Improving "Fast Iterative Shrinkage-Thresholding Algorithm": Faster, Smarter and Greedier

arXiv: https://arxiv.org/abs/1811.01430 · HTML: https://mlsanity.com/paper/1811.01430/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Nov 2018.

## Built on by (most cited first, 5 of 5)

- [Benchopt: Reproducible, efficient and collaborative optimization benchmarks](https://mlsanity.com/paper/2206.13424/) (2022)
- [Spatiotemporal Regularized Tucker Decomposition Approach for Traffic Data Imputation](https://mlsanity.com/paper/2305.06563/) (2023)
- [Why do we regularise in every iteration for imaging inverse problems?](https://mlsanity.com/paper/2411.00688/) (2024)
- [Sensitivity-Aware Density Estimation in Multiple Dimensions](https://mlsanity.com/paper/2506.02323/) (2025)
- [LRTuckerRep: Low-rank Tucker Representation Model for Multi-dimensional Data Completion](https://mlsanity.com/paper/2508.03755/) (2025)

## Abstract (arXiv)

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case O(1/k2) optimal convergence rate in terms of objective function value. However, despite such an optimal theoretical convergence rate, in practice the (local) oscillatory behaviour of FISTA often damps its efficiency. Over the past years, various efforts are made in the literature to improve the practical performance of FISTA, such as monotone FISTA, restarting FISTA and backtracking strategies. In this paper, we propose a simple yet effective modification to the original FISTA scheme which has two advantages: it allows us to 1) prove the convergence of generated sequence; 2) design a so-called "lazy-start" strategy which can up to an order faster than the original scheme. Moreover, by exploring the properties of FISTA scheme, we propose novel adaptive and greedy strategies which probes the limit of the algorithm. The advantages of the proposed schemes are tested through problems arising from inverse problem, machine learning and signal/image processing.