# Revisiting Stochastic Gradient Descent for Strongly Convex Objectives: Tight Uniform-in-Time Bounds

arXiv: https://arxiv.org/abs/2508.20823 · HTML: https://mlsanity.com/paper/2508.20823/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Aug 2025.

## Built on by (most cited first, 1 of 1)

- [The Exact Time-Uniform Rate Frontier for Stochastic Gradient Descent on Smooth Convex Objectives](https://mlsanity.com/paper/2609.08537/) (2026)

## Abstract (arXiv)

Stochastic optimization via Stochastic Gradient Descent (SGD) is a fundamental problem in statistics and optimization. This paper revisits Stochastic Gradient Descent (SGD) for strongly convex objectives, establishing tight, uniform-in-time convergence bounds. We prove that, with probability at least 1 - β, a convergence rate of order fraclog log k + log (1/β)k simultaneously holds for all  k ∈ mathbbN_+ , and demonstrate this bound is tight up to constant factors. We also provide an improved last-iterate convergence rate for such objectives. While focused on strongly convex objectives, our results generalize to the Polyak-Lojasiewicz functions and indicate an O(k-1 log log k) convergence rate for contractive stochastic approximation with additive noise.