{"total":13,"rows":[{"id":"2202.05791","title":"The Power of Adaptivity in SGD: Self-Tuning Step Sizes with Unbounded Gradients and Affine Variance","created":"2022-02-11","cited_by_count":61,"area":null},{"id":"2206.06597","title":"Permutation Search of Tensor Network Structures via Local Sampling","created":"2022-06-14","cited_by_count":13,"area":null},{"id":"2411.07724","title":"Convergence Rate Analysis of LION","created":"2024-11-12","cited_by_count":11,"area":null},{"id":"2306.12700","title":"Accelerated Training via Incrementally Growing Neural Networks using Variance Transfer and Learning Rate Adaptation","created":"2023-06-22","cited_by_count":8,"area":null},{"id":"2505.11840","title":"On the $O(\\frac{\\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\\ell_1$ Norm","created":"2025-05-17","cited_by_count":8,"area":null},{"id":"2106.11514","title":"Rethinking Adam: A Twofold Exponential Moving Average Approach","created":"2021-06-22","cited_by_count":6,"area":null},{"id":"2110.05454","title":"Momentum Centering and Asynchronous Update for Adaptive Gradient Methods","created":"2021-10-11","cited_by_count":4,"area":null},{"id":"2208.00502","title":"Formal guarantees for heuristic optimization algorithms used in machine learning","created":"2022-07-31","cited_by_count":0,"area":null},{"id":"2311.11532","title":"Fine-Tuning Adaptive Stochastic Optimizers: Determining the Optimal Hyperparameter $\\epsilon$ via Gradient Magnitude Histogram Analysis","created":"2023-11-20","cited_by_count":0,"area":null},{"id":"2402.00389","title":"On the $O(\\frac{\\sqrt{d}}{T^{1/4}})$ Convergence Rate of RMSProp and Its Momentum Extension Measured by $\\ell_1$ Norm","created":"2024-02-01","cited_by_count":0,"area":null},{"id":"2605.02317","title":"Anon: Extrapolating Adaptivity Beyond SGD and Adam","created":"2026-05-04","cited_by_count":0,"area":null},{"id":"2609.30276","title":"Why Clipping Matters in AdaGrad? Toward a High-Probability Theory under Generalized Smoothness","created":"2026-08-12","cited_by_count":0,"area":null},{"id":"2610.16923","title":"Minimax Optimality of Shampoo for Nonstationary Stochastic Optimization","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}