{"total":38,"rows":[{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110,"area":null},{"id":"2310.04415","title":"Why Do We Need Weight Decay in Modern Deep Learning?","created":"2023-10-06","cited_by_count":72,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2206.09841","title":"Label noise (stochastic) gradient descent implicitly solves the Lasso for quadratic parametrisation","created":"2022-06-20","cited_by_count":29,"area":null},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25,"area":null},{"id":"2408.09966","title":"Mask in the Mirror: Implicit Sparsification","created":"2024-08-19","cited_by_count":14,"area":null},{"id":"2108.04620","title":"A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions","created":"2021-08-10","cited_by_count":10,"area":null},{"id":"2511.04622","title":"ODE approximation for the Adam algorithm: General and overparametrized setting","created":"2025-11-06","cited_by_count":10,"area":null},{"id":"2112.07369","title":"Convergence proof for stochastic gradient descent in the training of deep neural networks with ReLU activation for constant target functions","created":"2021-12-13","cited_by_count":9,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2302.03550","title":"Exponential convergence rates for momentum stochastic gradient descent in the overparametrized setting","created":"2023-02-07","cited_by_count":8,"area":null},{"id":"2404.12293","title":"Singular-limit analysis of gradient descent with noise injection","created":"2024-04-18","cited_by_count":7,"area":null},{"id":"2410.08395","title":"Nesterov acceleration in benignly non-convex landscapes","created":"2024-10-10","cited_by_count":7,"area":null},{"id":"2209.07446","title":"Efficiency Ordering of Stochastic Gradient Descent","created":"2022-09-15","cited_by_count":6,"area":null},{"id":"2302.14690","title":"On the existence of minimizers in shallow residual ReLU neural network optimization landscapes","created":"2023-02-28","cited_by_count":6,"area":null},{"id":"2403.07688","title":"Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2210.06705","title":"From Gradient Flow on Population Loss to Learning with Stochastic Gradient Descent","created":"2022-10-13","cited_by_count":5,"area":null},{"id":"2304.09221","title":"Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks","created":"2023-04-18","cited_by_count":3,"area":null},{"id":"2310.17610","title":"A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces","created":"2023-10-26","cited_by_count":3,"area":null},{"id":"2407.02322","title":"Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent","created":"2024-07-02","cited_by_count":3,"area":null},{"id":"2410.16849","title":"Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequality","created":"2024-10-22","cited_by_count":3,"area":null},{"id":"2505.11434","title":"Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization","created":"2025-05-16","cited_by_count":3,"area":null},{"id":"2201.10245","title":"On Uniform Boundedness Properties of SGD and its Momentum Variants","created":"2022-01-25","cited_by_count":2,"area":null},{"id":"2402.08344","title":"Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training","created":"2024-02-13","cited_by_count":2,"area":null},{"id":"2405.11775","title":"Exploring Ordinality in Text Classification: A Comparative Study of Explicit and Implicit Techniques","created":"2024-05-20","cited_by_count":2,"area":null},{"id":"2409.17499","title":"Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGD","created":"2024-09-26","cited_by_count":2,"area":null},{"id":"2502.07584","title":"Generalization Bounds for Markov Algorithms through Entropy Flow Computations","created":"2025-02-11","cited_by_count":2,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2411.15220","title":"Sampling with Adaptive Variance for Multimodal Distributions","created":"2024-11-20","cited_by_count":1,"area":null},{"id":"2105.14694","title":"Combining resampling and reweighting for faithful stochastic optimization","created":"2021-05-31","cited_by_count":0,"area":null},{"id":"2207.00389","title":"Analysis of Kinetic Models for Label Switching and Stochastic Gradient Descent","created":"2022-07-01","cited_by_count":0,"area":null},{"id":"2501.08074","title":"Artificial Liver Classifier: A New Alternative to Conventional Machine Learning Models","created":"2025-01-14","cited_by_count":0,"area":null},{"id":"2512.24445","title":"Adaptive Learning Guided by Bias-Noise-Alignment Diagnostics","created":"2025-12-30","cited_by_count":0,"area":null},{"id":"2605.14663","title":"Optimal Asymptotic Rates for (Stochastic) Gradient Descent under the Local PL-Condition: A Geometric Approach","created":"2026-05-14","cited_by_count":0,"area":null},{"id":"2605.21104","title":"HORST: Composing Optimizer Geometries for Sparse Transformer Training","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2610.16868","title":"From Parallel to Sequential: Small-Batch Noise Restores Simplicity Bias of Muon","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}