{"total":38,"rows":[{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2207.02628","title":"The alignment property of SGD noise and how it helps select flat minima: A stability analysis","created":"2022-07-06","cited_by_count":64,"area":null},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2301.02312","title":"Training trajectories, mini-batch losses and the curious role of the learning rate","created":"2023-01-05","cited_by_count":21,"area":null},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19,"area":null},{"id":"2306.02913","title":"Decentralized SGD and Average-direction SAM are Asymptotically Equivalent","created":"2023-06-05","cited_by_count":15,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2201.06714","title":"AdaTerm: Adaptive T-Distribution Estimated Robust Moments for Noise-Robust Stochastic Gradient Optimization","created":"2022-01-18","cited_by_count":11,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2301.12309","title":"On the Lipschitz Constant of Deep Networks and Double Descent","created":"2023-01-28","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2306.07850","title":"Exact Mean Square Linear Stability Analysis for SGD","created":"2023-06-13","cited_by_count":11,"area":null},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2505.12387","title":"Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning","created":"2025-05-18","cited_by_count":9,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2602.06500","title":"Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?","created":"2026-02-06","cited_by_count":7,"area":null},{"id":"2205.13799","title":"Generalization Bounds for Gradient Methods via Discrete and Continuous Prior","created":"2022-05-27","cited_by_count":5,"area":null},{"id":"2406.00396","title":"Stochastic Resetting Mitigates Latent Gradient Bias of SGD from Label Noise","created":"2024-06-01","cited_by_count":4,"area":null},{"id":"2505.23489","title":"SGD as Free Energy Minimization: A Thermodynamic View on Neural Network Training","created":"2025-05-29","cited_by_count":4,"area":null},{"id":"2201.12724","title":"Stochastic Neural Networks with Infinite Width are Deterministic","created":"2022-01-30","cited_by_count":3,"area":null},{"id":"2310.18455","title":"Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent","created":"2023-10-27","cited_by_count":3,"area":null},{"id":"2407.02322","title":"Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent","created":"2024-07-02","cited_by_count":3,"area":null},{"id":"2602.14789","title":"On the Stability of Nonlinear Dynamics in GD and SGD: Beyond Quadratic Potentials","created":"2026-02-16","cited_by_count":3,"area":null},{"id":"2306.05300","title":"Anti-Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances in Flat Directions","created":"2023-06-08","cited_by_count":2,"area":null},{"id":"2509.18001","title":"Unveiling m-Sharpness Through the Structure of Stochastic Gradient Noise","created":"2025-09-22","cited_by_count":2,"area":null},{"id":"2210.15764","title":"Noise Injection Node Regularization for Robust Learning","created":"2022-10-27","cited_by_count":1,"area":null},{"id":"2306.09991","title":"Evolutionary Algorithms in the Light of SGD: Limit Equivalence, Minima Flatness, and Transfer Learning","created":"2023-05-20","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2605.21292","title":"Unbiased Gradients, Moving Stability Boundaries: Exact Mini-Batch Geometry in Linear Self-Attention","created":"2026-05-20","cited_by_count":1,"area":null},{"id":"2105.07222","title":"On the Distributional Properties of Adaptive Gradients","created":"2021-05-15","cited_by_count":0,"area":null},{"id":"2410.07719","title":"How Learning Dynamics Drive Adversarially Robust Generalization?","created":"2024-10-10","cited_by_count":0,"area":null},{"id":"2508.14539","title":"FedEve: On Bridging the Client Drift and Period Drift for Cross-device Federated Learning","created":"2025-08-20","cited_by_count":0,"area":null},{"id":"2510.25074","title":"BOND: License to Train with Black-Box Functions","created":"2025-10-29","cited_by_count":0,"area":null},{"id":"2605.29983","title":"Improving Adversarial Robustness of Attribution via Implicit Regularization","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.00293","title":"Accurate Large-sample Uncertainty Quantification using Stochastic Gradient Markov Chain Monte Carlo","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.22180","title":"FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism","created":"2026-06-20","cited_by_count":0,"area":null}],"next_cursor":null}