{"total":43,"rows":[{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2202.02831","title":"Anticorrelated Noise Injection for Improved Generalization","created":"2022-02-06","cited_by_count":42,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2206.04613","title":"Explicit Regularization in Overparametrized Models via Noise Injection","created":"2022-06-09","cited_by_count":26,"area":null},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23,"area":null},{"id":"2410.16561","title":"Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration","created":"2024-10-21","cited_by_count":18,"area":null},{"id":"2301.11885","title":"Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions","created":"2023-01-27","cited_by_count":15,"area":null},{"id":"2106.08414","title":"On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control","created":"2021-06-15","cited_by_count":12,"area":null},{"id":"2201.12332","title":"On the Hidden Biases of Policy Mirror Ascent in Continuous Action Spaces","created":"2022-01-28","cited_by_count":11,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2210.00690","title":"Taming Fat-Tailed (\"Heavier-Tailed'' with Potentially Infinite Variance) Noise in Federated Learning","created":"2022-10-03","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2406.04657","title":"From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks","created":"2024-06-07","cited_by_count":9,"area":null},{"id":"2411.00999","title":"Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers","created":"2024-11-01","cited_by_count":7,"area":null},{"id":"2502.04164","title":"Efficient Distributed Optimization under Heavy-Tailed Noise","created":"2025-02-06","cited_by_count":7,"area":null},{"id":"2111.04004","title":"Exponential escape efficiency of SGD from sharp minima in non-stationary regime","created":"2021-11-07","cited_by_count":5,"area":null},{"id":"2209.09162","title":"On the Theoretical Properties of Noise Correlation in Stochastic Optimization","created":"2022-09-19","cited_by_count":5,"area":null},{"id":"2312.00427","title":"From Mutual Information to Expected Dynamics: New Generalization Bounds for Heavy-Tailed SGD","created":"2023-12-01","cited_by_count":4,"area":null},{"id":"2403.02051","title":"Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping","created":"2024-03-04","cited_by_count":3,"area":null},{"id":"2406.20006","title":"On the Trade-off between Flatness and Optimization in Distributed Learning","created":"2024-06-28","cited_by_count":3,"area":null},{"id":"2410.18117","title":"Efficient Adaptive Federated Optimization","created":"2024-10-10","cited_by_count":2,"area":null},{"id":"2503.22478","title":"Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent","created":"2025-03-28","cited_by_count":2,"area":null},{"id":"2506.12903","title":"Variational Learning Finds Flatter Solutions at the Edge of Stability","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2602.05600","title":"On the Superlinear Relationship between SGD Noise Covariance and Loss Landscape Curvature","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2604.19740","title":"Generalization at the Edge of Stability","created":"2026-04-21","cited_by_count":2,"area":null},{"id":"2105.02062","title":"Understanding Short-Range Memory Effects in Deep Neural Networks","created":"2021-05-05","cited_by_count":1,"area":null},{"id":"2210.11257","title":"A note on diffusion limits for stochastic gradient descent","created":"2022-10-20","cited_by_count":1,"area":null},{"id":"2303.17109","title":"Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models","created":"2023-03-30","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2601.20399","title":"Convergence Analysis of Randomized Subspace Normalized SGD under Heavy-Tailed Noise","created":"2026-01-28","cited_by_count":1,"area":null},{"id":"2602.05393","title":"Late-to-Early Training: LET LLMs Learn Earlier, So Faster and Better","created":"2026-02-05","cited_by_count":1,"area":null},{"id":"2603.10074","title":"Marginals Before Conditionals","created":"2026-03-10","cited_by_count":1,"area":null},{"id":"2206.04359","title":"Learning Non-Vacuous Generalization Bounds from Optimization","created":"2022-06-09","cited_by_count":0,"area":null},{"id":"2305.18864","title":"Stochastic Gradient Langevin Dynamics Based on Quantization with Increasing Resolution","created":"2023-05-30","cited_by_count":0,"area":null},{"id":"2306.09624","title":"Power-law Dynamic arising from machine learning","created":"2023-06-16","cited_by_count":0,"area":null},{"id":"2406.16032","title":"Effect of Random Learning Rate: Theoretical Analysis of SGD Dynamics in Non-Convex Optimization via Stationary Distribution","created":"2024-06-23","cited_by_count":0,"area":null},{"id":"2410.14667","title":"SGD Jittering: A Training Strategy for Robust and Accurate Model-Based Architectures","created":"2024-10-18","cited_by_count":0,"area":null},{"id":"2505.18535","title":"Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD","created":"2025-05-24","cited_by_count":0,"area":null},{"id":"2509.11337","title":"On the Escaping Efficiency of Distributed Adversarial Training Algorithms","created":"2025-09-14","cited_by_count":0,"area":null},{"id":"2509.15127","title":"Learning Rate Should Scale Inversely with High-Order Data Moments in High-Dimensional Online Independent Component Analysis","created":"2025-09-18","cited_by_count":0,"area":null},{"id":"2605.22644","title":"Why SGD is not Brownian Motion: A New Perspective on Stochastic Dynamics","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2609.13057","title":"Benign Loss Landscapes Can Coexist with Worst-Case Hardness","created":"2026-09-11","cited_by_count":0,"area":null},{"id":"2610.16868","title":"From Parallel to Sequential: Small-Batch Noise Restores Simplicity Bias of Muon","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}