{"total":45,"rows":[{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184,"area":null},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2207.05952","title":"Implicit regularization of dropout","created":"2022-07-13","cited_by_count":25,"area":null},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2603.09697","title":"Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning","created":"2026-03-10","cited_by_count":17,"area":null},{"id":"2102.09645","title":"SVRG Meets AdaGrad: Painless Variance Reduction","created":"2021-02-18","cited_by_count":13,"area":null},{"id":"2103.12682","title":"How to decay your learning rate","created":"2021-03-23","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2104.04874","title":"SGD Implicitly Regularizes Generalization Error","created":"2021-04-10","cited_by_count":10,"area":null},{"id":"2201.11137","title":"Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization","created":"2022-01-26","cited_by_count":10,"area":null},{"id":"2210.00690","title":"Taming Fat-Tailed (\"Heavier-Tailed'' with Potentially Infinite Variance) Noise in Federated Learning","created":"2022-10-03","cited_by_count":10,"area":null},{"id":"2410.03006","title":"Formation of Representations in Neural Networks","created":"2024-10-03","cited_by_count":10,"area":null},{"id":"2505.12387","title":"Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning","created":"2025-05-18","cited_by_count":9,"area":null},{"id":"2406.11110","title":"How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD","created":"2024-06-17","cited_by_count":8,"area":null},{"id":"2407.16427","title":"Stochastic weight matrix dynamics during learning and Dyson Brownian motion","created":"2024-07-23","cited_by_count":7,"area":null},{"id":"2302.02563","title":"Stochastic Gradient Descent-Induced Drift of Representation in a Two-Layer Neural Network","created":"2023-02-06","cited_by_count":6,"area":null},{"id":"2201.04021","title":"Optimization Planning for 3D ConvNets","created":"2022-01-11","cited_by_count":5,"area":null},{"id":"2306.03521","title":"Machine learning in and out of equilibrium","created":"2023-06-06","cited_by_count":5,"area":null},{"id":"2505.23489","title":"SGD as Free Energy Minimization: A Thermodynamic View on Neural Network Training","created":"2025-05-29","cited_by_count":4,"area":null},{"id":"2106.02220","title":"Fluctuation-dissipation Type Theorem in Stochastic Linear Learning","created":"2021-06-04","cited_by_count":3,"area":null},{"id":"2106.16200","title":"Revisiting the Effects of Stochasticity for Hamiltonian Samplers","created":"2021-06-30","cited_by_count":3,"area":null},{"id":"2309.05337","title":"Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems","created":"2023-09-11","cited_by_count":3,"area":null},{"id":"2104.12210","title":"Generative Adversarial Network: Some Analytical Perspectives","created":"2021-04-25","cited_by_count":2,"area":null},{"id":"2108.09507","title":"Shift-Curvature, SGD, and Generalization","created":"2021-08-21","cited_by_count":2,"area":null},{"id":"2110.14254","title":"Multilayer Lookahead: a Nested Version of Lookahead","created":"2021-10-27","cited_by_count":2,"area":null},{"id":"2306.05300","title":"Anti-Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances in Flat Directions","created":"2023-06-08","cited_by_count":2,"area":null},{"id":"2505.21651","title":"AutoSGD: Automatic Learning Rate Selection for Stochastic Gradient Descent","created":"2025-05-27","cited_by_count":2,"area":null},{"id":"2510.21588","title":"Contribution of task-irrelevant stimuli to drift of neural representations","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2606.28486","title":"Spectral phase transitions and trainability in neural network learning dynamics","created":"2026-06-26","cited_by_count":2,"area":null},{"id":"2509.01349","title":"Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks","created":"2025-09-01","cited_by_count":1,"area":null},{"id":"2509.21181","title":"Closed-form $\\ell_r$ norm scaling with data for overparameterized linear regression and diagonal linear networks under $\\ell_p$ bias","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2607.04135","title":"Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning","created":"2026-07-05","cited_by_count":1,"area":null},{"id":"2206.13669","title":"Studying Generalization Through Data Averaging","created":"2022-06-28","cited_by_count":0,"area":null},{"id":"2302.03258","title":"Climate Intervention Analysis using AI Model Guided by Statistical Physics Principles","created":"2023-02-07","cited_by_count":0,"area":null},{"id":"2412.11341","title":"Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent","created":"2024-12-15","cited_by_count":0,"area":null},{"id":"2412.20496","title":"Random Matrix Theory for Stochastic Gradient Descent","created":"2024-12-29","cited_by_count":0,"area":null},{"id":"2512.16515","title":"The Universe Learning Itself: On the Evolution of Dynamics from the Big Bang to Machine Intelligence","created":"2025-12-18","cited_by_count":0,"area":null},{"id":"2606.06412","title":"Nonreversible Gauge Fields in Fokker--Planck Dynamics: Supersymmetric Hamiltonians and Learned Finite Forces","created":"2026-06-04","cited_by_count":0,"area":null},{"id":"2609.08219","title":"Speed Limit for Information Acquisition in Stochastic Learning Dynamics","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.29774","title":"An Analytical Theory of Auxiliary Learning","created":"2026-09-24","cited_by_count":0,"area":null},{"id":"2609.37745","title":"Optimizer-dependent training dynamics converge to the same one-third optimal data scaling","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2610.00615","title":"Learning the identity: a case study of how SGD selects among functional decompositions","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}