{"total":114,"rows":[{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110,"area":null},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107,"area":null},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104,"area":null},{"id":"2103.00502","title":"Optimal Approximation Rate of ReLU Networks in terms of Width and Depth","created":"2021-02-28","cited_by_count":96,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76,"area":null},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2105.13462","title":"On Linear Stability of SGD and Input-Smoothness of Neural Networks","created":"2021-05-27","cited_by_count":63,"area":null},{"id":"2107.02397","title":"Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons","created":"2021-07-06","cited_by_count":41,"area":null},{"id":"2206.09841","title":"Label noise (stochastic) gradient descent implicitly solves the Lasso for quadratic parametrisation","created":"2022-06-20","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2512.22382","title":"Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration","created":"2025-12-26","cited_by_count":27,"area":null},{"id":"2302.00849","title":"Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent","created":"2023-02-02","cited_by_count":25,"area":null},{"id":"2307.13813","title":"How to Scale Your EMA","created":"2023-07-25","cited_by_count":24,"area":null},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23,"area":null},{"id":"2301.08203","title":"An SDE for Modeling SAM: Theory and Insights","created":"2023-01-19","cited_by_count":22,"area":null},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19,"area":null},{"id":"2307.15196","title":"The Marginal Value of Momentum for Small Learning Rate SGD","created":"2023-07-27","cited_by_count":18,"area":null},{"id":"2106.03696","title":"Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models","created":"2021-06-07","cited_by_count":16,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2310.11428","title":"Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression","created":"2023-10-17","cited_by_count":14,"area":null},{"id":"2405.20763","title":"Improving Generalization and Convergence by Enhancing Implicit Regularization","created":"2024-05-31","cited_by_count":14,"area":null},{"id":"2210.15898","title":"Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis","created":"2022-10-28","cited_by_count":13,"area":null},{"id":"2111.07964","title":"Deep Network Approximation in Terms of Intrinsic Parameters","created":"2021-11-15","cited_by_count":12,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2305.15850","title":"Stochastic Modified Equations and Dynamics of Dropout Algorithm","created":"2023-05-25","cited_by_count":11,"area":null},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11,"area":null},{"id":"2511.04622","title":"ODE approximation for the Adam algorithm: General and overparametrized setting","created":"2025-11-06","cited_by_count":10,"area":null},{"id":"2108.03947","title":"On the Hyperparameters in Stochastic Gradient Descent with Momentum","created":"2021-08-09","cited_by_count":9,"area":null},{"id":"2301.13703","title":"Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning","created":"2023-01-31","cited_by_count":9,"area":null},{"id":"2302.03550","title":"Exponential convergence rates for momentum stochastic gradient descent in the overparametrized setting","created":"2023-02-07","cited_by_count":8,"area":null},{"id":"2305.04547","title":"Diffusion Theory as a Scalpel: Detecting and Purifying Poisonous Dimensions in Pre-trained Language Models Caused by Backdoor or Bias","created":"2023-05-08","cited_by_count":8,"area":"safety"},{"id":"2407.20209","title":"Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning","created":"2024-07-29","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2112.03754","title":"A Continuous-time Stochastic Gradient Descent Method for Continuous Data","created":"2021-12-07","cited_by_count":7,"area":null},{"id":"2302.07125","title":"Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent","created":"2023-02-14","cited_by_count":7,"area":null},{"id":"2411.12135","title":"Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects","created":"2024-11-19","cited_by_count":7,"area":null},{"id":"2207.04922","title":"On uniform-in-time diffusion approximation for stochastic gradient descent","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2304.00707","title":"High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance","created":"2023-04-03","cited_by_count":6,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2602.14208","title":"Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws","created":"2026-02-15","cited_by_count":6,"area":null},{"id":"2110.15954","title":"Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training","created":"2021-10-29","cited_by_count":5,"area":null},{"id":"2309.02082","title":"Backward error analysis and the qualitative behaviour of stochastic optimization algorithms: Application to stochastic coordinate descent","created":"2023-09-05","cited_by_count":5,"area":null},{"id":"2310.14423","title":"A Quadratic Synchronization Rule for Distributed Deep Learning","created":"2023-10-22","cited_by_count":5,"area":null},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2105.08037","title":"Adversarial Training for Gradient Descent: Analysis Through its Continuous-time Approximation","created":"2021-05-17","cited_by_count":4,"area":null},{"id":"2506.00181","title":"On the Interaction of Batch Noise, Adaptivity, and Compression, under $(L_0,L_1)$-Smoothness: An SDE Approach","created":"2025-05-30","cited_by_count":4,"area":null},{"id":"2303.17805","title":"On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks","created":"2023-03-31","cited_by_count":3,"area":null},{"id":"2311.00274","title":"Generalization Bounds for Label Noise Stochastic Gradient Descent","created":"2023-11-01","cited_by_count":3,"area":null},{"id":"2407.02322","title":"Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent","created":"2024-07-02","cited_by_count":3,"area":null},{"id":"2510.24160","title":"Identifiable learning of dissipative dynamics","created":"2025-10-28","cited_by_count":3,"area":null},{"id":"2104.12210","title":"Generative Adversarial Network: Some Analytical Perspectives","created":"2021-04-25","cited_by_count":2,"area":null},{"id":"2112.00222","title":"Convergence of GANs Training: A Game and Stochastic Control Methodology","created":"2021-12-01","cited_by_count":2,"area":null},{"id":"2402.03467","title":"Stochastic Modified Flows for Riemannian Stochastic Gradient Descent","created":"2024-02-02","cited_by_count":2,"area":null},{"id":"2402.08344","title":"Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training","created":"2024-02-13","cited_by_count":2,"area":null},{"id":"2502.07584","title":"Generalization Bounds for Markov Algorithms through Entropy Flow Computations","created":"2025-02-11","cited_by_count":2,"area":null},{"id":"2503.22478","title":"Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent","created":"2025-03-28","cited_by_count":2,"area":null},{"id":"2506.18588","title":"Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks","created":"2025-06-23","cited_by_count":2,"area":null},{"id":"2508.21571","title":"Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equation","created":"2025-08-29","cited_by_count":2,"area":null},{"id":"2509.18001","title":"Unveiling m-Sharpness Through the Structure of Stochastic Gradient Noise","created":"2025-09-22","cited_by_count":2,"area":null},{"id":"2603.03226","title":"Adaptive Methods Are Preferable in High Privacy Settings: An SDE Perspective","created":"2026-03-03","cited_by_count":2,"area":null},{"id":"2210.00422","title":"Stochastic optimization on matrices and a graphon McKean-Vlasov limit","created":"2022-10-02","cited_by_count":1,"area":null},{"id":"2210.11257","title":"A note on diffusion limits for stochastic gradient descent","created":"2022-10-20","cited_by_count":1,"area":null},{"id":"2305.13882","title":"Subsampling Error in Stochastic Gradient Langevin Diffusions","created":"2023-05-23","cited_by_count":1,"area":null},{"id":"2307.02454","title":"Transgressing the boundaries: towards a rigorous understanding of deep learning and its (non-)robustness","created":"2023-07-05","cited_by_count":1,"area":null},{"id":"2311.02818","title":"Signal Processing Meets SGD: From Momentum to Filter","created":"2023-11-06","cited_by_count":1,"area":null},{"id":"2402.07626","title":"Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features","created":"2024-02-12","cited_by_count":1,"area":null},{"id":"2406.11159","title":"Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework","created":"2024-06-17","cited_by_count":1,"area":null},{"id":"2410.17297","title":"Error estimates between SGD with momentum and underdamped Langevin diffusion","created":"2024-10-22","cited_by_count":1,"area":null},{"id":"2508.07397","title":"A Spin Glass Characterization of Neural Networks","created":"2025-08-10","cited_by_count":1,"area":null},{"id":"2509.21614","title":"Effective continuous equations for adaptive SGD: a stochastic analysis view","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2511.02258","title":"Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks","created":"2025-11-04","cited_by_count":1,"area":null},{"id":"2602.15538","title":"Functional Central Limit Theorem for Stochastic Gradient Descent","created":"2026-02-17","cited_by_count":1,"area":null},{"id":"2603.06120","title":"Dynamic Momentum Recalibration in Online Gradient Learning","created":"2026-03-06","cited_by_count":1,"area":null},{"id":"2603.13872","title":"On Interpolation Formulas Describing Neural Network Generalization","created":"2026-03-14","cited_by_count":1,"area":null},{"id":"2604.08742","title":"Deterministic Adam-Inspired Methods with Accelerated Convergence Rate","created":"2026-04-09","cited_by_count":1,"area":null},{"id":"2607.06781","title":"On Explicit Super-Expressive Approximation for Neural Networks","created":"2026-07-07","cited_by_count":1,"area":null},{"id":"2607.23012","title":"Mini-batch Noise Lowers Sharpness via Dominant-Subspace Fluctuations","created":"2026-07-25","cited_by_count":1,"area":null},{"id":"2206.04359","title":"Learning Non-Vacuous Generalization Bounds from Optimization","created":"2022-06-09","cited_by_count":0,"area":null},{"id":"2207.00389","title":"Analysis of Kinetic Models for Label Switching and Stochastic Gradient Descent","created":"2022-07-01","cited_by_count":0,"area":null},{"id":"2304.00320","title":"Doubly Stochastic Models: Learning with Unbiased Label Noises and Inference Stability","created":"2023-04-01","cited_by_count":0,"area":null},{"id":"2305.18864","title":"Stochastic Gradient Langevin Dynamics Based on Quantization with Increasing Resolution","created":"2023-05-30","cited_by_count":0,"area":null},{"id":"2310.06081","title":"Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting","created":"2023-10-09","cited_by_count":0,"area":null},{"id":"2404.14358","title":"A General Continuous-Time Formulation of Stochastic ADMM and Its Variants","created":"2024-04-22","cited_by_count":0,"area":null},{"id":"2406.03696","title":"Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression","created":"2024-06-06","cited_by_count":0,"area":null},{"id":"2409.03749","title":"Dynamics of Supervised and Reinforcement Learning in the Non-Linear Perceptron","created":"2024-09-05","cited_by_count":0,"area":"deeprl"},{"id":"2410.19371","title":"Noise-Aware Differentially Private Variational Inference","created":"2024-10-25","cited_by_count":0,"area":null},{"id":"2505.00382","title":"Approximation to Deep Q-Network by Stochastic Delay Differential Equations","created":"2025-05-01","cited_by_count":0,"area":"deeprl"},{"id":"2505.18535","title":"Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD","created":"2025-05-24","cited_by_count":0,"area":null},{"id":"2506.14806","title":"Heavy-Ball Momentum Method in Continuous Time and Discretization Error Analysis","created":"2025-06-03","cited_by_count":0,"area":null},{"id":"2508.12834","title":"Optimal Condition for Initialization Variance in Deep Neural Networks: An SGD Dynamics Perspective","created":"2025-08-18","cited_by_count":0,"area":null},{"id":"2512.04703","title":"Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement","created":"2025-12-04","cited_by_count":0,"area":null},{"id":"2601.14695","title":"CoScale-RL: Efficient Post-Training by Co-Scaling Data and Computation","created":"2026-01-21","cited_by_count":0,"area":"lr"},{"id":"2605.25698","title":"How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling Laws","created":"2026-05-25","cited_by_count":0,"area":"moe"},{"id":"2605.29152","title":"Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias","created":"2026-05-27","cited_by_count":0,"area":null},{"id":"2606.00293","title":"Accurate Large-sample Uncertainty Quantification using Stochastic Gradient Markov Chain Monte Carlo","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.07495","title":"Second-Order Path Kernel Interpolation Formulas in Machine Learning","created":"2026-06-05","cited_by_count":0,"area":null}],"next_cursor":"100"}