{"total":57,"rows":[{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110,"area":null},{"id":"2103.13822","title":"FedCor: Correlation-Based Active Client Selection Strategy for Heterogeneous Federated Learning","created":"2021-03-24","cited_by_count":43,"area":null},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39,"area":null},{"id":"2302.08982","title":"(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability","created":"2023-02-17","cited_by_count":36,"area":null},{"id":"2303.02749","title":"Revisiting the Noise Model of Stochastic Gradient Descent","created":"2023-03-05","cited_by_count":36,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2501.06842","title":"SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training","created":"2025-01-12","cited_by_count":28,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2205.07069","title":"Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties","created":"2022-05-14","cited_by_count":27,"area":null},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2405.14578","title":"Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling","created":"2024-05-23","cited_by_count":22,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2106.03696","title":"Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models","created":"2021-06-07","cited_by_count":16,"area":null},{"id":"2302.02766","title":"Generalization Bounds with Data-dependent Fractal Dimensions","created":"2023-02-06","cited_by_count":15,"area":null},{"id":"2510.27486","title":"FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models","created":"2025-10-31","cited_by_count":15,"area":null},{"id":"2205.08187","title":"Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility","created":"2022-05-17","cited_by_count":13,"area":null},{"id":"2410.22729","title":"Identifying Drift, Diffusion, and Causal Structure from Temporal Snapshots","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2102.07006","title":"Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections","created":"2021-02-13","cited_by_count":12,"area":null},{"id":"2107.09028","title":"Structured Stochastic Gradient MCMC","created":"2021-07-19","cited_by_count":12,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2108.03947","title":"On the Hyperparameters in Stochastic Gradient Descent with Momentum","created":"2021-08-09","cited_by_count":9,"area":null},{"id":"2112.03754","title":"A Continuous-time Stochastic Gradient Descent Method for Continuous Data","created":"2021-12-07","cited_by_count":7,"area":null},{"id":"2406.11733","title":"To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions","created":"2024-06-17","cited_by_count":7,"area":null},{"id":"2206.01944","title":"Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptile","created":"2022-06-04","cited_by_count":6,"area":null},{"id":"2310.10379","title":"Revisiting Logistic-softmax Likelihood in Bayesian Meta-Learning for Few-Shot Classification","created":"2023-10-16","cited_by_count":6,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2108.00918","title":"Communication-Efficient Federated Learning via Predictive Coding","created":"2021-08-02","cited_by_count":5,"area":null},{"id":"2111.04004","title":"Exponential escape efficiency of SGD from sharp minima in non-stationary regime","created":"2021-11-07","cited_by_count":5,"area":null},{"id":"2201.04545","title":"On generalization bounds for deep networks based on loss surface implicit regularization","created":"2022-01-12","cited_by_count":5,"area":null},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2506.03849","title":"Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models","created":"2025-06-04","cited_by_count":5,"area":"diffusion"},{"id":"2402.01382","title":"Emergence of heavy tails in homogenized stochastic gradient descent","created":"2024-02-02","cited_by_count":4,"area":null},{"id":"2506.00181","title":"On the Interaction of Batch Noise, Adaptivity, and Compression, under $(L_0,L_1)$-Smoothness: An SDE Approach","created":"2025-05-30","cited_by_count":4,"area":null},{"id":"2210.06401","title":"Improving information retention in large scale online continual learning","created":"2022-10-12","cited_by_count":3,"area":null},{"id":"2411.00119","title":"Soft Condorcet Optimization for Ranking of General Agents","created":"2024-10-31","cited_by_count":3,"area":null},{"id":"2312.03792","title":"PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance","created":"2023-12-06","cited_by_count":2,"area":null},{"id":"2403.13868","title":"Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations","created":"2024-03-20","cited_by_count":2,"area":null},{"id":"2502.07584","title":"Generalization Bounds for Markov Algorithms through Entropy Flow Computations","created":"2025-02-11","cited_by_count":2,"area":null},{"id":"2503.22478","title":"Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent","created":"2025-03-28","cited_by_count":2,"area":null},{"id":"2603.03226","title":"Adaptive Methods Are Preferable in High Privacy Settings: An SDE Perspective","created":"2026-03-03","cited_by_count":2,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2402.07626","title":"Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features","created":"2024-02-12","cited_by_count":1,"area":null},{"id":"2406.11159","title":"Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework","created":"2024-06-17","cited_by_count":1,"area":null},{"id":"2509.16959","title":"Graph Coloring for Multi-Task Learning","created":"2025-09-21","cited_by_count":1,"area":null},{"id":"2603.13872","title":"On Interpolation Formulas Describing Neural Network Generalization","created":"2026-03-14","cited_by_count":1,"area":null},{"id":"2604.19846","title":"Neural posterior estimation of the neutrino direction in IceCube using transformer-encoded normalizing flows on the sphere","created":"2026-04-21","cited_by_count":1,"area":null},{"id":"2105.14694","title":"Combining resampling and reweighting for faithful stochastic optimization","created":"2021-05-31","cited_by_count":0,"area":null},{"id":"2403.10671","title":"Variation Due to Regularization Tractably Recovers Bayesian Deep Learning","created":"2024-03-15","cited_by_count":0,"area":null},{"id":"2410.19371","title":"Noise-Aware Differentially Private Variational Inference","created":"2024-10-25","cited_by_count":0,"area":null},{"id":"2504.03902","title":"Stochastic Variational Inference with Tuneable Stochastic Annealing","created":"2025-04-04","cited_by_count":0,"area":null},{"id":"2508.19028","title":"GRADSTOP: Early Stopping of Gradient Descent via Posterior Sampling","created":"2025-08-26","cited_by_count":0,"area":null},{"id":"2512.11089","title":"TPV: Parameter Perturbations Through the Lens of Test Prediction Variance","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2605.19195","title":"The Thermodynamic Costs of Simple Linear Regression","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2606.07495","title":"Second-Order Path Kernel Interpolation Formulas in Machine Learning","created":"2026-06-05","cited_by_count":0,"area":null},{"id":"2609.09589","title":"A Function-Space Approach to the Statistical Mechanics of Learning Dynamics","created":"2026-09-09","cited_by_count":0,"area":null},{"id":"2610.13524","title":"Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}