{"total":88,"rows":[{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70,"area":null},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43,"area":null},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39,"area":null},{"id":"2105.01650","title":"Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis","created":"2021-05-04","cited_by_count":39,"area":null},{"id":"2111.03741","title":"Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective","created":"2021-11-05","cited_by_count":38,"area":null},{"id":"2210.00953","title":"Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes","created":"2022-10-03","cited_by_count":30,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2106.00797","title":"QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learning","created":"2021-06-01","cited_by_count":26,"area":null},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23,"area":null},{"id":"2105.11558","title":"Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systems","created":"2021-05-24","cited_by_count":17,"area":null},{"id":"2401.13884","title":"Constant Stepsize Q-learning: Distributional Convergence, Bias and Extrapolation","created":"2024-01-25","cited_by_count":17,"area":"deeprl"},{"id":"2401.15719","title":"Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning","created":"2024-01-28","cited_by_count":17,"area":null},{"id":"2504.09951","title":"Towards Weaker Variance Assumptions for Stochastic Optimization","created":"2025-04-14","cited_by_count":17,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2111.06328","title":"Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization","created":"2021-11-11","cited_by_count":13,"area":null},{"id":"2102.07586","title":"On Riemannian Stochastic Approximation Schemes with Fixed Step-Size","created":"2021-02-15","cited_by_count":12,"area":null},{"id":"2209.08951","title":"Generalization Bounds for Stochastic Gradient Descent via Localized $\\varepsilon$-Covers","created":"2022-09-19","cited_by_count":11,"area":null},{"id":"2306.11497","title":"Convergence and concentration properties of constant step-size SGD through Markov chains","created":"2023-06-20","cited_by_count":11,"area":null},{"id":"2307.14642","title":"Linear Convergence of Black-Box Variational Inference: Should We Stick the Landing?","created":"2023-07-27","cited_by_count":10,"area":null},{"id":"2502.06719","title":"Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent","created":"2025-02-10","cited_by_count":10,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2405.14285","title":"Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise","created":"2024-05-23","cited_by_count":9,"area":null},{"id":"2306.05862","title":"Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often!","created":"2023-06-09","cited_by_count":8,"area":null},{"id":"2308.01481","title":"Online covariance estimation for stochastic gradient descent under Markovian sampling","created":"2023-08-03","cited_by_count":7,"area":null},{"id":"2102.05198","title":"Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm","created":"2021-02-10","cited_by_count":6,"area":null},{"id":"2202.04732","title":"Online Learning to Transport via the Minimal Selection Principle","created":"2022-02-09","cited_by_count":6,"area":null},{"id":"2209.07446","title":"Efficiency Ordering of Stochastic Gradient Descent","created":"2022-09-15","cited_by_count":6,"area":null},{"id":"2304.00707","title":"High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance","created":"2023-04-03","cited_by_count":6,"area":null},{"id":"2306.16502","title":"Stochastic Methods in Variational Inequalities: Ergodicity, Bias and Refinements","created":"2023-06-28","cited_by_count":6,"area":null},{"id":"2410.05106","title":"Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation","created":"2024-10-07","cited_by_count":6,"area":null},{"id":"2111.04004","title":"Exponential escape efficiency of SGD from sharp minima in non-stationary regime","created":"2021-11-07","cited_by_count":5,"area":null},{"id":"2312.10894","title":"Effectiveness of Constant Stepsize in Markovian LSA and Statistical Inference","created":"2023-12-18","cited_by_count":5,"area":null},{"id":"2410.13067","title":"Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way","created":"2024-10-16","cited_by_count":5,"area":null},{"id":"2103.09027","title":"Repurposing Pretrained Models for Robust Out-of-domain Few-Shot Learning","created":"2021-03-16","cited_by_count":4,"area":null},{"id":"2207.12395","title":"Tuning Stochastic Gradient Algorithms for Statistical Inference via Large-Sample Asymptotics","created":"2022-07-25","cited_by_count":4,"area":null},{"id":"2309.17316","title":"Robust Stochastic Optimization via Gradient Quantile Clipping","created":"2023-09-29","cited_by_count":3,"area":null},{"id":"2310.18455","title":"Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent","created":"2023-10-27","cited_by_count":3,"area":null},{"id":"2404.06023","title":"Prelimit Coupling and Steady-State Convergence of Constant-stepsize Nonsmooth Contractive SA","created":"2024-04-09","cited_by_count":3,"area":"deeprl"},{"id":"2504.04274","title":"Randomised Splitting Methods and Stochastic Gradient Descent","created":"2025-04-05","cited_by_count":3,"area":null},{"id":"2504.08178","title":"A Piecewise Lyapunov Analysis of Sub-quadratic SGD: Applications to Robust and Quantile Regression","created":"2025-04-11","cited_by_count":3,"area":null},{"id":"2405.13726","title":"Score-based Generative Models with Adaptive Momentum","created":"2024-05-22","cited_by_count":2,"area":"diffusion"},{"id":"2408.01736","title":"Can LLMs predict the convergence of Stochastic Gradient Descent?","created":"2024-08-03","cited_by_count":2,"area":null},{"id":"2502.07584","title":"Generalization Bounds for Markov Algorithms through Entropy Flow Computations","created":"2025-02-11","cited_by_count":2,"area":null},{"id":"2510.12013","title":"Statistical Guarantees for High-Dimensional Stochastic Gradient Descent","created":"2025-10-13","cited_by_count":2,"area":null},{"id":"2602.10691","title":"Convergence Rates for Distribution Matching with Sliced Optimal Transport","created":"2026-02-11","cited_by_count":2,"area":null},{"id":"2606.17364","title":"A Polyak-Ruppert Central Limit Theorem for SA-Adam with Momentum and Non-Convergent Adaptive Preconditioning","created":"2026-06-15","cited_by_count":2,"area":null},{"id":"2105.10347","title":"Quantifying the mini-batching error in Bayesian inference for Adaptive Langevin dynamics","created":"2021-05-21","cited_by_count":1,"area":null},{"id":"2202.09688","title":"A Variance-Reduced Stochastic Accelerated Primal Dual Algorithm","created":"2022-02-19","cited_by_count":1,"area":null},{"id":"2204.11897","title":"Reinforcement Teaching","created":"2022-04-25","cited_by_count":1,"area":null},{"id":"2302.09727","title":"Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression","created":"2023-02-20","cited_by_count":1,"area":null},{"id":"2406.05869","title":"An Analysis of Elo Rating Systems via Markov Chains","created":"2024-06-09","cited_by_count":1,"area":null},{"id":"2505.08125","title":"Sharp Gaussian approximations for Decentralized Federated Learning","created":"2025-05-12","cited_by_count":1,"area":null},{"id":"2508.05570","title":"High-Order Error Bounds for Markovian LSA with Richardson-Romberg Extrapolation","created":"2025-08-07","cited_by_count":1,"area":null},{"id":"2509.13628","title":"Accelerated Gradient Methods with Biased Gradient Estimates: Risk Sensitivity, High-Probability Guarantees, and Large Deviation Bounds","created":"2025-09-17","cited_by_count":1,"area":null},{"id":"2510.10739","title":"A Stochastic Differential Equation Framework for Multi-Objective LLM Interactions: Dynamical Systems Analysis with Code Generation Applications","created":"2025-10-12","cited_by_count":1,"area":null},{"id":"2510.19734","title":"Statistical Inference for Linear Functionals of Online Least-squares SGD when $t \\gtrsim d^{1+\\delta}$","created":"2025-10-22","cited_by_count":1,"area":null},{"id":"2601.07021","title":"Tight Analysis of Decentralized SGD: A Markov Chain Perspective","created":"2026-01-11","cited_by_count":1,"area":null},{"id":"2602.15538","title":"Functional Central Limit Theorem for Stochastic Gradient Descent","created":"2026-02-17","cited_by_count":1,"area":null},{"id":"2604.10373","title":"Shuffling the Data, Stretching the Step-size: Sharper Bias in constant step-size SGD","created":"2026-04-11","cited_by_count":1,"area":null},{"id":"2112.07110","title":"Non-Asymptotic Analysis of Online Multiplicative Stochastic Gradient Descent","created":"2021-12-14","cited_by_count":0,"area":null},{"id":"2212.12675","title":"Iterative regularization in classification via hinge loss diagonal descent","created":"2022-12-24","cited_by_count":0,"area":null},{"id":"2302.09376","title":"Why is parameter averaging beneficial in SGD? An objective smoothing perspective","created":"2023-02-18","cited_by_count":0,"area":null},{"id":"2403.11163","title":"A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques","created":"2024-03-17","cited_by_count":0,"area":null},{"id":"2406.16032","title":"Effect of Random Learning Rate: Theoretical Analysis of SGD Dynamics in Non-Convex Optimization via Stationary Distribution","created":"2024-06-23","cited_by_count":0,"area":null},{"id":"2407.10955","title":"Enhancing Stochastic Optimization for Statistical Efficiency Using ROOT-SGD with Diminishing Stepsize","created":"2024-07-15","cited_by_count":0,"area":null},{"id":"2412.01389","title":"Refined Analysis of Federated Averaging and Federated Richardson-Romberg","created":"2024-12-02","cited_by_count":0,"area":null},{"id":"2412.11341","title":"Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent","created":"2024-12-15","cited_by_count":0,"area":null},{"id":"2503.02178","title":"Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators","created":"2025-03-04","cited_by_count":0,"area":null},{"id":"2505.10605","title":"An Exponential Averaging Process with Strong Convergence Properties","created":"2025-05-15","cited_by_count":0,"area":null},{"id":"2508.13639","title":"Explainable Learning Rate Regimes for Stochastic Optimization","created":"2025-08-19","cited_by_count":0,"area":null},{"id":"2512.08132","title":"Multi-agent learning under uncertainty: Recurrence vs. concentration","created":"2025-12-09","cited_by_count":0,"area":null},{"id":"2512.08138","title":"Robust equilibria in continuous games: From strategic to dynamic robustness","created":"2025-12-09","cited_by_count":0,"area":null},{"id":"2605.07551","title":"Disagreement-Regularized Importance Sampling for Adversarial Label Corruption","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2606.00293","title":"Accurate Large-sample Uncertainty Quantification using Stochastic Gradient Markov Chain Monte Carlo","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.00309","title":"Large-scale Uncertainty Quantification for Latent Variable Models Using Subsampling Markov Chain Monte Carlo","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.07841","title":"Large-scale empirical tuning and comparison of default optimizers for variational inference","created":"2026-06-05","cited_by_count":0,"area":null},{"id":"2606.28123","title":"Dangerous Liaisons of Convex Learning and Non-Affine Aggregation","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2607.06643","title":"The Power of Backdoor Absorption in Community Training","created":"2026-07-07","cited_by_count":0,"area":null},{"id":"2607.12360","title":"Same Loss, Same Noise, Opposite Schedules: Noise Structure and Optimizer Normalization Jointly Determine Whether Learning-Rate Cooldown Helps","created":"2026-07-14","cited_by_count":0,"area":null},{"id":"2608.26765","title":"Beyond Client Averaging: A Client-Independent Second-Order Stationary-Bias Component in Stochastic SCAFFOLD","created":"2026-08-27","cited_by_count":0,"area":null},{"id":"2609.29674","title":"The Sequential Price of Continual Learning","created":"2026-08-30","cited_by_count":0,"area":null},{"id":"2609.30499","title":"Ordinary Nonconvex SGD under Distance-Dependent Moments: Finite-Horizon Stationarity and Nagaev Bounds","created":"2026-09-24","cited_by_count":0,"area":null},{"id":"2609.39144","title":"Sharp Stationary Gaussian Approximation for Constant-Stepsize SGD","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.05599","title":"Gaussian Limits for SGD Without Stationary Moments","created":"2026-10-04","cited_by_count":0,"area":null},{"id":"2610.13916","title":"Markov Chain Convergence in Kernel-Induced Geometry","created":"2026-10-09","cited_by_count":0,"area":null},{"id":"2610.16030","title":"Limit Theory for Online Expectile Estimation under Short and Long Range Dependence","created":"2026-10-12","cited_by_count":0,"area":null},{"id":"2610.16034","title":"A Nonlinear Time-Series Theory for Constant-step SGD with Momentum","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}