{"total":64,"rows":[{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96,"area":null},{"id":"2103.12692","title":"Benign Overfitting of Constant-Stepsize SGD for Linear Regression","created":"2021-03-23","cited_by_count":71,"area":null},{"id":"2411.18704","title":"Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefits","created":"2024-11-27","cited_by_count":71,"area":null},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2201.03398","title":"Multiplayer Performative Prediction: Learning in Decision-Dependent Games","created":"2022-01-10","cited_by_count":44,"area":null},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43,"area":null},{"id":"2102.03183","title":"Last iterate convergence of SGD for Least-Squares in the Interpolation regime","created":"2021-02-05","cited_by_count":42,"area":null},{"id":"2302.06570","title":"Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD","created":"2023-02-13","cited_by_count":41,"area":null},{"id":"2110.06198","title":"Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression","created":"2021-10-12","cited_by_count":38,"area":null},{"id":"2108.04552","title":"The Benefits of Implicit Regularization from SGD in Least Squares Problems","created":"2021-08-10","cited_by_count":32,"area":null},{"id":"2405.17583","title":"Understanding Forgetting in Continual Learning with Linear Regression","created":"2024-05-27","cited_by_count":30,"area":null},{"id":"2208.01857","title":"The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift","created":"2022-08-03","cited_by_count":26,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2406.15244","title":"AdaGrad under Anisotropic Smoothness","created":"2024-06-21","cited_by_count":22,"area":null},{"id":"2107.00464","title":"On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averaging","created":"2021-06-30","cited_by_count":18,"area":null},{"id":"2210.04994","title":"Sampling-based inference for large linear models, with application to linearised Laplace","created":"2022-10-10","cited_by_count":18,"area":null},{"id":"2310.20581","title":"Stochastic Gradient Descent for Gaussian Processes Done Right","created":"2023-10-31","cited_by_count":17,"area":null},{"id":"2305.15938","title":"First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities","created":"2023-05-25","cited_by_count":14,"area":null},{"id":"2306.11497","title":"Convergence and concentration properties of constant step-size SGD through Markov chains","created":"2023-06-20","cited_by_count":11,"area":null},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2102.07002","title":"On the Last Iterate Convergence of Momentum Methods","created":"2021-02-13","cited_by_count":10,"area":null},{"id":"2206.09136","title":"Provable Generalization of Overparameterized Meta-learning Trained with SGD","created":"2022-06-18","cited_by_count":9,"area":null},{"id":"2312.14567","title":"Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise","created":"2023-12-22","cited_by_count":9,"area":null},{"id":"2203.03159","title":"Risk Bounds of Multi-Pass SGD for Least Squares in the Interpolation Regime","created":"2022-03-07","cited_by_count":8,"area":null},{"id":"2409.09745","title":"The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization","created":"2024-09-15","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2402.03839","title":"Random features models: a way to study the success of naive imputation","created":"2024-02-06","cited_by_count":7,"area":null},{"id":"2405.05818","title":"Fine-grained Analysis and Faster Algorithms for Iteratively Solving Linear Systems","created":"2024-05-09","cited_by_count":7,"area":null},{"id":"2207.04686","title":"(Nearly) Optimal Private Linear Regression via Adaptive Clipping","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2306.05325","title":"Federated Learning under Covariate Shifts with Generalization Guarantees","created":"2023-06-08","cited_by_count":6,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2106.05397","title":"From inexact optimization to learning via gradient concentration","created":"2021-06-09","cited_by_count":4,"area":null},{"id":"2301.03125","title":"Sharper Analysis for Minibatch Stochastic Proximal Point Methods: Stability, Smoothness, and Deviation","created":"2023-01-09","cited_by_count":4,"area":null},{"id":"2505.22048","title":"Learning Curves of Stochastic Gradient Descent in Kernel Regression","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2310.02941","title":"Hoeffding's Inequality for Markov Chains under Generalized Concentrability Condition","created":"2023-10-04","cited_by_count":3,"area":null},{"id":"2403.08585","title":"Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems","created":"2024-03-13","cited_by_count":3,"area":null},{"id":"2507.03404","title":"On the Effectiveness of the z-Transform Method in Quadratic Optimization","created":"2025-07-04","cited_by_count":3,"area":null},{"id":"2508.00180","title":"EMA Without the Lag: Bias-Corrected Iterate Averaging Schemes","created":"2025-07-31","cited_by_count":3,"area":null},{"id":"2205.12549","title":"Learning from time-dependent streaming data with online stochastic algorithms","created":"2022-05-25","cited_by_count":2,"area":null},{"id":"2410.04228","title":"SGD with memory: fundamental properties and stochastic acceleration","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2410.17998","title":"Estimating the Spectral Moments of the Kernel Integral Operator from Finite Sample Matrices","created":"2024-10-23","cited_by_count":2,"area":null},{"id":"2503.00504","title":"On the Saturation Effects of Spectral Algorithms in Large Dimensions","created":"2025-03-01","cited_by_count":2,"area":null},{"id":"2508.14338","title":"On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks","created":"2025-08-20","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2106.08855","title":"Beyond Tikhonov: Faster Learning with Self-Concordant Losses via Iterative Regularization","created":"2021-06-16","cited_by_count":1,"area":null},{"id":"2202.01463","title":"Minimax rate of consistency for linear models with missing values","created":"2022-02-03","cited_by_count":1,"area":null},{"id":"2311.03483","title":"Hebbian learning inspired estimation of the linear regression parameters from queries","created":"2023-09-26","cited_by_count":1,"area":null},{"id":"2406.18623","title":"Unbiased least squares regression via averaged stochastic gradient descent","created":"2024-06-26","cited_by_count":1,"area":null},{"id":"2408.04313","title":"Better Locally Private Sparse Estimation Given Multiple Samples Per User","created":"2024-08-08","cited_by_count":1,"area":null},{"id":"2502.14123","title":"Understanding SGD with Exponential Moving Average: A Case Study in Linear Regression","created":"2025-02-19","cited_by_count":1,"area":"diffusion"},{"id":"2509.21174","title":"Breaking the curse of dimensionality for linear rules: optimal predictors over the ellipsoid","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2102.00853","title":"Painless step size adaptation for SGD","created":"2021-02-01","cited_by_count":0,"area":null},{"id":"2104.02578","title":"Neurons learn slower than they think","created":"2021-04-02","cited_by_count":0,"area":null},{"id":"2109.03207","title":"COCO Denoiser: Using Co-Coercivity for Variance Reduction in Stochastic Convex Optimization","created":"2021-09-07","cited_by_count":0,"area":null},{"id":"2304.00320","title":"Doubly Stochastic Models: Learning with Unbiased Label Noises and Inference Stability","created":"2023-04-01","cited_by_count":0,"area":null},{"id":"2309.07779","title":"Convergence analysis of online algorithms for vector-valued kernel regression","created":"2023-09-14","cited_by_count":0,"area":null},{"id":"2407.10955","title":"Enhancing Stochastic Optimization for Statistical Efficiency Using ROOT-SGD with Diminishing Stepsize","created":"2024-07-15","cited_by_count":0,"area":null},{"id":"2503.02178","title":"Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators","created":"2025-03-04","cited_by_count":0,"area":null},{"id":"2510.14222","title":"A novel Information-Driven Strategy for Optimal Regression Assessment","created":"2025-10-16","cited_by_count":0,"area":null},{"id":"2601.01160","title":"Gradient-Free Approaches is a Key to an Efficient Interaction with Markovian Stochasticity","created":"2026-01-03","cited_by_count":0,"area":null},{"id":"2602.02083","title":"Handling Covariate Mismatch in Collaborative Linear Prediction","created":"2026-02-02","cited_by_count":0,"area":null},{"id":"2603.01951","title":"Accelerating Single-Pass SGD for Generalized Linear Prediction","created":"2026-03-02","cited_by_count":0,"area":null},{"id":"2605.00473","title":"Near-optimal and Efficient First-Order Algorithm for Multi-Task Learning with Shared Linear Representation","created":"2026-05-01","cited_by_count":0,"area":null},{"id":"2608.22953","title":"Stochastic gradient descent with initial regularization","created":"2026-08-24","cited_by_count":0,"area":null}],"next_cursor":null}