{"total":68,"rows":[{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43,"area":null},{"id":"2110.06198","title":"Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression","created":"2021-10-12","cited_by_count":38,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2108.04552","title":"The Benefits of Implicit Regularization from SGD in Least Squares Problems","created":"2021-08-10","cited_by_count":32,"area":null},{"id":"2405.17583","title":"Understanding Forgetting in Continual Learning with Linear Regression","created":"2024-05-27","cited_by_count":30,"area":null},{"id":"2207.06475","title":"Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime","created":"2022-06-01","cited_by_count":29,"area":null},{"id":"2306.11589","title":"Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent","created":"2023-06-20","cited_by_count":27,"area":null},{"id":"2208.01857","title":"The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift","created":"2022-08-03","cited_by_count":26,"area":null},{"id":"2210.05021","title":"The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective","created":"2022-10-10","cited_by_count":24,"area":null},{"id":"2107.05074","title":"SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs","created":"2021-07-11","cited_by_count":22,"area":null},{"id":"2107.01641","title":"A Theoretical Analysis of Fine-tuning with Linear Teachers","created":"2021-07-04","cited_by_count":17,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2504.04579","title":"From Continual Learning to SGD and Back: Better Rates for Continual Linear Models","created":"2025-04-06","cited_by_count":12,"area":null},{"id":"2112.15250","title":"Benign Overfitting in Adversarially Robust Linear Classification","created":"2021-12-31","cited_by_count":11,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2406.04425","title":"On Regularization via Early Stopping for Least Squares Regression","created":"2024-06-06","cited_by_count":11,"area":null},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2305.19377","title":"Benign Overfitting in Deep Neural Networks under Lazy Training","created":"2023-05-30","cited_by_count":10,"area":null},{"id":"2310.01975","title":"Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data","created":"2023-10-03","cited_by_count":10,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9,"area":null},{"id":"2203.01744","title":"Accelerated SGD for Non-Strongly-Convex Least Squares","created":"2022-03-03","cited_by_count":9,"area":null},{"id":"2206.09136","title":"Provable Generalization of Overparameterized Meta-learning Trained with SGD","created":"2022-06-18","cited_by_count":9,"area":null},{"id":"2210.14184","title":"Learning Ability of Interpolating Deep Convolutional Neural Networks","created":"2022-10-25","cited_by_count":9,"area":null},{"id":"2502.13283","title":"Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression","created":"2025-02-18","cited_by_count":9,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2203.03159","title":"Risk Bounds of Multi-Pass SGD for Least Squares in the Interpolation Regime","created":"2022-03-07","cited_by_count":8,"area":null},{"id":"2303.02255","title":"Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron","created":"2023-03-03","cited_by_count":8,"area":null},{"id":"2409.09745","title":"The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization","created":"2024-09-15","cited_by_count":8,"area":null},{"id":"2207.11621","title":"A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors","created":"2022-07-23","cited_by_count":7,"area":null},{"id":"2211.10837","title":"Non-reversible Parallel Tempering for Deep Posterior Approximation","created":"2022-11-20","cited_by_count":7,"area":null},{"id":"2303.17940","title":"Per-Example Gradient Regularization Improves Learning Signals from Noisy Data","created":"2023-03-31","cited_by_count":7,"area":null},{"id":"2306.09955","title":"Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign?","created":"2023-06-16","cited_by_count":7,"area":null},{"id":"2403.17592","title":"On the Benefits of Over-parameterization for Out-of-Distribution Generalization","created":"2024-03-26","cited_by_count":7,"area":null},{"id":"2403.06903","title":"Benign overfitting in leaky ReLU networks with moderate input dimension","created":"2024-03-11","cited_by_count":6,"area":null},{"id":"2510.14717","title":"Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling","created":"2025-10-16","cited_by_count":6,"area":null},{"id":"2106.06153","title":"Towards Understanding Generalization via Decomposing Excess Risk Dynamics","created":"2021-06-11","cited_by_count":5,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2206.00501","title":"Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models","created":"2022-06-01","cited_by_count":5,"area":null},{"id":"2505.22048","title":"Learning Curves of Stochastic Gradient Descent in Kernel Regression","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2506.15535","title":"A Simplified Analysis of SGD for Linear Regression with Weight Averaging","created":"2025-06-18","cited_by_count":4,"area":null},{"id":"2202.06054","title":"Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression","created":"2022-02-12","cited_by_count":3,"area":null},{"id":"2403.08585","title":"Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems","created":"2024-03-13","cited_by_count":3,"area":null},{"id":"2503.06009","title":"Nearly Optimal Differentially Private ReLU Regression","created":"2025-03-08","cited_by_count":3,"area":null},{"id":"2308.03215","title":"The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning","created":"2023-08-06","cited_by_count":2,"area":null},{"id":"2410.04228","title":"SGD with memory: fundamental properties and stochastic acceleration","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2502.12508","title":"Understanding Generalization in Transformers: Error Bounds and Training Dynamics Under Benign and Harmful Overfitting","created":"2025-02-18","cited_by_count":2,"area":null},{"id":"2508.14338","title":"On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks","created":"2025-08-20","cited_by_count":2,"area":null},{"id":"2604.09909","title":"Last-Iterate Convergence of Randomized Kaczmarz and SGD with Greedy Step Size","created":"2026-04-10","cited_by_count":2,"area":null},{"id":"2606.19179","title":"Compute Efficiency and Serial Runtime Tradeoffs for Stochastic Momentum Methods","created":"2026-06-17","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2302.09727","title":"Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression","created":"2023-02-20","cited_by_count":1,"area":null},{"id":"2510.19734","title":"Statistical Inference for Linear Functionals of Online Least-squares SGD when $t \\gtrsim d^{1+\\delta}$","created":"2025-10-22","cited_by_count":1,"area":null},{"id":"2602.00825","title":"Harmful Overfitting in Sobolev Spaces","created":"2026-01-31","cited_by_count":1,"area":null},{"id":"2607.16638","title":"De-floored Principal Component Regression: When Rank Selection Alone Is Insufficient for Prediction","created":"2026-07-18","cited_by_count":1,"area":null},{"id":"2210.11562","title":"Local SGD in Overparameterized Linear Regression","created":"2022-10-20","cited_by_count":0,"area":null},{"id":"2305.12883","title":"Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors","created":"2023-05-22","cited_by_count":0,"area":null},{"id":"2308.09430","title":"Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent","created":"2023-08-18","cited_by_count":0,"area":null},{"id":"2401.00691","title":"Stochastic Gradient Descent for Nonparametric Additive Regression","created":"2024-01-01","cited_by_count":0,"area":null},{"id":"2410.14667","title":"SGD Jittering: A Training Strategy for Robust and Accurate Model-Based Architectures","created":"2024-10-18","cited_by_count":0,"area":null},{"id":"2602.22936","title":"Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks","created":"2026-02-26","cited_by_count":0,"area":null},{"id":"2603.01951","title":"Accelerating Single-Pass SGD for Generalized Linear Prediction","created":"2026-03-02","cited_by_count":0,"area":null},{"id":"2608.22953","title":"Stochastic gradient descent with initial regularization","created":"2026-08-24","cited_by_count":0,"area":null},{"id":"2609.33041","title":"Balancing Early Performance Sacrifices with Long-Term Gains: Scaling Learning-Rate Warmup Duration Across Training Horizons","created":"2026-09-27","cited_by_count":0,"area":null}],"next_cursor":null}