{"total":68,"rows":[{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96,"area":null},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2310.07831","title":"Optimal Linear Decay Learning Rate Schedules and Further Refinements","created":"2023-10-11","cited_by_count":43,"area":null},{"id":"2102.03183","title":"Last iterate convergence of SGD for Least-Squares in the Interpolation regime","created":"2021-02-05","cited_by_count":42,"area":null},{"id":"2110.06198","title":"Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression","created":"2021-10-12","cited_by_count":38,"area":null},{"id":"2502.15938","title":"Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs","created":"2025-02-21","cited_by_count":35,"area":null},{"id":"2305.16252","title":"Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning","created":"2023-05-25","cited_by_count":27,"area":null},{"id":"2208.01857","title":"The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift","created":"2022-08-03","cited_by_count":26,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2406.15244","title":"AdaGrad under Anisotropic Smoothness","created":"2024-06-21","cited_by_count":22,"area":null},{"id":"2102.09393","title":"On the Convergence of Step Decay Step-Size for Stochastic Optimization","created":"2021-02-18","cited_by_count":21,"area":null},{"id":"2103.01089","title":"A Biased Graph Neural Network Sampler with Near-Optimal Regret","created":"2021-03-01","cited_by_count":17,"area":null},{"id":"2312.12670","title":"On the Role of Server Momentum in Federated Learning","created":"2023-12-19","cited_by_count":16,"area":null},{"id":"2110.14109","title":"Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums","created":"2021-10-27","cited_by_count":15,"area":null},{"id":"2103.01338","title":"Acceleration via Fractal Learning Rate Schedules","created":"2021-03-01","cited_by_count":13,"area":null},{"id":"2504.04579","title":"From Continual Learning to SGD and Back: Better Rates for Continual Linear Models","created":"2025-04-06","cited_by_count":12,"area":null},{"id":"2507.11274","title":"Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime","created":"2025-07-15","cited_by_count":12,"area":null},{"id":"2508.01483","title":"Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler","created":"2025-08-02","cited_by_count":12,"area":null},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2312.14567","title":"Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise","created":"2023-12-22","cited_by_count":9,"area":null},{"id":"2406.04657","title":"From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks","created":"2024-06-07","cited_by_count":9,"area":null},{"id":"2203.03159","title":"Risk Bounds of Multi-Pass SGD for Least Squares in the Interpolation Regime","created":"2022-03-07","cited_by_count":8,"area":null},{"id":"2303.02255","title":"Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron","created":"2023-03-03","cited_by_count":8,"area":null},{"id":"2409.09745","title":"The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization","created":"2024-09-15","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2303.15634","title":"Learning Rate Schedules in the Presence of Distribution Shift","created":"2023-03-27","cited_by_count":7,"area":null},{"id":"2510.17802","title":"Unbiased Gradient Low-Rank Projection","created":"2025-10-20","cited_by_count":7,"area":null},{"id":"2110.07435","title":"Adaptive Differentially Private Empirical Risk Minimization","created":"2021-10-14","cited_by_count":5,"area":null},{"id":"2201.04021","title":"Optimization Planning for 3D ConvNets","created":"2022-01-11","cited_by_count":5,"area":null},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4,"area":null},{"id":"2401.10989","title":"Provably Scalable Black-Box Variational Inference with Structured Variational Families","created":"2024-01-19","cited_by_count":4,"area":null},{"id":"2408.02707","title":"SnapE -- Training Snapshot Ensembles of Link Prediction Models","created":"2024-08-05","cited_by_count":4,"area":null},{"id":"2410.15639","title":"Can Large Language Models Invent Algorithms to Improve Themselves?: Algorithm Discovery for Recursive Self-Improvement through Reinforcement Learning","created":"2024-10-21","cited_by_count":4,"area":"synth"},{"id":"2505.22048","title":"Learning Curves of Stochastic Gradient Descent in Kernel Regression","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2203.09717","title":"Towards an AI-Driven Universal Anti-Jamming Solution with Convolutional Interference Cancellation Network","created":"2022-03-18","cited_by_count":3,"area":null},{"id":"2106.02888","title":"Bandwidth-based Step-Sizes for Non-Convex Stochastic Optimization","created":"2021-06-05","cited_by_count":2,"area":null},{"id":"2110.08764","title":"S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks","created":"2021-10-17","cited_by_count":2,"area":null},{"id":"2201.10245","title":"On Uniform Boundedness Properties of SGD and its Momentum Variants","created":"2022-01-25","cited_by_count":2,"area":null},{"id":"2403.00853","title":"Parallel Momentum Methods Under Biased Gradient Estimations","created":"2024-02-29","cited_by_count":2,"area":null},{"id":"2403.02347","title":"On the Convergence of Federated Learning Algorithms without Data Similarity","created":"2024-02-29","cited_by_count":2,"area":null},{"id":"2604.09909","title":"Last-Iterate Convergence of Randomized Kaczmarz and SGD with Greedy Step Size","created":"2026-04-10","cited_by_count":2,"area":null},{"id":"2108.00082","title":"Towards Continual Entity Learning in Language Models for Conversational Agents","created":"2021-07-30","cited_by_count":1,"area":null},{"id":"2312.14824","title":"An investigation of belief-free DRL and MCTS for inspection and maintenance planning","created":"2023-12-22","cited_by_count":1,"area":null},{"id":"2401.00379","title":"DREAM: Debugging and Repairing AutoML Pipelines","created":"2023-12-31","cited_by_count":1,"area":null},{"id":"2404.14811","title":"FLARE: A New Federated Learning Framework with Adjustable Learning Rates over Resource-Constrained Wireless Networks","created":"2024-04-23","cited_by_count":1,"area":null},{"id":"2406.05637","title":"A Generalized Version of Chung's Lemma and its Applications","created":"2024-06-09","cited_by_count":1,"area":null},{"id":"2505.24452","title":"Stepsize anything: A unified learning rate schedule for budgeted-iteration training","created":"2025-05-30","cited_by_count":1,"area":null},{"id":"2506.08419","title":"Online Learning-guided Learning Rate Adaptation via Gradient Alignment","created":"2025-06-10","cited_by_count":1,"area":null},{"id":"2101.01178","title":"Advances in Electron Microscopy with Deep Learning","created":"2021-01-04","cited_by_count":0,"area":null},{"id":"2212.06144","title":"Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks","created":"2022-12-09","cited_by_count":0,"area":null},{"id":"2302.11947","title":"Real-Time Damage Detection in Fiber Lifting Ropes Using Lightweight Convolutional Neural Networks","created":"2023-02-23","cited_by_count":0,"area":null},{"id":"2304.08589","title":"Fast and Straggler-Tolerant Distributed SGD with Reduced Computation Load","created":"2023-04-17","cited_by_count":0,"area":null},{"id":"2306.08998","title":"Team AcieLee: Technical Report for EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023","created":"2023-06-15","cited_by_count":0,"area":null},{"id":"2401.00691","title":"Stochastic Gradient Descent for Nonparametric Additive Regression","created":"2024-01-01","cited_by_count":0,"area":null},{"id":"2403.11163","title":"A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques","created":"2024-03-17","cited_by_count":0,"area":null},{"id":"2404.01257","title":"New logarithmic step size for stochastic gradient descent","created":"2024-04-01","cited_by_count":0,"area":null},{"id":"2406.04841","title":"Primitive Agentic First-Order Optimization","created":"2024-06-07","cited_by_count":0,"area":"agents"},{"id":"2407.15143","title":"Investigating Long-term Training for Remote Sensing Object Detection","created":"2024-07-21","cited_by_count":0,"area":null},{"id":"2503.02178","title":"Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators","created":"2025-03-04","cited_by_count":0,"area":null},{"id":"2503.09411","title":"Learning Rate Annealing Improves Tuning Robustness in Stochastic Optimization","created":"2025-03-12","cited_by_count":0,"area":null},{"id":"2507.01724","title":"Revisiting Learning Rate Control","created":"2025-07-02","cited_by_count":0,"area":null},{"id":"2510.20157","title":"ADP-VRSGP: Decentralized Learning with Adaptive Differential Privacy via Variance-Reduced Stochastic Gradient Push","created":"2025-10-23","cited_by_count":0,"area":null},{"id":"2601.15212","title":"ZENITH: Automated Gradient Norm Informed Stochastic Optimization","created":"2026-01-21","cited_by_count":0,"area":null},{"id":"2603.01951","title":"Accelerating Single-Pass SGD for Generalized Linear Prediction","created":"2026-03-02","cited_by_count":0,"area":null},{"id":"2606.29593","title":"How AI settled the complexity of the oldest SGD algorithm","created":"2026-06-28","cited_by_count":0,"area":null},{"id":"2610.16518","title":"Asymptotic Risk of Learning-Rate Schedules for Least-Squares Regression with Discretely Distributed Features","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}