{"list":"other","total":51,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1503.00036","title":"Norm-Based Capacity Control in Neural Networks","created":"2015-02-27","cited_by_count":299},{"id":"1810.01075","title":"Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning","created":"2018-10-02","cited_by_count":215},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2002.06716","title":"Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data","created":"2020-02-17","cited_by_count":115},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"2405.15074","title":"4+3 Phases of Compute-Optimal Neural Scaling Laws","created":"2024-05-23","cited_by_count":68},{"id":"2304.00488","title":"Saddle-to-Saddle Dynamics in Diagonal Linear Networks","created":"2023-04-02","cited_by_count":57},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56},{"id":"2004.09031","title":"Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification","created":"2020-04-20","cited_by_count":53},{"id":"2210.08571","title":"Dimension free ridge regression","created":"2022-10-16","cited_by_count":51},{"id":"2006.15459","title":"Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions","created":"2020-06-27","cited_by_count":50},{"id":"2105.02180","title":"A unifying tutorial on Approximate Message Passing","created":"2021-05-05","cited_by_count":50},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35},{"id":"2504.19983","title":"Emergence and scaling laws in SGD learning of shallow neural networks","created":"2025-04-28","cited_by_count":32},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30},{"id":"2403.08938","title":"A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator","created":"2024-03-13","cited_by_count":28},{"id":"2508.03688","title":"Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws","created":"2025-08-05","cited_by_count":25},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23},{"id":"2311.03794","title":"On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions","created":"2023-11-07","cited_by_count":21},{"id":"1606.01800","title":"Finite Sample Analysis of Approximate Message Passing Algorithms","created":"2016-06-06","cited_by_count":20},{"id":"2208.03313","title":"A Non-Asymptotic Framework for Approximate Message Passing in Spiked Models","created":"2022-08-05","cited_by_count":20},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15},{"id":"2503.14121","title":"Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications","created":"2025-03-18","cited_by_count":11},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10},{"id":"2507.12709","title":"From SGD to Spectra: A Theory of Neural Network Weight Dynamics","created":"2025-07-17","cited_by_count":9},{"id":"2310.01169","title":"Fitting an ellipsoid to random points: predictions using the replica method","created":"2023-10-02","cited_by_count":7},{"id":"2310.05787","title":"Exact threshold for approximate ellipsoid fitting of random points","created":"2023-10-09","cited_by_count":7},{"id":"2406.03768","title":"Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective","created":"2024-06-06","cited_by_count":4},{"id":"2412.17387","title":"Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement","created":"2024-12-23","cited_by_count":3},{"id":"2508.10782","title":"Dimension-Free Bounds for Generalized First-Order Methods via Gaussian Coupling","created":"2025-08-14","cited_by_count":2}],"next_cursor":null}