{"list":"other","total":51,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1810.01075","title":"Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning","created":"2018-10-02","cited_by_count":215},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"1602.04474","title":"Generalization Properties of Learning with Random Features","created":"2016-02-14","cited_by_count":164},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143},{"id":"1708.03395","title":"Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models","created":"2017-08-10","cited_by_count":116},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2002.06716","title":"Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data","created":"2020-02-17","cited_by_count":115},{"id":"2307.15936","title":"A Theory for Emergence of Complex Skills in Language Models","created":"2023-07-29","cited_by_count":113},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"2405.15074","title":"4+3 Phases of Compute-Optimal Neural Scaling Laws","created":"2024-05-23","cited_by_count":68},{"id":"1806.05451","title":"The committee machine: Computational to statistical gaps in learning a two-layers neural network","created":"2018-06-14","cited_by_count":58},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56},{"id":"2105.02180","title":"A unifying tutorial on Approximate Message Passing","created":"2021-05-05","cited_by_count":50},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50},{"id":"2403.05529","title":"Computational-Statistical Gaps in Gaussian Single-Index Models","created":"2024-03-08","cited_by_count":44},{"id":"1708.05932","title":"Fundamental Limits of Weak Recovery with Applications to Phase Retrieval","created":"2017-08-20","cited_by_count":39},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35},{"id":"2504.19983","title":"Emergence and scaling laws in SGD learning of shallow neural networks","created":"2025-04-28","cited_by_count":32},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30},{"id":"1702.06435","title":"Phase Transitions of Spectral Initialization for High-Dimensional Nonconvex Estimation","created":"2017-02-21","cited_by_count":26},{"id":"2508.03688","title":"Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws","created":"2025-08-05","cited_by_count":25},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19},{"id":"2201.12655","title":"Error Scaling Laws for Kernel Classification under Source and Capacity Conditions","created":"2022-01-29","cited_by_count":17},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14},{"id":"2503.14121","title":"Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications","created":"2025-03-18","cited_by_count":11},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9},{"id":"2502.01583","title":"Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery","created":"2025-02-03","cited_by_count":8},{"id":"2403.02418","title":"The Role of the Time-Dependent Hessian in High-Dimensional Optimization","created":"2024-03-04","cited_by_count":7},{"id":"2502.02545","title":"Optimal Spectral Transitions in High-Dimensional Multi-Index Models","created":"2025-02-04","cited_by_count":7},{"id":"2601.10483","title":"High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks","created":"2026-01-15","cited_by_count":7},{"id":"2511.15120","title":"Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit","created":"2025-11-19","cited_by_count":6},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3}],"next_cursor":null}