{"list":"other","total":58,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1503.00036","title":"Norm-Based Capacity Control in Neural Networks","created":"2015-02-27","cited_by_count":299},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1810.01075","title":"Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning","created":"2018-10-02","cited_by_count":215},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"2306.15063","title":"Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression","created":"2023-06-26","cited_by_count":146},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"2003.10409","title":"Online stochastic gradient descent on non-convex losses from high-dimensional inference","created":"2020-03-23","cited_by_count":119},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2002.06716","title":"Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data","created":"2020-02-17","cited_by_count":115},{"id":"2307.15936","title":"A Theory for Emergence of Complex Skills in Language Models","created":"2023-07-29","cited_by_count":113},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75},{"id":"2405.15074","title":"4+3 Phases of Compute-Optimal Neural Scaling Laws","created":"2024-05-23","cited_by_count":68},{"id":"2305.10633","title":"Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models","created":"2023-05-18","cited_by_count":61},{"id":"2303.00055","title":"Learning time-scales in two-layers neural networks","created":"2023-02-28","cited_by_count":57},{"id":"2304.00488","title":"Saddle-to-Saddle Dynamics in Diagonal Linear Networks","created":"2023-04-02","cited_by_count":57},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54},{"id":"2210.08571","title":"Dimension free ridge regression","created":"2022-10-16","cited_by_count":51},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50},{"id":"2501.16265","title":"Training Dynamics of In-Context Learning in Linear Attention","created":"2025-01-27","cited_by_count":46},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35},{"id":"2011.07729","title":"Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View","created":"2020-11-16","cited_by_count":32},{"id":"2504.19983","title":"Emergence and scaling laws in SGD learning of shallow neural networks","created":"2025-04-28","cited_by_count":32},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28},{"id":"2403.08938","title":"A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator","created":"2024-03-13","cited_by_count":28},{"id":"2205.06308","title":"An Equivalence Principle for the Spectrum of Random Inner-Product Kernel Matrices with Polynomial Scalings","created":"2022-05-12","cited_by_count":27},{"id":"2410.23819","title":"Weight decay induces low-rank attention layers","created":"2024-10-31","cited_by_count":27},{"id":"2508.03688","title":"Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws","created":"2025-08-05","cited_by_count":25},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23},{"id":"2410.17770","title":"Small Singular Values Matter: A Random Matrix Analysis of Transformer Models","created":"2024-10-23","cited_by_count":21},{"id":"2206.05794","title":"SGD and Weight Decay Secretly Minimize the Rank of Your Neural Network","created":"2022-06-12","cited_by_count":19},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16},{"id":"2502.20003","title":"Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula","created":"2025-02-27","cited_by_count":14},{"id":"2502.00901","title":"Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds","created":"2025-02-02","cited_by_count":12},{"id":"2503.14121","title":"Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications","created":"2025-03-18","cited_by_count":11},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9},{"id":"2310.01169","title":"Fitting an ellipsoid to random points: predictions using the replica method","created":"2023-10-02","cited_by_count":7},{"id":"2505.23099","title":"Weight Spectra Induced Efficient Model Adaptation","created":"2025-05-29","cited_by_count":5},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3}],"next_cursor":null}