{"list":"other","total":100,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"2006.11239","title":"Denoising Diffusion Probabilistic Models","created":"2020-06-19","cited_by_count":21076},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1505.04597","title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","created":"2015-05-18","cited_by_count":19713},{"id":"1503.03585","title":"Deep Unsupervised Learning using Nonequilibrium Thermodynamics","created":"2015-03-12","cited_by_count":7058},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"1708.07747","title":"Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms","created":"2017-08-25","cited_by_count":4349},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"1902.06015","title":"Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit","created":"2019-02-16","cited_by_count":187},{"id":"1810.10531","title":"A mathematical theory of semantic development in deep neural networks","created":"2018-10-23","cited_by_count":186},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"1507.03003","title":"High-Dimensional Asymptotics of Prediction: Ridge Regression and Classification","created":"2015-07-10","cited_by_count":148},{"id":"1511.02476","title":"Statistical physics of inference: Thresholds and algorithms","created":"2015-11-08","cited_by_count":128},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126},{"id":"1708.03395","title":"Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models","created":"2017-08-10","cited_by_count":116},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"1906.08632","title":"Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup","created":"2019-06-18","cited_by_count":112},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"1702.05419","title":"A Random Matrix Approach to Neural Networks","created":"2017-02-17","cited_by_count":80},{"id":"1601.04920","title":"Understanding Deep Convolutional Networks","created":"2016-01-19","cited_by_count":76},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"2006.05013","title":"A Random Matrix Analysis of Random Fourier Features: Beyond the Gaussian Kernel, a Precise Phase Transition, and the Corresponding Double Descent","created":"2020-06-09","cited_by_count":70},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66},{"id":"2002.11544","title":"The role of regularization in classification of high-dimensional noisy Gaussian mixture","created":"2020-02-26","cited_by_count":63},{"id":"1710.06487","title":"Classification and Geometry of General Perceptual Manifolds","created":"2017-10-17","cited_by_count":62},{"id":"2006.06098","title":"Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification","created":"2020-06-10","cited_by_count":60},{"id":"1806.05451","title":"The committee machine: Computational to statistical gaps in learning a two-layers neural network","created":"2018-06-14","cited_by_count":58},{"id":"2405.11751","title":"Asymptotic theory of in-context learning by linear attention","created":"2024-05-20","cited_by_count":55},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53},{"id":"1805.09785","title":"Entropy and mutual information in models of deep neural networks","created":"2018-05-24","cited_by_count":51},{"id":"2006.06560","title":"Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization","created":"2020-06-11","cited_by_count":51},{"id":"2211.11567","title":"Neural networks trained with SGD learn distributions of increasing complexity","created":"2022-11-21","cited_by_count":50},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49},{"id":"1804.09753","title":"The phase transition for the existence of the maximum likelihood estimate in high-dimensional logistic regression","created":"2018-04-25","cited_by_count":46},{"id":"2002.01586","title":"A Precise High-Dimensional Asymptotic Theory for Boosting and Minimum-$\\ell_1$-Norm Interpolated Classifiers","created":"2020-02-05","cited_by_count":44},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41},{"id":"1605.06444","title":"Unreasonable Effectiveness of Learning Neural Networks: From Accessible States and Robust Ensembles to Basic Algorithmic Schemes","created":"2016-05-20","cited_by_count":40},{"id":"1509.05753","title":"Subdominant Dense Clusters Allow for Simple Learning and High Computational Performance in Neural Networks with Discrete Synapses","created":"2015-09-18","cited_by_count":39},{"id":"2006.05228","title":"Phase retrieval in high dimensions: Statistical and computational phase transitions","created":"2020-06-09","cited_by_count":39},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39},{"id":"2310.03575","title":"Analysis of learning a flow-based generative model from limited sample complexity","created":"2023-10-05","cited_by_count":38},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35},{"id":"2011.07729","title":"Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View","created":"2020-11-16","cited_by_count":32},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28},{"id":"2201.02115","title":"The dynamics of representation learning in shallow, non-linear autoencoders","created":"2022-01-06","cited_by_count":27},{"id":"2205.13303","title":"Gaussian Universality of Perceptrons with Random Labels","created":"2022-05-26","cited_by_count":26},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26},{"id":"2403.08160","title":"Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime","created":"2024-03-13","cited_by_count":26},{"id":"2112.10852","title":"The effective noise of Stochastic Gradient Descent","created":"2021-12-20","cited_by_count":25},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24},{"id":"2103.04902","title":"Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem","created":"2021-03-08","cited_by_count":23},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23},{"id":"2302.06210","title":"Precise Asymptotic Analysis of Deep Random Feature Models","created":"2023-02-13","cited_by_count":22},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18},{"id":"2201.12655","title":"Error Scaling Laws for Kernel Classification under Source and Capacity Conditions","created":"2022-01-29","cited_by_count":17},{"id":"2203.12094","title":"Learning curves for the multi-class teacher-student perceptron","created":"2022-03-22","cited_by_count":17},{"id":"1408.1784","title":"Origin of the computational hardness for learning with binary synapses","created":"2014-08-08","cited_by_count":16},{"id":"1911.00890","title":"Mean-field inference methods for neural networks","created":"2019-11-03","cited_by_count":16},{"id":"2012.00194","title":"Solvable Model for Inheriting the Regularization through Knowledge Distillation","created":"2020-12-01","cited_by_count":16},{"id":"1301.7115","title":"Statistical mechanics of complex neural systems and high dimensional data","created":"2013-01-30","cited_by_count":15},{"id":"1311.0830","title":"The Squared-Error of Generalized LASSO: A Precise Analysis","created":"2013-11-04","cited_by_count":15},{"id":"2309.16476","title":"High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality","created":"2023-09-28","cited_by_count":15},{"id":"2102.08373","title":"Analysis of feature learning in weight-tied autoencoders via the mean field lens","created":"2021-02-16","cited_by_count":14},{"id":"1911.11983","title":"Benefits of Jointly Training Autoencoders: An Improved Neural Tangent Kernel Analysis","created":"2019-11-27","cited_by_count":13},{"id":"2103.05524","title":"On the interplay between data structure and loss function in classification problems","created":"2021-03-09","cited_by_count":13},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13},{"id":"1701.06981","title":"Multi-Layer Generalized Linear Estimation","created":"2017-01-24","cited_by_count":12},{"id":"2304.02912","title":"Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach","created":"2023-04-06","cited_by_count":11},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11},{"id":"1906.08034","title":"Disentangling feature and lazy training in deep neural networks","created":"2019-06-19","cited_by_count":10},{"id":"2405.15926","title":"Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers","created":"2024-05-24","cited_by_count":9},{"id":"1912.03927","title":"Large deviations for the perceptron model and consequences for active learning","created":"2019-12-09","cited_by_count":7},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6},{"id":"1602.04129","title":"Learning may need only a few bits of synaptic precision","created":"2016-02-12","cited_by_count":5},{"id":"2405.16630","title":"Bayesian Inference with Deep Weakly Nonlinear Networks","created":"2024-05-26","cited_by_count":5},{"id":"1903.07378","title":"On-line learning dynamics of ReLU neural networks using statistical physics techniques","created":"2019-03-18","cited_by_count":4},{"id":"2309.09240","title":"High-dimensional manifold of solutions in neural networks: insights from statistical physics","created":"2023-09-17","cited_by_count":4},{"id":"2405.19585","title":"The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms","created":"2024-05-30","cited_by_count":3},{"id":"2409.06053","title":"Statistical Mechanics of Min-Max Problems","created":"2024-09-09","cited_by_count":1}],"next_cursor":null}