{"list":"other","total":61,"rows":[{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"2011.06225","title":"A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges","created":"2020-11-12","cited_by_count":819},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"2002.08791","title":"Bayesian Deep Learning and a Probabilistic Perspective of Generalization","created":"2020-02-20","cited_by_count":480},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"2104.14421","title":"What Are Bayesian Neural Network Posteriors Really Like?","created":"2021-04-29","cited_by_count":308},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2003.00307","title":"Loss landscapes and optimization in over-parameterized non-linear systems and neural networks","created":"2020-02-29","cited_by_count":233},{"id":"1903.07571","title":"Two models of double descent for weak features","created":"2019-03-18","cited_by_count":195},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2106.10165","title":"The Principles of Deep Learning Theory","created":"2021-06-18","cited_by_count":173},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"1803.01719","title":"How to Start Training: The Effect of Initialization and Architecture","created":"2018-03-05","cited_by_count":109},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"2008.06786","title":"The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization","created":"2020-08-15","cited_by_count":101},{"id":"1801.03744","title":"Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients?","created":"2018-01-11","cited_by_count":94},{"id":"2007.05864","title":"Bayesian Deep Ensembles via the Neural Tangent Kernel","created":"2020-07-11","cited_by_count":90},{"id":"1809.10374","title":"An analytic theory of generalization dynamics and transfer learning in deep linear networks","created":"2018-09-27","cited_by_count":85},{"id":"2007.12826","title":"The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training","created":"2020-07-25","cited_by_count":84},{"id":"1901.01608","title":"Scaling description of generalization with number of parameters in deep learning","created":"2019-01-06","cited_by_count":83},{"id":"1910.00019","title":"Non-Gaussian processes and neural networks at finite widths","created":"2019-09-30","cited_by_count":78},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"1712.01473","title":"Deep linear neural networks with arbitrary loss: All local minima are global","created":"2017-12-05","cited_by_count":65},{"id":"2202.11678","title":"Bayesian Model Selection, the Marginal Likelihood, and Generalization","created":"2022-02-23","cited_by_count":57},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53},{"id":"1901.08572","title":"Width Provably Matters in Optimization for Deep Linear Neural Networks","created":"2019-01-24","cited_by_count":52},{"id":"1812.05994","title":"Products of Many Large Random Matrices and Gradients in Deep Neural Networks","created":"2018-12-14","cited_by_count":49},{"id":"1903.04440","title":"Mean Field Analysis of Deep Neural Networks","created":"2019-03-11","cited_by_count":42},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41},{"id":"1712.00779","title":"Gradient Descent Learns One-hidden-layer CNN: Don't be Afraid of Spurious Local Minima","created":"2017-12-03","cited_by_count":40},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33},{"id":"1806.05490","title":"Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo","created":"2018-06-14","cited_by_count":32},{"id":"2004.01190","title":"Predicting the outputs of finite deep neural networks trained with noisy gradients","created":"2020-04-02","cited_by_count":31},{"id":"1702.08580","title":"Depth Creates No Bad Local Minima","created":"2017-02-27","cited_by_count":29},{"id":"2106.06615","title":"Precise characterization of the prior predictive distribution of deep ReLU networks","created":"2021-06-11","cited_by_count":28},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24},{"id":"2204.01058","title":"Random Fully Connected Neural Networks as Perturbatively Solvable Hierarchies","created":"2022-04-03","cited_by_count":24},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21},{"id":"2105.05228","title":"Global Convergence of Three-layer Neural Networks in the Mean Field Regime","created":"2021-05-11","cited_by_count":16},{"id":"2206.07673","title":"Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling","created":"2022-06-15","cited_by_count":9},{"id":"2011.10487","title":"Normalization effects on shallow neural networks and related asymptotic expansions","created":"2020-11-20","cited_by_count":4}],"next_cursor":null}