{"list":"other","total":108,"rows":[{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1412.8690","title":"Breaking the Curse of Dimensionality with Convex Neural Networks","created":"2014-12-30","cited_by_count":331},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1906.05890","title":"Gradient Descent Maximizes the Margin of Homogeneous Neural Networks","created":"2019-06-13","cited_by_count":320},{"id":"1804.11271","title":"Gaussian Process Behaviour in Wide Deep Neural Networks","created":"2018-04-30","cited_by_count":317},{"id":"2002.09277","title":"Kernel and Rich Regimes in Overparametrized Models","created":"2020-02-20","cited_by_count":306},{"id":"2002.04486","title":"Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss","created":"2020-02-11","cited_by_count":268},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1905.13210","title":"Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks","created":"2019-05-30","cited_by_count":222},{"id":"1808.00387","title":"Just Interpolate: Kernel \"Ridgeless\" Regression Can Generalize","created":"2018-08-01","cited_by_count":190},{"id":"2011.14522","title":"Feature Learning in Infinite-Width Neural Networks","created":"2020-11-30","cited_by_count":190},{"id":"1802.01396","title":"To understand deep learning we need to understand kernel learning","created":"2018-02-05","cited_by_count":187},{"id":"1902.06015","title":"Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit","created":"2019-02-16","cited_by_count":187},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2006.06657","title":"Directional convergence and alignment in deep learning","created":"2020-06-11","cited_by_count":178},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"1912.01198","title":"Towards Understanding the Spectral Bias of Deep Learning","created":"2019-12-03","cited_by_count":174},{"id":"1810.05148","title":"Bayesian Deep Convolutional Networks with Many Channels are Gaussian Processes","created":"2018-10-11","cited_by_count":167},{"id":"2006.13198","title":"Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks","created":"2020-06-23","cited_by_count":166},{"id":"1602.04474","title":"Generalization Properties of Learning with Random Features","created":"2016-02-14","cited_by_count":164},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"1904.12191","title":"Linearized two-layers neural networks in high dimension","created":"2019-04-27","cited_by_count":155},{"id":"2009.14286","title":"Benign overfitting in ridge regression","created":"2020-09-29","cited_by_count":153},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"2012.09839","title":"Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning","created":"2020-12-17","cited_by_count":150},{"id":"1507.03003","title":"High-Dimensional Asymptotics of Prediction: Ridge Regression and Classification","created":"2015-07-10","cited_by_count":148},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"1502.06800","title":"On the Equivalence between Kernel Quadrature Rules and Random Feature Expansions","created":"2015-02-24","cited_by_count":138},{"id":"1602.05897","title":"Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity","created":"2016-02-18","cited_by_count":138},{"id":"2010.01092","title":"On the linearity of large non-linear models: when and why the tangent kernel is constant","created":"2020-10-02","cited_by_count":129},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"1906.04688","title":"An Improved Analysis of Training Over-parameterized Deep Neural Networks","created":"2019-06-11","cited_by_count":121},{"id":"1909.12292","title":"Polylogarithmic width suffices for gradient descent to achieve arbitrarily small test error with shallow ReLU networks","created":"2019-09-26","cited_by_count":121},{"id":"2003.10409","title":"Online stochastic gradient descent on non-convex losses from high-dimensional inference","created":"2020-03-23","cited_by_count":119},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"1904.00687","title":"On the Power and Limitations of Random Features for Understanding Neural Networks","created":"2019-04-01","cited_by_count":103},{"id":"2008.06786","title":"The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization","created":"2020-08-15","cited_by_count":101},{"id":"2006.05800","title":"On the Optimal Weighted $\\ell_2$ Regularization in Overparameterized Linear Regression","created":"2020-06-10","cited_by_count":98},{"id":"1909.08156","title":"Dynamics of Deep Neural Networks and Neural Tangent Hierarchy","created":"2019-09-18","cited_by_count":96},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"1806.09471","title":"Does data interpolation contradict statistical optimality?","created":"2018-06-25","cited_by_count":95},{"id":"2210.15651","title":"Learning Single-Index Models with Shallow Neural Networks","created":"2022-10-27","cited_by_count":92},{"id":"1905.10337","title":"What Can ResNet Learn Efficiently, Going Beyond Kernels?","created":"2019-05-24","cited_by_count":91},{"id":"2102.13219","title":"Learning with invariances in random features and kernel models","created":"2021-02-25","cited_by_count":89},{"id":"1812.10004","title":"Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?","created":"2018-12-25","cited_by_count":88},{"id":"1906.08899","title":"Limitations of Lazy Training of Two-layers Neural Networks","created":"2019-06-21","cited_by_count":87},{"id":"1910.01663","title":"Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks","created":"2019-10-03","cited_by_count":87},{"id":"1607.06534","title":"The Landscape of Empirical Risk for Non-convex Losses","created":"2016-07-22","cited_by_count":86},{"id":"1803.07300","title":"Risk and parameter convergence of logistic regression","created":"2018-03-20","cited_by_count":85},{"id":"2007.12826","title":"The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training","created":"2020-07-25","cited_by_count":84},{"id":"1810.12065","title":"On the Convergence Rate of Training Recurrent Neural Networks","created":"2018-10-29","cited_by_count":82},{"id":"1910.01619","title":"Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks","created":"2019-10-03","cited_by_count":79},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2005.11879","title":"Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks","created":"2020-05-25","cited_by_count":77},{"id":"1911.00809","title":"Enhanced Convolutional Neural Tangent Kernels","created":"2019-11-03","cited_by_count":76},{"id":"2010.02501","title":"A Unifying View on Implicit Bias in Training Linear Neural Networks","created":"2020-10-06","cited_by_count":75},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75},{"id":"2006.05013","title":"A Random Matrix Analysis of Random Fourier Features: Beyond the Gaussian Kernel, a Precise Phase Transition, and the Corresponding Double Descent","created":"2020-06-09","cited_by_count":70},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69},{"id":"2001.11443","title":"A Rigorous Framework for the Mean Field Limit of Multilayer Neural Networks","created":"2020-01-30","cited_by_count":68},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63},{"id":"2006.06386","title":"Asymptotics of Ridge (less) Regression under General Source Condition","created":"2020-06-11","cited_by_count":62},{"id":"1906.03593","title":"Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound","created":"2019-06-09","cited_by_count":59},{"id":"2303.00055","title":"Learning time-scales in two-layers neural networks","created":"2023-02-28","cited_by_count":57},{"id":"2003.02237","title":"Neural Kernels Without Tangents","created":"2020-03-04","cited_by_count":56},{"id":"2003.05508","title":"A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth","created":"2020-03-11","cited_by_count":56},{"id":"2006.09796","title":"Kernel Alignment Risk Estimator: Risk Prediction from Training Data","created":"2020-06-17","cited_by_count":54},{"id":"2106.09276","title":"Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting","created":"2021-06-17","cited_by_count":54},{"id":"2210.08571","title":"Dimension free ridge regression","created":"2022-10-16","cited_by_count":51},{"id":"2006.13436","title":"Towards Understanding Hierarchical Learning: Benefits of Neural Representations","created":"2020-06-24","cited_by_count":46},{"id":"2204.10425","title":"Spectrum of inner-product kernel matrices in the polynomial regime and multiple descent phenomenon in kernel ridge regression","created":"2022-04-21","cited_by_count":45},{"id":"1812.11167","title":"Consistency of Interpolation with Laplace Kernels is a High-Dimensional Phenomenon","created":"2018-12-28","cited_by_count":44},{"id":"2010.02681","title":"Kernel regression in high dimensions: Refined analysis beyond double descent","created":"2020-10-06","cited_by_count":39},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38},{"id":"1908.02419","title":"Gradient Descent Finds Global Minima for Generalizable Deep Neural Networks of Practical Sizes","created":"2019-08-05","cited_by_count":29}],"next_cursor":"100"}