{"list":"other","total":60,"rows":[{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"1412.8690","title":"Breaking the Curse of Dimensionality with Convex Neural Networks","created":"2014-12-30","cited_by_count":331},{"id":"2002.09277","title":"Kernel and Rich Regimes in Overparametrized Models","created":"2020-02-20","cited_by_count":306},{"id":"2002.04486","title":"Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss","created":"2020-02-11","cited_by_count":268},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2003.00307","title":"Loss landscapes and optimization in over-parameterized non-linear systems and neural networks","created":"2020-02-29","cited_by_count":233},{"id":"1902.06015","title":"Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit","created":"2019-02-16","cited_by_count":187},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"2007.15801","title":"Finite Versus Infinite Neural Networks: an Empirical Study","created":"2020-07-31","cited_by_count":157},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"1810.05369","title":"Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel","created":"2018-10-12","cited_by_count":131},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"1906.08632","title":"Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup","created":"2019-06-18","cited_by_count":112},{"id":"1712.08968","title":"Spurious Local Minima are Common in Two-Layer ReLU Neural Networks","created":"2017-12-24","cited_by_count":104},{"id":"1611.01540","title":"Topology and Geometry of Half-Rectified Network Optimization","created":"2016-11-04","cited_by_count":102},{"id":"1909.08156","title":"Dynamics of Deep Neural Networks and Neural Tangent Hierarchy","created":"2019-09-18","cited_by_count":96},{"id":"1812.10004","title":"Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?","created":"2018-12-25","cited_by_count":88},{"id":"1906.08899","title":"Limitations of Lazy Training of Two-layers Neural Networks","created":"2019-06-21","cited_by_count":87},{"id":"2004.12019","title":"Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime","created":"2020-04-25","cited_by_count":81},{"id":"1910.01619","title":"Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks","created":"2019-10-03","cited_by_count":79},{"id":"1909.11304","title":"Asymptotics of Wide Networks from Feynman Diagrams","created":"2019-09-25","cited_by_count":77},{"id":"2001.11443","title":"A Rigorous Framework for the Mean Field Limit of Multilayer Neural Networks","created":"2020-01-30","cited_by_count":68},{"id":"2007.07497","title":"Phase diagram for two-layer ReLU neural networks at infinite-width limit","created":"2020-07-15","cited_by_count":67},{"id":"2003.05508","title":"A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth","created":"2020-03-11","cited_by_count":56},{"id":"1703.00560","title":"An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis","created":"2017-03-02","cited_by_count":52},{"id":"1901.08572","title":"Width Provably Matters in Optimization for Deep Linear Neural Networks","created":"2019-01-24","cited_by_count":52},{"id":"1905.07769","title":"Mean-Field Langevin Dynamics and Energy Landscape of Neural Networks","created":"2019-05-19","cited_by_count":50},{"id":"1907.10300","title":"Sparse Optimization on Measures with Over-parameterized Gradient Descent","created":"2019-07-24","cited_by_count":50},{"id":"1912.12777","title":"Machine Learning from a Continuous Viewpoint","created":"2019-12-30","cited_by_count":50},{"id":"2006.15459","title":"Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions","created":"2020-06-27","cited_by_count":50},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47},{"id":"2006.13436","title":"Towards Understanding Hierarchical Learning: Benefits of Neural Representations","created":"2020-06-24","cited_by_count":46},{"id":"1802.06093","title":"Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks","created":"2018-02-16","cited_by_count":44},{"id":"2007.01452","title":"Modeling from Features: a Mean-field Framework for Over-parameterized Deep Neural Networks","created":"2020-07-03","cited_by_count":44},{"id":"1903.04440","title":"Mean Field Analysis of Deep Neural Networks","created":"2019-03-11","cited_by_count":42},{"id":"2005.13530","title":"On the Convergence of Gradient Descent Training for Two-layer ReLU-networks in the Mean Field Regime","created":"2020-05-27","cited_by_count":39},{"id":"2007.15623","title":"On the Banach spaces associated with multi-layer ReLU networks: Function representation, approximation theory and gradient descent dynamics","created":"2020-07-30","cited_by_count":39},{"id":"1605.08361","title":"No bad local minima: Data independent training error guarantees for multilayer neural networks","created":"2016-05-26","cited_by_count":30},{"id":"1901.01375","title":"Analysis of a Two-Layer Neural Network via Displacement Convexity","created":"2019-01-05","cited_by_count":27},{"id":"2010.14495","title":"Are wider nets better given the same number of parameters?","created":"2020-10-27","cited_by_count":27},{"id":"1902.02880","title":"Mean Field Limit of the Learning Dynamics of Multilayer Neural Networks","created":"2019-02-07","cited_by_count":25},{"id":"2005.10815","title":"Can Shallow Neural Networks Beat the Curse of Dimensionality? A mean field training perspective","created":"2020-05-21","cited_by_count":22},{"id":"2012.15477","title":"Particle Dual Averaging: Optimization of Mean Field Neural Networks with Global Convergence Rate Analysis","created":"2020-12-31","cited_by_count":21},{"id":"2106.13792","title":"Proxy Convexity: A Unified Framework for the Analysis of Neural Networks Trained by Gradient Descent","created":"2021-06-25","cited_by_count":21},{"id":"1912.05475","title":"Mean-Field Neural ODEs via Relaxed Optimal Control","created":"2019-12-11","cited_by_count":16},{"id":"2105.05228","title":"Global Convergence of Three-layer Neural Networks in the Mean Field Regime","created":"2021-05-11","cited_by_count":16},{"id":"1805.04938","title":"The Global Optimization Geometry of Shallow Linear Neural Networks","created":"2018-05-13","cited_by_count":11},{"id":"1906.08034","title":"Disentangling feature and lazy training in deep neural networks","created":"2019-06-19","cited_by_count":10},{"id":"2102.04998","title":"When does gradient descent with logistic loss interpolate using deep networks with smoothed ReLU activations?","created":"2021-02-09","cited_by_count":9}],"next_cursor":null}