{"list":"other","total":53,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1502.01852","title":"Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification","created":"2015-02-06","cited_by_count":3611},{"id":"1606.08415","title":"Gaussian Error Linear Units (GELUs)","created":"2016-06-27","cited_by_count":3502},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"1804.11271","title":"Gaussian Process Behaviour in Wide Deep Neural Networks","created":"2018-04-30","cited_by_count":317},{"id":"1606.05340","title":"Exponential expressivity in deep neural networks through transient chaos","created":"2016-06-16","cited_by_count":261},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1901.09321","title":"Fixup Initialization: Residual Learning Without Normalization","created":"2019-01-27","cited_by_count":198},{"id":"1611.01232","title":"Deep Information Propagation","created":"2016-11-04","cited_by_count":195},{"id":"2106.10165","title":"The Principles of Deep Learning Theory","created":"2021-06-18","cited_by_count":173},{"id":"1901.09021","title":"Complexity of Linear Regions in Deep Networks","created":"2019-01-25","cited_by_count":167},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"1902.04760","title":"Scaling Limits of Wide Neural Networks with Weight Sharing: Gaussian Process Behavior, Gradient Independence, and Neural Tangent Kernel Derivation","created":"2019-02-13","cited_by_count":149},{"id":"2006.14548","title":"Tensor Programs II: Neural Tangent Kernel for Any Architecture","created":"2020-06-25","cited_by_count":143},{"id":"1808.05587","title":"Deep Convolutional Networks as shallow Gaussian Processes","created":"2018-08-16","cited_by_count":138},{"id":"1711.04735","title":"Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice","created":"2017-11-13","cited_by_count":132},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"1803.01719","title":"How to Start Training: The Effect of Initialization and Architecture","created":"2018-03-05","cited_by_count":109},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105},{"id":"1902.06853","title":"On the Impact of the Activation Function on Deep Neural Networks Training","created":"2019-02-19","cited_by_count":102},{"id":"1801.03744","title":"Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients?","created":"2018-01-11","cited_by_count":94},{"id":"2009.14397","title":"Deep Equals Shallow for ReLU Networks in Kernel Regimes","created":"2020-09-30","cited_by_count":85},{"id":"1910.00019","title":"Non-Gaussian processes and neural networks at finite widths","created":"2019-09-30","cited_by_count":78},{"id":"1802.09979","title":"The Emergence of Spectral Universality in Deep Networks","created":"2018-02-27","cited_by_count":74},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44},{"id":"1903.04440","title":"Mean Field Analysis of Deep Neural Networks","created":"2019-03-11","cited_by_count":42},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33},{"id":"2106.06615","title":"Precise characterization of the prior predictive distribution of deep ReLU networks","created":"2021-06-11","cited_by_count":28},{"id":"2203.07379","title":"Quantitative Gaussian Approximation of Randomly Initialized Deep Neural Networks","created":"2022-03-14","cited_by_count":25},{"id":"2204.01058","title":"Random Fully Connected Neural Networks as Perturbatively Solvable Hierarchies","created":"2022-04-03","cited_by_count":24},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21},{"id":"1801.01990","title":"Procrustes Metrics on Covariance Operators and Optimal Transportation of Gaussian Processes","created":"2018-01-06","cited_by_count":19},{"id":"2102.08668","title":"Non-asymptotic approximations of neural networks by Gaussian processes","created":"2021-02-17","cited_by_count":19},{"id":"2102.10307","title":"Large-width functional asymptotics for deep Gaussian neural networks","created":"2021-02-20","cited_by_count":15},{"id":"1901.07114","title":"Training Neural Networks as Learning Data-adaptive Kernels: Provable Representation and Approximation Benefits","created":"2019-01-21","cited_by_count":13},{"id":"2111.03175","title":"Rate of Convergence of Polynomial Networks to Gaussian Processes","created":"2021-11-04","cited_by_count":13},{"id":"2304.04010","title":"Non-asymptotic approximations of Gaussian neural networks via second-order Poincar\\'e inequalities","created":"2023-04-08","cited_by_count":11},{"id":"2306.16308","title":"Gaussian random field approximation via Stein's method with applications to wide random neural networks","created":"2023-06-28","cited_by_count":11},{"id":"2306.16932","title":"A Quantitative Functional Central Limit Theorem for Shallow Neural Networks","created":"2023-06-29","cited_by_count":8},{"id":"2306.11668","title":"Principles for Initialization and Architecture Selection in Graph Neural Networks with ReLU Activations","created":"2023-06-20","cited_by_count":3}],"next_cursor":null}