{"list":"other","total":52,"rows":[{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"2005.10190","title":"Feature Purification: How Adversarial Training Performs Robust Deep Learning","created":"2020-05-20","cited_by_count":107},{"id":"1805.00915","title":"Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach","created":"2018-05-02","cited_by_count":106},{"id":"1906.08899","title":"Limitations of Lazy Training of Two-layers Neural Networks","created":"2019-06-21","cited_by_count":87},{"id":"1910.00019","title":"Non-Gaussian processes and neural networks at finite widths","created":"2019-09-30","cited_by_count":78},{"id":"1909.11304","title":"Asymptotics of Wide Networks from Feynman Diagrams","created":"2019-09-25","cited_by_count":77},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"2002.11544","title":"The role of regularization in classification of high-dimensional noisy Gaussian mixture","created":"2020-02-26","cited_by_count":63},{"id":"2108.10573","title":"The staircase property: How hierarchical structure can guide deep learning","created":"2021-08-24","cited_by_count":62},{"id":"2303.00055","title":"Learning time-scales in two-layers neural networks","created":"2023-02-28","cited_by_count":57},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53},{"id":"2006.06560","title":"Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization","created":"2020-06-11","cited_by_count":51},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26},{"id":"2302.06210","title":"Precise Asymptotic Analysis of Deep Random Feature Models","created":"2023-02-13","cited_by_count":22},{"id":"2309.16476","title":"High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality","created":"2023-09-28","cited_by_count":15},{"id":"1303.7289","title":"Upper-bounding $\\ell_1$-optimization weak thresholds","created":"2013-03-29","cited_by_count":14},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13},{"id":"2304.02912","title":"Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach","created":"2023-04-06","cited_by_count":11},{"id":"2303.05420","title":"Kernel Regression with Infinite-Width Neural Networks on Millions of Examples","created":"2023-03-09","cited_by_count":9},{"id":"1304.0003","title":"Meshes that trap random subspaces","created":"2013-03-29","cited_by_count":8},{"id":"2211.08771","title":"On the symmetries in the dynamics of wide two-layer neural networks","created":"2022-11-16","cited_by_count":8}],"next_cursor":null}