{"list":"other","total":62,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1905.00414","title":"Similarity of Neural Network Representations Revisited","created":"2019-05-01","cited_by_count":1755},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"2006.13198","title":"Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks","created":"2020-06-23","cited_by_count":166},{"id":"1601.03764","title":"Linear Algebraic Structure of Word Senses, with Applications to Polysemy","created":"2016-01-14","cited_by_count":165},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"1912.02803","title":"Neural Tangents: Fast and Easy Infinite Neural Networks in Python","created":"2019-12-05","cited_by_count":149},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"2003.04560","title":"Frequency Bias in Neural Networks for Input of Non-Uniform Density","created":"2020-03-10","cited_by_count":140},{"id":"1810.05369","title":"Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel","created":"2018-10-12","cited_by_count":131},{"id":"1904.00687","title":"On the Power and Limitations of Random Features for Understanding Neural Networks","created":"2019-04-01","cited_by_count":103},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95},{"id":"1905.10337","title":"What Can ResNet Learn Efficiently, Going Beyond Kernels?","created":"2019-05-24","cited_by_count":91},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2407.05872","title":"Scaling Exponents Across Parameterizations and Optimizers","created":"2024-07-08","cited_by_count":76},{"id":"2007.06738","title":"Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy","created":"2020-07-13","cited_by_count":71},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69},{"id":"2202.08384","title":"Limitations of Neural Collapse for Understanding Generalization in Deep Learning","created":"2022-02-17","cited_by_count":63},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49},{"id":"2103.01210","title":"Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels","created":"2021-03-01","cited_by_count":41},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35},{"id":"2408.05451","title":"Mathematical Models of Computation in Superposition","created":"2024-08-10","cited_by_count":35},{"id":"2012.04477","title":"Analyzing Finite Neural Networks: Can We Trust Neural Tangent Kernel Theory?","created":"2020-12-08","cited_by_count":33},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33},{"id":"2104.04244","title":"How rotational invariance of common kernels prevents generalization in high dimensions","created":"2021-04-09","cited_by_count":32},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23},{"id":"1905.10843","title":"Asymptotic learning curves of kernel methods: empirical data v.s. Teacher-Student paradigm","created":"2019-05-26","cited_by_count":20},{"id":"2001.04413","title":"Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning","created":"2020-01-13","cited_by_count":19},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19},{"id":"2007.04596","title":"Learning Over-Parametrized Two-Layer ReLU Neural Networks beyond NTK","created":"2020-07-09","cited_by_count":18},{"id":"2405.17580","title":"Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes","created":"2024-05-27","cited_by_count":18},{"id":"2203.09255","title":"On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels","created":"2022-03-17","cited_by_count":16},{"id":"2010.11356","title":"Beyond Lazy Training for Over-parameterized Tensor Decomposition","created":"2020-10-22","cited_by_count":15},{"id":"2408.07254","title":"Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics","created":"2024-08-14","cited_by_count":15},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13},{"id":"2202.03348","title":"Failure and success of the spectral bias prediction for Kernel Ridge Regression: the case of low-dimensional data","created":"2022-02-07","cited_by_count":12},{"id":"2202.09028","title":"On the Implicit Bias Towards Minimal Depth of Deep Neural Networks","created":"2022-02-18","cited_by_count":12},{"id":"1906.05301","title":"Learning Curves for Deep Neural Networks: A Gaussian Field Theory Perspective","created":"2019-06-12","cited_by_count":11},{"id":"2205.14818","title":"Excess Risk of Two-Layer ReLU Neural Networks in Teacher-Student Settings and its Superiority to Kernel Methods","created":"2022-05-30","cited_by_count":10},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9},{"id":"2310.00137","title":"On the Disconnect Between Theory and Practice of Neural Networks: Limits of the NTK Perspective","created":"2023-09-29","cited_by_count":6},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3}],"next_cursor":null}