{"list":"other","total":59,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227},{"id":"1810.10531","title":"A mathematical theory of semantic development in deep neural networks","created":"2018-10-23","cited_by_count":186},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1805.08522","title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","created":"2018-05-22","cited_by_count":183},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"1806.05393","title":"Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks","created":"2018-06-14","cited_by_count":176},{"id":"1909.06581","title":"Blind Super-Resolution Kernel Estimation using an Internal-GAN","created":"2019-09-14","cited_by_count":175},{"id":"1912.01198","title":"Towards Understanding the Spectral Bias of Deep Learning","created":"2019-12-03","cited_by_count":174},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166},{"id":"1809.09573","title":"Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview","created":"2018-09-25","cited_by_count":160},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"1704.00708","title":"No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis","created":"2017-04-03","cited_by_count":129},{"id":"1605.07272","title":"Matrix Completion has No Spurious Local Minimum","created":"2016-05-24","cited_by_count":125},{"id":"1904.13262","title":"Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks","created":"2019-04-30","cited_by_count":124},{"id":"1803.01905","title":"Convergence of Gradient Descent on Separable Data","created":"2018-03-05","cited_by_count":110},{"id":"2203.01238","title":"On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features","created":"2022-03-02","cited_by_count":97},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95},{"id":"2008.11865","title":"Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra","created":"2020-08-27","cited_by_count":94},{"id":"2202.14026","title":"Robust Training under Label Noise by Over-parameterization","created":"2022-02-28","cited_by_count":93},{"id":"1709.01953","title":"Implicit Regularization in Deep Learning","created":"2017-09-06","cited_by_count":90},{"id":"1411.8003","title":"Guaranteed Matrix Completion via Non-convex Factorization","created":"2014-11-28","cited_by_count":82},{"id":"1605.07221","title":"Global Optimality of Local Search for Low Rank Matrix Recovery","created":"2016-05-23","cited_by_count":82},{"id":"2210.02192","title":"Are All Losses Created Equal: A Neural Collapse Perspective","created":"2022-10-04","cited_by_count":78},{"id":"1802.09979","title":"The Emergence of Spectral Universality in Deep Networks","created":"2018-02-27","cited_by_count":74},{"id":"2001.05992","title":"Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks","created":"2020-01-16","cited_by_count":73},{"id":"1909.12051","title":"The Implicit Bias of Depth: How Incremental Learning Drives Generalization","created":"2019-09-26","cited_by_count":64},{"id":"2209.09211","title":"Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold","created":"2022-09-19","cited_by_count":50},{"id":"1806.05394","title":"Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks","created":"2018-06-14","cited_by_count":45},{"id":"2012.05156","title":"Implicit Regularization in ReLU Networks with the Square Loss","created":"2020-12-09","cited_by_count":45},{"id":"1605.07051","title":"Convergence Analysis for Rectangular Matrix Completion Using Burer-Monteiro Factorization and Gradient Descent","created":"2016-05-23","cited_by_count":39},{"id":"2210.17020","title":"A Law of Data Separation in Deep Learning","created":"2022-10-31","cited_by_count":36},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35},{"id":"2210.16658","title":"Perturbation Analysis of Neural Collapse","created":"2022-10-29","cited_by_count":35},{"id":"1702.08580","title":"Depth Creates No Bad Local Minima","created":"2017-02-27","cited_by_count":29},{"id":"2006.08857","title":"Robust Recovery via Implicit Bias of Discrepant Learning Rates for Double Over-parameterization","created":"2020-06-16","cited_by_count":26},{"id":"2302.00457","title":"Simplicity Bias in 1-Hidden Layer Neural Networks","created":"2023-02-01","cited_by_count":26},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25},{"id":"2212.12206","title":"Understanding and Improving Transfer Learning of Deep Models via Neural Collapse","created":"2022-12-23","cited_by_count":24},{"id":"2002.09852","title":"Training Linear Neural Networks: Non-Local Convergence and Complexity Results","created":"2020-02-23","cited_by_count":19},{"id":"2210.10041","title":"Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning","created":"2022-10-18","cited_by_count":13},{"id":"2010.00380","title":"Deep matrix factorizations","created":"2020-10-01","cited_by_count":9},{"id":"2105.06351","title":"Convergence and Implicit Bias of Gradient Flow on Overparametrized Linear Networks","created":"2021-05-13","cited_by_count":5}],"next_cursor":null}