{"list":"other","total":61,"rows":[{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"2002.09277","title":"Kernel and Rich Regimes in Overparametrized Models","created":"2020-02-20","cited_by_count":306},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"1808.00387","title":"Just Interpolate: Kernel \"Ridgeless\" Regression Can Generalize","created":"2018-08-01","cited_by_count":190},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2009.14286","title":"Benign overfitting in ridge regression","created":"2020-09-29","cited_by_count":153},{"id":"2012.09839","title":"Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning","created":"2020-12-17","cited_by_count":150},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132},{"id":"1903.09139","title":"Harmless interpolation of noisy data in regression","created":"2019-03-21","cited_by_count":121},{"id":"2005.06398","title":"Implicit Regularization in Deep Learning May Not Be Explainable by Norms","created":"2020-05-13","cited_by_count":119},{"id":"1806.05161","title":"Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate","created":"2018-06-13","cited_by_count":99},{"id":"2006.05800","title":"On the Optimal Weighted $\\ell_2$ Regularization in Overparameterized Linear Regression","created":"2020-06-10","cited_by_count":98},{"id":"2005.08054","title":"Classification vs regression in overparameterized regimes: Does the loss function matter?","created":"2020-05-16","cited_by_count":97},{"id":"1806.09471","title":"Does data interpolation contradict statistical optimality?","created":"2018-06-25","cited_by_count":95},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91},{"id":"1911.05822","title":"A Model of Double Descent for High-dimensional Binary Linear Classification","created":"2019-11-13","cited_by_count":81},{"id":"2004.12019","title":"Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime","created":"2020-04-25","cited_by_count":81},{"id":"2010.02501","title":"A Unifying View on Implicit Bias in Training Linear Neural Networks","created":"2020-10-06","cited_by_count":75},{"id":"2202.05928","title":"Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data","created":"2022-02-11","cited_by_count":74},{"id":"2001.05992","title":"Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks","created":"2020-01-16","cited_by_count":73},{"id":"2102.09769","title":"On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent","created":"2021-02-19","cited_by_count":70},{"id":"1806.01796","title":"Stochastic Gradient Descent on Separable Data: Exact Convergence with a Fixed Learning Rate","created":"2018-06-05","cited_by_count":64},{"id":"2106.09276","title":"Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting","created":"2021-06-17","cited_by_count":54},{"id":"1805.10939","title":"Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization","created":"2018-05-28","cited_by_count":53},{"id":"2201.12760","title":"Implicit Regularization Towards Rank Minimization in ReLU Networks","created":"2022-01-30","cited_by_count":53},{"id":"1901.08572","title":"Width Provably Matters in Optimization for Deep Linear Neural Networks","created":"2019-01-24","cited_by_count":52},{"id":"2104.13628","title":"Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures","created":"2021-04-28","cited_by_count":49},{"id":"2012.05156","title":"Implicit Regularization in ReLU Networks with the Square Loss","created":"2020-12-09","cited_by_count":45},{"id":"1802.06093","title":"Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks","created":"2018-02-16","cited_by_count":44},{"id":"1912.04265","title":"In Defense of Uniform Convergence: Generalization via derandomization with an application to interpolating predictors","created":"2019-12-09","cited_by_count":44},{"id":"2002.01586","title":"A Precise High-Dimensional Asymptotic Theory for Boosting and Minimum-$\\ell_1$-Norm Interpolated Classifiers","created":"2020-02-05","cited_by_count":44},{"id":"2207.04036","title":"Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent","created":"2022-07-08","cited_by_count":39},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36},{"id":"2009.10670","title":"On the proliferation of support vectors in high dimensions","created":"2020-09-22","cited_by_count":32},{"id":"2106.03212","title":"Towards an Understanding of Benign Overfitting in Neural Networks","created":"2021-06-06","cited_by_count":30},{"id":"2003.01094","title":"On the Global Convergence of Training Deep Linear ResNets","created":"2020-03-02","cited_by_count":29},{"id":"2010.08479","title":"Failures of model-dependent generalization bounds for least-norm interpolation","created":"2020-10-16","cited_by_count":26},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24},{"id":"2110.02914","title":"Foolish Crowds Support Benign Overfitting","created":"2021-10-06","cited_by_count":24},{"id":"2203.03597","title":"Fast Rates for Noisy Interpolation Require Rethinking the Effects of Inductive Bias","created":"2022-03-07","cited_by_count":22},{"id":"2010.01618","title":"A Modular Analysis of Provable Acceleration via Polyak's Momentum: Training a Wide ReLU Network and a Deep Linear Network","created":"2020-10-04","cited_by_count":19},{"id":"2012.00807","title":"On the robustness of minimum norm interpolators and regularized empirical risk minimizers","created":"2020-12-01","cited_by_count":19},{"id":"2112.12986","title":"Is Importance Weighting Incompatible with Interpolating Classifiers?","created":"2021-12-24","cited_by_count":19},{"id":"2102.12238","title":"Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm","created":"2021-02-24","cited_by_count":18},{"id":"2108.11489","title":"The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks","created":"2021-08-25","cited_by_count":18},{"id":"2105.06351","title":"Convergence and Implicit Bias of Gradient Flow on Overparametrized Linear Networks","created":"2021-05-13","cited_by_count":5},{"id":"2002.02525","title":"Interpolating Predictors in High-Dimensional Factor Regression","created":"2020-02-06","cited_by_count":3}],"next_cursor":null}