{"list":"other","total":55,"rows":[{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1709.02540","title":"The Expressive Power of Neural Networks: A View from the Width","created":"2017-09-08","cited_by_count":320},{"id":"2203.03466","title":"Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer","created":"2022-03-07","cited_by_count":288},{"id":"2003.00307","title":"Loss landscapes and optimization in over-parameterized non-linear systems and neural networks","created":"2020-02-29","cited_by_count":233},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"1808.00387","title":"Just Interpolate: Kernel \"Ridgeless\" Regression Can Generalize","created":"2018-08-01","cited_by_count":190},{"id":"2006.13198","title":"Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks","created":"2020-06-23","cited_by_count":166},{"id":"1602.04474","title":"Generalization Properties of Learning with Random Features","created":"2016-02-14","cited_by_count":164},{"id":"2007.15801","title":"Finite Versus Infinite Neural Networks: an Empirical Study","created":"2020-07-31","cited_by_count":157},{"id":"2009.14286","title":"Benign overfitting in ridge regression","created":"2020-09-29","cited_by_count":153},{"id":"2105.12806","title":"A Universal Law of Robustness via Isoperimetry","created":"2021-05-26","cited_by_count":151},{"id":"1912.02803","title":"Neural Tangents: Fast and Easy Infinite Neural Networks in Python","created":"2019-12-05","cited_by_count":149},{"id":"1507.03003","title":"High-Dimensional Asymptotics of Prediction: Ridge Regression and Classification","created":"2015-07-10","cited_by_count":148},{"id":"2006.07322","title":"Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks","created":"2020-06-12","cited_by_count":138},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126},{"id":"1903.09139","title":"Harmless interpolation of noisy data in regression","created":"2019-03-21","cited_by_count":121},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"2003.01897","title":"Optimal Regularization Can Mitigate Double Descent","created":"2020-03-04","cited_by_count":109},{"id":"1806.05161","title":"Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate","created":"2018-06-13","cited_by_count":99},{"id":"2006.05800","title":"On the Optimal Weighted $\\ell_2$ Regularization in Overparameterized Linear Regression","created":"2020-06-10","cited_by_count":98},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91},{"id":"2006.06386","title":"Asymptotics of Ridge (less) Regression under General Source Condition","created":"2020-06-11","cited_by_count":62},{"id":"2003.02237","title":"Neural Kernels Without Tangents","created":"2020-03-04","cited_by_count":56},{"id":"2002.08404","title":"Implicit Regularization of Random Feature Models","created":"2020-02-19","cited_by_count":54},{"id":"2006.09796","title":"Kernel Alignment Risk Estimator: Risk Prediction from Training Data","created":"2020-06-17","cited_by_count":54},{"id":"2106.09276","title":"Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting","created":"2021-06-17","cited_by_count":54},{"id":"1805.10939","title":"Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization","created":"2018-05-28","cited_by_count":53},{"id":"2210.08571","title":"Dimension free ridge regression","created":"2022-10-16","cited_by_count":51},{"id":"2303.01372","title":"High-dimensional analysis of double descent for linear regression with random projections","created":"2023-03-02","cited_by_count":47},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43},{"id":"2009.08092","title":"Distributional Generalization: A New Kind of Generalization","created":"2020-09-17","cited_by_count":42},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25},{"id":"2202.09889","title":"Memorize to Generalize: on the Necessity of Interpolation in High Dimensional Linear Regression","created":"2022-02-20","cited_by_count":14},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13},{"id":"2305.18496","title":"Generalized equivalences between subsampling and ridge regularization","created":"2023-05-29","cited_by_count":10},{"id":"2207.11621","title":"A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors","created":"2022-07-23","cited_by_count":7},{"id":"2306.13185","title":"An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression","created":"2023-06-22","cited_by_count":5},{"id":"2305.16179","title":"Dropout Drops Double Descent","created":"2023-05-25","cited_by_count":2}],"next_cursor":null}