{"list":"other","total":73,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1503.05671","title":"Optimizing Neural Networks with Kronecker-factored Approximate Curvature","created":"2015-03-19","cited_by_count":796},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"2206.14486","title":"Beyond neural scaling laws: beating power law scaling via data pruning","created":"2022-06-29","cited_by_count":528},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"1912.02178","title":"Fantastic Generalization Measures and Where to Find Them","created":"2019-12-04","cited_by_count":513},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"2110.04596","title":"Deep Long-Tailed Learning: A Survey","created":"2021-10-09","cited_by_count":417},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1905.13210","title":"Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks","created":"2019-05-30","cited_by_count":222},{"id":"1810.01075","title":"Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning","created":"2018-10-02","cited_by_count":215},{"id":"1901.06053","title":"A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks","created":"2019-01-18","cited_by_count":214},{"id":"2010.15110","title":"Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel","created":"2020-10-28","cited_by_count":187},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"2006.04740","title":"The Heavy-Tail Phenomenon in SGD","created":"2020-06-08","cited_by_count":124},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2002.06716","title":"Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data","created":"2020-02-17","cited_by_count":115},{"id":"1906.08632","title":"Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup","created":"2019-06-18","cited_by_count":112},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"1710.11029","title":"Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks","created":"2017-10-30","cited_by_count":109},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"1909.08156","title":"Dynamics of Deep Neural Networks and Neural Tangent Hierarchy","created":"2019-09-18","cited_by_count":96},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91},{"id":"1605.08636","title":"PAC-Bayesian Theory Meets Bayesian Inference","created":"2016-05-27","cited_by_count":88},{"id":"2211.13609","title":"PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization","created":"2022-11-24","cited_by_count":76},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"2006.05013","title":"A Random Matrix Analysis of Random Fourier Features: Beyond the Gaussian Kernel, a Precise Phase Transition, and the Corresponding Double Descent","created":"2020-06-09","cited_by_count":70},{"id":"1805.10074","title":"Statistical Optimality of Stochastic Gradient Descent on Hard Learning Problems through Multiple Passes","created":"2018-05-25","cited_by_count":69},{"id":"2405.15074","title":"4+3 Phases of Compute-Optimal Neural Scaling Laws","created":"2024-05-23","cited_by_count":68},{"id":"1810.09665","title":"A jamming transition from under- to over-parametrization affects loss landscape and generalization","created":"2018-10-22","cited_by_count":67},{"id":"1809.09349","title":"The jamming transition as a paradigm to understand the loss landscape of deep neural networks","created":"2018-09-25","cited_by_count":62},{"id":"1602.02666","title":"A Variational Analysis of Stochastic Gradient Algorithms","created":"2016-02-08","cited_by_count":57},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56},{"id":"2503.02113","title":"Deep Learning is Not So Mysterious or Different","created":"2025-03-03","cited_by_count":56},{"id":"1812.05994","title":"Products of Many Large Random Matrices and Gradients in Deep Neural Networks","created":"2018-12-14","cited_by_count":49},{"id":"1901.08278","title":"Heavy-Tailed Universality Predicts Trends in Test Accuracies for Very Large Pre-Trained Deep Neural Networks","created":"2019-01-24","cited_by_count":44},{"id":"1906.09069","title":"First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise","created":"2019-06-21","cited_by_count":44},{"id":"2410.10912","title":"AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models","created":"2024-10-14","cited_by_count":36},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27},{"id":"2205.06308","title":"An Equivalence Principle for the Spectrum of Random Inner-Product Kernel Matrices with Polynomial Scalings","created":"2022-05-12","cited_by_count":27},{"id":"2402.10127","title":"Nonlinear spiked covariance matrices and signal propagation in deep neural networks","created":"2024-02-15","cited_by_count":26},{"id":"1710.09553","title":"Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior","created":"2017-10-26","cited_by_count":25},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2203.14661","title":"Random matrix analysis of deep neural network weight matrices","created":"2022-03-28","cited_by_count":21},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20},{"id":"2312.17162","title":"Function-Space Regularization in Neural Networks: A Probabilistic Perspective","created":"2023-12-28","cited_by_count":20},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19},{"id":"2309.13337","title":"On the Asymptotic Learning Curves of Kernel Ridge Regression under Power-law Decay","created":"2023-09-23","cited_by_count":19},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16},{"id":"2307.07785","title":"The Interpolating Information Criterion for Overparameterized Models","created":"2023-07-15","cited_by_count":12},{"id":"2010.01851","title":"On the Universality of the Double Descent Peak in Ridgeless Regression","created":"2020-10-05","cited_by_count":11},{"id":"2406.04425","title":"On Regularization via Early Stopping for Least Squares Regression","created":"2024-06-06","cited_by_count":11},{"id":"2502.02870","title":"Uncertainty Quantification with the Empirical Neural Tangent Kernel","created":"2025-02-05","cited_by_count":11},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9},{"id":"2111.11954","title":"Depth induces scale-averaging in overparameterized linear Bayesian neural networks","created":"2021-11-23","cited_by_count":7},{"id":"2502.05074","title":"Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models","created":"2025-02-07","cited_by_count":7},{"id":"2205.06689","title":"Heavy-Tail Phenomenon in Decentralized SGD","created":"2022-05-13","cited_by_count":6},{"id":"2503.04424","title":"Determinant Estimation under Memory Constraints and Neural Scaling Laws","created":"2025-03-06","cited_by_count":4}],"next_cursor":null}