{"list":"other","total":52,"rows":[{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1503.05671","title":"Optimizing Neural Networks with Kronecker-factored Approximate Curvature","created":"2015-03-19","cited_by_count":796},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1802.09568","title":"Shampoo: Preconditioned Stochastic Tensor Optimization","created":"2018-02-26","cited_by_count":426},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"1602.04485","title":"Benefits of depth in neural networks","created":"2016-02-14","cited_by_count":250},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"1611.00740","title":"Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Review","created":"2016-11-02","cited_by_count":155},{"id":"1904.12191","title":"Linearized two-layers neural networks in high dimension","created":"2019-04-27","cited_by_count":155},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"2003.10409","title":"Online stochastic gradient descent on non-convex losses from high-dimensional inference","created":"2020-03-23","cited_by_count":119},{"id":"1708.03395","title":"Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models","created":"2017-08-10","cited_by_count":116},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"2210.15651","title":"Learning Single-Index Models with Shallow Neural Networks","created":"2022-10-27","cited_by_count":92},{"id":"1905.10337","title":"What Can ResNet Learn Efficiently, Going Beyond Kernels?","created":"2019-05-24","cited_by_count":91},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75},{"id":"2307.02129","title":"How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model","created":"2023-07-05","cited_by_count":71},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"1806.05451","title":"The committee machine: Computational to statistical gaps in learning a two-layers neural network","created":"2018-06-14","cited_by_count":58},{"id":"2002.04806","title":"The Unreasonable Effectiveness of Deep Learning in Artificial Intelligence","created":"2020-02-12","cited_by_count":57},{"id":"1410.3831","title":"An exact mapping between the Variational Renormalization Group and Deep Learning","created":"2014-10-14","cited_by_count":56},{"id":"1802.02840","title":"Neural Network Renormalization Group","created":"2018-02-08","cited_by_count":48},{"id":"1702.08489","title":"Depth Separation for Neural Networks","created":"2017-02-27","cited_by_count":46},{"id":"2406.01581","title":"Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit","created":"2024-06-03","cited_by_count":46},{"id":"2403.05529","title":"Computational-Statistical Gaps in Gaussian Single-Index Models","created":"2024-03-08","cited_by_count":44},{"id":"1708.05932","title":"Fundamental Limits of Weak Recovery with Applications to Phase Retrieval","created":"2017-08-20","cited_by_count":39},{"id":"2406.00048","title":"Towards a theory of how the structure of language is acquired by deep neural networks","created":"2024-05-28","cited_by_count":39},{"id":"2405.15459","title":"Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions","created":"2024-05-24","cited_by_count":37},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28},{"id":"2205.06308","title":"An Equivalence Principle for the Spectrum of Random Inner-Product Kernel Matrices with Polynomial Scalings","created":"2022-05-12","cited_by_count":27},{"id":"1702.06435","title":"Phase Transitions of Spectral Initialization for High-Dimensional Nonconvex Estimation","created":"2017-02-21","cited_by_count":26},{"id":"2403.08160","title":"Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime","created":"2024-03-13","cited_by_count":26},{"id":"1612.09057","title":"Deep Learning and Hierarchal Generative Models","created":"2016-12-29","cited_by_count":25},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2001.04413","title":"Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning","created":"2020-01-13","cited_by_count":19},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19},{"id":"2503.14121","title":"Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications","created":"2025-03-18","cited_by_count":11},{"id":"2512.03325","title":"When does Gaussian equivalence fail and how to fix it: Non-universal behavior of random features with quadratic scaling","created":"2025-12-03","cited_by_count":10},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9},{"id":"2502.01583","title":"Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery","created":"2025-02-03","cited_by_count":8},{"id":"2310.05787","title":"Exact threshold for approximate ellipsoid fitting of random points","created":"2023-10-09","cited_by_count":7},{"id":"2403.02418","title":"The Role of the Time-Dependent Hessian in High-Dimensional Optimization","created":"2024-03-04","cited_by_count":7},{"id":"2502.02545","title":"Optimal Spectral Transitions in High-Dimensional Multi-Index Models","created":"2025-02-04","cited_by_count":7},{"id":"2511.15120","title":"Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit","created":"2025-11-19","cited_by_count":6},{"id":"2502.13961","title":"The Computational Advantage of Depth: Learning High-Dimensional Hierarchical Functions with Gradient Descent","created":"2025-02-19","cited_by_count":3},{"id":"2411.17201","title":"Learning Hierarchical Polynomials of Multiple Nonlinear Features with Three-Layer Networks","created":"2024-11-26","cited_by_count":1}],"next_cursor":null}