{"list":"other","total":80,"rows":[{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"2002.08791","title":"Bayesian Deep Learning and a Probabilistic Perspective of Generalization","created":"2020-02-20","cited_by_count":480},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"2007.06823","title":"Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users","created":"2020-07-14","cited_by_count":338},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1704.04289","title":"Stochastic Gradient Descent as Approximate Bayesian Inference","created":"2017-04-13","cited_by_count":300},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"1905.13210","title":"Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks","created":"2019-05-30","cited_by_count":222},{"id":"1901.06053","title":"A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks","created":"2019-01-18","cited_by_count":214},{"id":"1810.10531","title":"A mathematical theory of semantic development in deep neural networks","created":"2018-10-23","cited_by_count":186},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2106.10165","title":"The Principles of Deep Learning Theory","created":"2021-06-18","cited_by_count":173},{"id":"1712.06559","title":"The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning","created":"2017-12-18","cited_by_count":150},{"id":"1506.04696","title":"A Complete Recipe for Stochastic Gradient MCMC","created":"2015-06-15","cited_by_count":146},{"id":"1511.06251","title":"Stochastic modified equations and adaptive stochastic gradient algorithms","created":"2015-11-19","cited_by_count":142},{"id":"1710.06451","title":"A Bayesian Perspective on Generalization and Stochastic Gradient Descent","created":"2017-10-17","cited_by_count":135},{"id":"1904.13262","title":"Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks","created":"2019-04-30","cited_by_count":124},{"id":"1512.07666","title":"Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks","created":"2015-12-23","cited_by_count":121},{"id":"1906.08632","title":"Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup","created":"2019-06-18","cited_by_count":112},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"1710.11029","title":"Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks","created":"2017-10-30","cited_by_count":109},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91},{"id":"1809.10374","title":"An analytic theory of generalization dynamics and transfer learning in deep linear networks","created":"2018-09-27","cited_by_count":85},{"id":"2007.12826","title":"The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training","created":"2020-07-25","cited_by_count":84},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73},{"id":"1610.08637","title":"Statistical Inference for Model Parameters in Stochastic Gradient Descent","created":"2016-10-27","cited_by_count":71},{"id":"1803.05999","title":"Escaping Saddles with Stochastic Gradients","created":"2018-03-15","cited_by_count":66},{"id":"1712.01473","title":"Deep linear neural networks with arbitrary loss: All local minima are global","created":"2017-12-05","cited_by_count":65},{"id":"2207.02628","title":"The alignment property of SGD noise and how it helps select flat minima: A stability analysis","created":"2022-07-06","cited_by_count":64},{"id":"2003.07802","title":"The Implicit Regularization of Stochastic Gradient Flow for Least Squares","created":"2020-03-17","cited_by_count":59},{"id":"1602.02666","title":"A Variational Analysis of Stochastic Gradient Algorithms","created":"2016-02-08","cited_by_count":57},{"id":"1901.08572","title":"Width Provably Matters in Optimization for Deep Linear Neural Networks","created":"2019-01-24","cited_by_count":52},{"id":"2211.11567","title":"Neural networks trained with SGD learn distributions of increasing complexity","created":"2022-11-21","cited_by_count":50},{"id":"1904.06963","title":"The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent","created":"2019-04-15","cited_by_count":46},{"id":"1906.07774","title":"On the interplay between noise and curvature and its effect on optimization and generalization","created":"2019-06-18","cited_by_count":44},{"id":"1906.09069","title":"First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise","created":"2019-06-21","cited_by_count":44},{"id":"1912.00018","title":"On the Heavy-Tailed Theory of Stochastic Gradient Descent for Deep Neural Networks","created":"2019-11-29","cited_by_count":43},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39},{"id":"2105.01650","title":"Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis","created":"2021-05-04","cited_by_count":39},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39},{"id":"2012.03636","title":"Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent","created":"2020-12-07","cited_by_count":37},{"id":"2303.14151","title":"Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle","created":"2023-03-24","cited_by_count":37},{"id":"2105.09557","title":"Power-law escape rate of SGD","created":"2021-05-20","cited_by_count":29},{"id":"2010.13933","title":"Memorizing without overfitting: Bias, variance, and interpolation in over-parameterized models","created":"2020-10-26","cited_by_count":27},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25},{"id":"2112.10852","title":"The effective noise of Stochastic Gradient Descent","created":"2021-12-20","cited_by_count":25},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24},{"id":"2206.01246","title":"Stochastic gradient descent introduces an effective landscape-dependent regularization favoring flat solutions","created":"2022-06-02","cited_by_count":22},{"id":"1803.01927","title":"Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning","created":"2018-03-05","cited_by_count":20},{"id":"2007.06352","title":"Quantitative Propagation of Chaos for SGD in Wide Neural Networks","created":"2020-07-13","cited_by_count":20},{"id":"2211.16980","title":"Infinite-width limit of deep linear neural networks","created":"2022-11-29","cited_by_count":20},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19},{"id":"2006.13719","title":"Dynamic of Stochastic Gradient Descent with State-Dependent Noise","created":"2020-06-24","cited_by_count":12},{"id":"2203.07337","title":"Phenomenology of Double Descent in Finite-Width Neural Networks","created":"2022-03-14","cited_by_count":12},{"id":"2009.10588","title":"Anomalous diffusion dynamics of learning in deep neural networks","created":"2020-09-22","cited_by_count":9},{"id":"2301.13703","title":"Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning","created":"2023-01-31","cited_by_count":9},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9},{"id":"2302.07125","title":"Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent","created":"2023-02-14","cited_by_count":7},{"id":"2306.03521","title":"Machine learning in and out of equilibrium","created":"2023-06-06","cited_by_count":5},{"id":"2109.09833","title":"Revisiting the Characteristics of Stochastic Gradient Noise and Dynamics","created":"2021-09-20","cited_by_count":4},{"id":"2106.02220","title":"Fluctuation-dissipation Type Theorem in Stochastic Linear Learning","created":"2021-06-04","cited_by_count":3},{"id":"2111.01022","title":"Dropout in Training Neural Networks: Flatness of Solution and Noise Structure","created":"2021-11-01","cited_by_count":2},{"id":"2306.05300","title":"Anti-Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances in Flat Directions","created":"2023-06-08","cited_by_count":2}],"next_cursor":null}