{"list":"other","total":63,"rows":[{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1802.10026","title":"Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs","created":"2018-02-27","cited_by_count":588},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"1707.09564","title":"A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks","created":"2017-07-29","cited_by_count":314},{"id":"1703.02930","title":"Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks","created":"2017-03-08","cited_by_count":311},{"id":"1802.05296","title":"Stronger generalization bounds for deep nets via a compression approach","created":"2018-02-14","cited_by_count":307},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1712.06541","title":"Size-Independent Sample Complexity of Neural Networks","created":"2017-12-18","cited_by_count":290},{"id":"1705.08741","title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","created":"2017-05-24","cited_by_count":279},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1503.02101","title":"Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition","created":"2015-03-06","cited_by_count":243},{"id":"1702.03849","title":"Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysis","created":"2017-02-13","cited_by_count":243},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"2003.00307","title":"Loss landscapes and optimization in over-parameterized non-linear systems and neural networks","created":"2020-02-29","cited_by_count":233},{"id":"1902.06015","title":"Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit","created":"2019-02-16","cited_by_count":187},{"id":"1611.07476","title":"Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond","created":"2016-11-22","cited_by_count":159},{"id":"1712.06559","title":"The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning","created":"2017-12-18","cited_by_count":150},{"id":"1705.09886","title":"Convergence Analysis of Two-layer Neural Networks with ReLU Activation","created":"2017-05-28","cited_by_count":137},{"id":"1710.06451","title":"A Bayesian Perspective on Generalization and Stochastic Gradient Descent","created":"2017-10-17","cited_by_count":135},{"id":"1310.5715","title":"Stochastic Gradient Descent, Weighted Sampling, and the Randomized Kaczmarz algorithm","created":"2013-10-21","cited_by_count":133},{"id":"1804.05862","title":"Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach","created":"2018-04-16","cited_by_count":126},{"id":"1605.08254","title":"Robust Large Margin Deep Neural Networks","created":"2016-05-26","cited_by_count":118},{"id":"1802.06175","title":"An Alternative View: When Does SGD Escape Local Minima?","created":"2018-02-17","cited_by_count":115},{"id":"1611.01540","title":"Topology and Geometry of Half-Rectified Network Optimization","created":"2016-11-04","cited_by_count":102},{"id":"1910.07833","title":"Sharper bounds for uniformly stable algorithms","created":"2019-10-17","cited_by_count":93},{"id":"1703.01678","title":"Data-Dependent Stability of Stochastic Gradient Descent","created":"2017-03-05","cited_by_count":92},{"id":"1902.00744","title":"Asymmetric Valleys: Beyond Sharp and Flat Local Minima","created":"2019-02-02","cited_by_count":90},{"id":"1707.06386","title":"Bridging the Gap between Constant Step Size Stochastic Gradient Descent and Markov Chains","created":"2017-07-20","cited_by_count":88},{"id":"2204.01050","title":"Understanding the unstable convergence of gradient descent","created":"2022-04-03","cited_by_count":86},{"id":"2007.12826","title":"The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training","created":"2020-07-25","cited_by_count":84},{"id":"1703.04680","title":"On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator","created":"2017-03-14","cited_by_count":73},{"id":"1812.09859","title":"Generalization Bounds for Uniformly Stable Algorithms","created":"2018-12-24","cited_by_count":56},{"id":"1805.09785","title":"Entropy and mutual information in models of deep neural networks","created":"2018-05-24","cited_by_count":51},{"id":"2006.15191","title":"Is SGD a Bayesian sampler? Well, almost","created":"2020-06-26","cited_by_count":50},{"id":"2110.03677","title":"Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect","created":"2021-10-07","cited_by_count":50},{"id":"1903.04440","title":"Mean Field Analysis of Deep Neural Networks","created":"2019-03-11","cited_by_count":42},{"id":"2105.01650","title":"Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis","created":"2021-05-04","cited_by_count":39},{"id":"1809.10749","title":"On the loss landscape of a class of deep neural networks with no bad local valleys","created":"2018-09-27","cited_by_count":38},{"id":"2006.02361","title":"Optimizing Neural Networks via Koopman Operator Theory","created":"2020-06-03","cited_by_count":33},{"id":"2102.05274","title":"Stability of SGD: Tightness Analysis and Improved Bounds","created":"2021-02-10","cited_by_count":33},{"id":"2002.06189","title":"Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function","created":"2020-02-14","cited_by_count":26},{"id":"1506.07540","title":"Global Optimality in Tensor Factorization, Deep Learning, and Beyond","created":"2015-06-24","cited_by_count":22},{"id":"1511.04210","title":"On the Quality of the Initial Basin in Overspecified Neural Networks","created":"2015-11-13","cited_by_count":20},{"id":"2106.15739","title":"On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay","created":"2021-06-29","cited_by_count":20},{"id":"1503.04123","title":"Perturbation theory for Markov chains via Wasserstein distance","created":"2015-03-13","cited_by_count":18},{"id":"1910.02934","title":"Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks","created":"2019-10-07","cited_by_count":16},{"id":"2110.06256","title":"Neural Network Weights Do Not Converge to Stationary Points: An Invariant Measure Perspective","created":"2021-10-12","cited_by_count":15},{"id":"1801.02254","title":"Theory of Deep Learning IIb: Optimization Properties of SGD","created":"2018-01-07","cited_by_count":12},{"id":"1909.03009","title":"Dissecting Non-Vacuous Generalization Bounds based on the Mean-Field Approximation","created":"2019-09-06","cited_by_count":6},{"id":"2002.04026","title":"A Generalized Neural Tangent Kernel Analysis for Two-layer Neural Networks","created":"2020-02-10","cited_by_count":5},{"id":"2106.04186","title":"What training reveals about neural network complexity","created":"2021-06-08","cited_by_count":5}],"next_cursor":null}