{"list":"other","total":64,"rows":[{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"1804.08838","title":"Measuring the Intrinsic Dimension of Objective Landscapes","created":"2018-04-24","cited_by_count":370},{"id":"1707.09564","title":"A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks","created":"2017-07-29","cited_by_count":314},{"id":"1705.07809","title":"Information-theoretic analysis of generalization capability of learning algorithms","created":"2017-05-22","cited_by_count":303},{"id":"1704.04289","title":"Stochastic Gradient Descent as Approximate Bayesian Inference","created":"2017-04-13","cited_by_count":300},{"id":"1912.07145","title":"PyHessian: Neural Networks Through the Lens of the Hessian","created":"2019-12-16","cited_by_count":292},{"id":"1705.08741","title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","created":"2017-05-24","cited_by_count":279},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"2006.14651","title":"Influence Functions in Deep Learning Are Fragile","created":"2020-06-25","cited_by_count":252},{"id":"1702.03849","title":"Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysis","created":"2017-02-13","cited_by_count":243},{"id":"2110.11216","title":"User-friendly introduction to PAC-Bayes bounds","created":"2021-10-21","cited_by_count":239},{"id":"1902.04742","title":"Uniform convergence may be unable to explain generalization in deep learning","created":"2019-02-13","cited_by_count":224},{"id":"1812.04754","title":"Gradient Descent Happens in a Tiny Subspace","created":"2018-12-12","cited_by_count":217},{"id":"1901.06053","title":"A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks","created":"2019-01-18","cited_by_count":214},{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184},{"id":"2006.06914","title":"Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses","created":"2020-06-12","cited_by_count":173},{"id":"2001.09122","title":"Reasoning About Generalization via Conditional Mutual Information","created":"2020-01-24","cited_by_count":147},{"id":"2009.11162","title":"Implicit Gradient Regularization","created":"2020-09-23","cited_by_count":146},{"id":"1511.06251","title":"Stochastic modified equations and adaptive stochastic gradient algorithms","created":"2015-11-19","cited_by_count":142},{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128},{"id":"2006.04740","title":"The Heavy-Tail Phenomenon in SGD","created":"2020-06-08","cited_by_count":124},{"id":"1911.02151","title":"Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates","created":"2019-11-06","cited_by_count":119},{"id":"1901.04609","title":"Tightening Mutual Information Based Bounds on Generalization Error","created":"2019-01-15","cited_by_count":117},{"id":"1811.01558","title":"Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations","created":"2018-11-05","cited_by_count":114},{"id":"1511.05219","title":"How much does your data exploration overfit? Controlling bias via information usage","created":"2015-11-16","cited_by_count":95},{"id":"2004.12983","title":"Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms","created":"2020-04-27","cited_by_count":89},{"id":"2102.00931","title":"Information-Theoretic Generalization Bounds for Stochastic Gradient Descent","created":"2021-02-01","cited_by_count":84},{"id":"1801.04295","title":"Generalization Error Bounds for Noisy, Iterative Algorithms","created":"2018-01-12","cited_by_count":82},{"id":"1802.08770","title":"A Walk with SGD","created":"2018-02-24","cited_by_count":78},{"id":"1912.10985","title":"BackPACK: Packing more into backprop","created":"2019-12-23","cited_by_count":78},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73},{"id":"1806.03803","title":"Chaining Mutual Information and Tightening Generalization Bounds","created":"2018-06-11","cited_by_count":65},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63},{"id":"2006.09313","title":"Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks","created":"2020-06-16","cited_by_count":62},{"id":"2012.14193","title":"Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization","created":"2020-12-28","cited_by_count":62},{"id":"1901.01672","title":"Generalization in Deep Networks: The Role of Distance from Initialization","created":"2019-01-07","cited_by_count":51},{"id":"1906.07774","title":"On the interplay between noise and curvature and its effect on optimization and generalization","created":"2019-06-18","cited_by_count":44},{"id":"1906.09069","title":"First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise","created":"2019-06-21","cited_by_count":44},{"id":"2005.08044","title":"Generalization Bounds via Information Density and Conditional Information Density","created":"2020-05-16","cited_by_count":43},{"id":"1905.12213","title":"Where is the Information in a Deep Neural Network?","created":"2019-05-29","cited_by_count":42},{"id":"1702.08712","title":"Algorithmic stability and hypothesis complexity","created":"2017-02-28","cited_by_count":39},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39},{"id":"1907.10732","title":"Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization","created":"2019-07-24","cited_by_count":37},{"id":"2012.03636","title":"Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent","created":"2020-12-07","cited_by_count":37},{"id":"2106.09683","title":"PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes","created":"2021-06-17","cited_by_count":31},{"id":"2110.03128","title":"On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications","created":"2021-10-07","cited_by_count":31},{"id":"2103.17182","title":"Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization","created":"2021-03-31","cited_by_count":28},{"id":"2107.05802","title":"How many degrees of freedom do we need to train deep networks: a loss landscape perspective","created":"2021-07-13","cited_by_count":28},{"id":"2109.14509","title":"PAC-Bayes Information Bottleneck","created":"2021-09-29","cited_by_count":28},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23},{"id":"1910.09626","title":"Non-Gaussianity of Stochastic Gradient Noise","created":"2019-10-21","cited_by_count":22},{"id":"2101.06640","title":"Estimating informativeness of samples with Smooth Unique Information","created":"2021-01-17","cited_by_count":15},{"id":"2102.02976","title":"Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels","created":"2021-02-05","cited_by_count":15},{"id":"2006.13719","title":"Dynamic of Stochastic Gradient Descent with State-Dependent Noise","created":"2020-06-24","cited_by_count":12},{"id":"2203.07337","title":"Phenomenology of Double Descent in Finite-Width Neural Networks","created":"2022-03-14","cited_by_count":12}],"next_cursor":null}