{"list":"other","total":70,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"2006.16668","title":"GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding","created":"2020-06-30","cited_by_count":1631},{"id":"1902.10811","title":"Do ImageNet Classifiers Generalize to ImageNet?","created":"2019-02-13","cited_by_count":1515},{"id":"1907.02189","title":"On the Convergence of FedAvg on Non-IID Data","created":"2019-07-04","cited_by_count":1229},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1812.05159","title":"An Empirical Study of Example Forgetting during Deep Neural Network Learning","created":"2018-12-12","cited_by_count":678},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1805.09767","title":"Local SGD Converges Fast and Communicates Little","created":"2018-05-24","cited_by_count":605},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1511.00363","title":"BinaryConnect: Training Deep Neural Networks with binary weights during propagations","created":"2015-11-02","cited_by_count":592},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"1506.02557","title":"Variational Dropout and the Local Reparameterization Trick","created":"2015-06-08","cited_by_count":490},{"id":"1906.05271","title":"Does Learning Require Memorization? A Short Tale about a Long Tail","created":"2019-06-12","cited_by_count":460},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"1707.09564","title":"A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks","created":"2017-07-29","cited_by_count":314},{"id":"1802.05296","title":"Stronger generalization bounds for deep nets via a compression approach","created":"2018-02-14","cited_by_count":307},{"id":"1812.08928","title":"Slimmable Neural Networks","created":"2018-12-21","cited_by_count":305},{"id":"1712.06541","title":"Size-Independent Sample Complexity of Neural Networks","created":"2017-12-18","cited_by_count":290},{"id":"1909.04746","title":"Tighter Theory for Local SGD on Identical and Heterogeneous Data","created":"2019-09-10","cited_by_count":266},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1905.13727","title":"PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization","created":"2019-05-31","cited_by_count":238},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"1903.11680","title":"Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networks","created":"2019-03-27","cited_by_count":159},{"id":"1910.14425","title":"On the Convergence of Local Descent Methods in Federated Learning","created":"2019-10-31","cited_by_count":153},{"id":"1712.06559","title":"The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning","created":"2017-12-18","cited_by_count":150},{"id":"1710.05468","title":"Generalization in Deep Learning","created":"2017-10-16","cited_by_count":146},{"id":"1811.08888","title":"Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks","created":"2018-11-21","cited_by_count":141},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1804.05862","title":"Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach","created":"2018-04-16","cited_by_count":126},{"id":"1909.12292","title":"Polylogarithmic width suffices for gradient descent to achieve arbitrarily small test error with shallow ReLU networks","created":"2019-09-26","cited_by_count":121},{"id":"1711.01530","title":"Fisher-Rao Metric, Geometry, and Complexity of Neural Networks","created":"2017-11-05","cited_by_count":100},{"id":"1806.05161","title":"Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate","created":"2018-06-13","cited_by_count":99},{"id":"1812.10004","title":"Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?","created":"2018-12-25","cited_by_count":88},{"id":"1909.04715","title":"First Analysis of Local GD on Heterogeneous Data","created":"2019-09-10","cited_by_count":81},{"id":"1810.09665","title":"A jamming transition from under- to over-parametrization affects loss landscape and generalization","created":"2018-10-22","cited_by_count":67},{"id":"2103.03936","title":"Pufferfish: Communication-efficient Models At No Extra Cost","created":"2021-03-05","cited_by_count":61},{"id":"2002.06262","title":"Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? -- A Neural Tangent Kernel Perspective","created":"2020-02-14","cited_by_count":60},{"id":"1906.03593","title":"Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound","created":"2019-06-09","cited_by_count":59},{"id":"2003.05508","title":"A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth","created":"2020-03-11","cited_by_count":56},{"id":"1904.13310","title":"Survey of Dropout Methods for Deep Neural Networks","created":"2019-04-25","cited_by_count":44},{"id":"2007.01452","title":"Modeling from Features: a Mean-field Framework for Over-parameterized Deep Neural Networks","created":"2020-07-03","cited_by_count":44},{"id":"2101.09612","title":"On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths","created":"2021-01-24","cited_by_count":44},{"id":"1606.07365","title":"Parallel SGD: When does averaging help?","created":"2016-06-23","cited_by_count":32},{"id":"2101.00562","title":"Few-shot Image Classification: Just Use a Library of Pre-trained Feature Extractors and a Simple Classifier","created":"2021-01-03","cited_by_count":32},{"id":"1905.10826","title":"On Learning Over-parameterized Neural Networks: A Functional Approximation Perspective","created":"2019-05-26","cited_by_count":28},{"id":"2006.12030","title":"DO-Conv: Depthwise Over-parameterized Convolutional Layer","created":"2020-06-22","cited_by_count":28},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26},{"id":"1910.04743","title":"The Implicit Regularization of Ordinary Least Squares Ensembles","created":"2019-10-10","cited_by_count":25},{"id":"1910.02120","title":"Distributed Learning of Deep Neural Networks using Independent Subnet Training","created":"2019-10-04","cited_by_count":20},{"id":"2010.12711","title":"On Convergence and Generalization of Dropout Training","created":"2020-10-23","cited_by_count":19},{"id":"2107.00961","title":"ResIST: Layer-Wise Decomposition of ResNets for Distributed Training","created":"2021-07-02","cited_by_count":18},{"id":"1910.02934","title":"Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks","created":"2019-10-07","cited_by_count":16},{"id":"1905.09788","title":"Multi-Sample Dropout for Accelerated Training and Better Generalization","created":"2019-05-23","cited_by_count":14},{"id":"2105.05001","title":"FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis","created":"2021-05-11","cited_by_count":13},{"id":"2102.10424","title":"GIST: Distributed Training for Large-Scale Graph Convolutional Networks","created":"2021-02-20","cited_by_count":10},{"id":"2107.10868","title":"Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time","created":"2021-07-22","cited_by_count":10},{"id":"2106.07769","title":"The Flip Side of the Reweighted Coin: Duality of Adaptive Dropout and Regularization","created":"2021-06-14","cited_by_count":6},{"id":"1403.7550","title":"DimmWitted: A Study of Main-Memory Statistical Analytics","created":"2014-03-28","cited_by_count":4},{"id":"2012.01978","title":"Asymptotic convergence rate of Dropout on shallow linear neural networks","created":"2020-12-01","cited_by_count":4},{"id":"2011.14066","title":"On Generalization of Adaptive Methods for Over-parameterized Linear Regression","created":"2020-11-28","cited_by_count":3}],"next_cursor":null}