{"list":"other","total":72,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1909.13719","title":"RandAugment: Practical automated data augmentation with a reduced search space","created":"2019-09-30","cited_by_count":2269},{"id":"1603.05027","title":"Identity Mappings in Deep Residual Networks","created":"2016-03-16","cited_by_count":1965},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1511.07289","title":"Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)","created":"2015-11-23","cited_by_count":1070},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1912.11370","title":"Big Transfer (BiT): General Visual Representation Learning","created":"2019-12-24","cited_by_count":769},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1806.08342","title":"Quantizing deep convolutional networks for efficient inference: A whitepaper","created":"2018-06-21","cited_by_count":521},{"id":"1505.00853","title":"Empirical Evaluation of Rectified Activations in Convolutional Network","created":"2015-05-05","cited_by_count":519},{"id":"1805.11604","title":"How Does Batch Normalization Help Optimization?","created":"2018-05-29","cited_by_count":357},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"2003.04887","title":"ReZero is All You Need: Fast Convergence at Large Depth","created":"2020-03-10","cited_by_count":264},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"1905.13210","title":"Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks","created":"2019-05-30","cited_by_count":222},{"id":"1808.00387","title":"Just Interpolate: Kernel \"Ridgeless\" Regression Can Generalize","created":"2018-08-01","cited_by_count":190},{"id":"1802.01396","title":"To understand deep learning we need to understand kernel learning","created":"2018-02-05","cited_by_count":187},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1512.03965","title":"The Power of Depth for Feedforward Neural Networks","created":"2015-12-12","cited_by_count":183},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"1507.06228","title":"Training Very Deep Networks","created":"2015-07-22","cited_by_count":173},{"id":"1901.09021","title":"Complexity of Linear Regions in Deep Networks","created":"2019-01-25","cited_by_count":167},{"id":"1906.00904","title":"Deep ReLU Networks Have Surprisingly Few Activation Patterns","created":"2019-06-03","cited_by_count":161},{"id":"2007.15801","title":"Finite Versus Infinite Neural Networks: an Empirical Study","created":"2020-07-31","cited_by_count":157},{"id":"1811.08888","title":"Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks","created":"2018-11-21","cited_by_count":141},{"id":"1705.09886","title":"Convergence Analysis of Two-layer Neural Networks with ReLU Activation","created":"2017-05-28","cited_by_count":137},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1906.04688","title":"An Improved Analysis of Training Over-parameterized Deep Neural Networks","created":"2019-06-11","cited_by_count":121},{"id":"2003.13630","title":"TResNet: High Performance GPU-Dedicated Architecture","created":"2020-03-30","cited_by_count":119},{"id":"1611.04231","title":"Identity Matters in Deep Learning","created":"2016-11-14","cited_by_count":109},{"id":"1712.08968","title":"Spurious Local Minima are Common in Two-Layer ReLU Neural Networks","created":"2017-12-24","cited_by_count":104},{"id":"1803.01206","title":"On the Power of Over-parametrization in Neural Networks with Quadratic Activation","created":"2018-03-03","cited_by_count":102},{"id":"1806.05161","title":"Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate","created":"2018-06-13","cited_by_count":99},{"id":"1509.05009","title":"On the Expressive Power of Deep Learning: A Tensor Analysis","created":"2015-09-16","cited_by_count":97},{"id":"1909.08156","title":"Dynamics of Deep Neural Networks and Neural Tangent Hierarchy","created":"2019-09-18","cited_by_count":96},{"id":"1801.03744","title":"Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients?","created":"2018-01-11","cited_by_count":94},{"id":"1509.08101","title":"Representation Benefits of Deep Feedforward Networks","created":"2015-09-27","cited_by_count":86},{"id":"1803.07300","title":"Risk and parameter convergence of logistic regression","created":"2018-03-20","cited_by_count":85},{"id":"1911.12360","title":"How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks?","created":"2019-11-27","cited_by_count":84},{"id":"1901.01608","title":"Scaling description of generalization with number of parameters in deep learning","created":"2019-01-06","cited_by_count":83},{"id":"1610.04161","title":"Why Deep Neural Networks for Function Approximation?","created":"2016-10-13","cited_by_count":82},{"id":"1810.07770","title":"Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity","created":"2018-10-17","cited_by_count":78},{"id":"1911.00809","title":"Enhanced Convolutional Neural Tangent Kernels","created":"2019-11-03","cited_by_count":76},{"id":"1410.1141","title":"On the Computational Efficiency of Training Neural Networks","created":"2014-10-05","cited_by_count":71},{"id":"1702.07966","title":"Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputs","created":"2017-02-26","cited_by_count":61},{"id":"2002.06262","title":"Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? -- A Neural Tangent Kernel Perspective","created":"2020-02-14","cited_by_count":60},{"id":"1906.03593","title":"Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound","created":"2019-06-09","cited_by_count":59},{"id":"1806.07808","title":"Learning One-hidden-layer ReLU Networks via Gradient Descent","created":"2018-06-20","cited_by_count":50},{"id":"1706.00388","title":"DiracNets: Training Very Deep Neural Networks Without Skip-Connections","created":"2017-06-01","cited_by_count":47},{"id":"1802.06093","title":"Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks","created":"2018-02-16","cited_by_count":44},{"id":"1906.08031","title":"XNAS: Neural Architecture Search with Expert Advice","created":"2019-06-19","cited_by_count":35},{"id":"1707.02444","title":"Global optimality conditions for deep neural networks","created":"2017-07-08","cited_by_count":31},{"id":"1904.04123","title":"ASAP: Architecture Search, Anneal and Prune","created":"2019-04-08","cited_by_count":29},{"id":"1908.02419","title":"Gradient Descent Finds Global Minima for Generalizable Deep Neural Networks of Practical Sizes","created":"2019-08-05","cited_by_count":29},{"id":"1703.06503","title":"CLTune: A Generic Auto-Tuner for OpenCL Kernels","created":"2017-03-19","cited_by_count":27},{"id":"1803.00909","title":"Understanding the Loss Surface of Neural Networks for Binary Classification","created":"2018-02-19","cited_by_count":27},{"id":"1902.07111","title":"Global Convergence of Adaptive Gradient Methods for An Over-parameterized Neural Network","created":"2019-02-19","cited_by_count":27},{"id":"1611.06013","title":"Improving training of deep neural networks via Singular Value Bounding","created":"2016-11-18","cited_by_count":26},{"id":"1802.06384","title":"Spurious Valleys in Two-layer Neural Network Optimization Landscapes","created":"2018-02-18","cited_by_count":21},{"id":"1912.13053","title":"Disentangling Trainability and Generalization in Deep Neural Networks","created":"2019-12-30","cited_by_count":16},{"id":"1711.03440","title":"Learning Non-overlapping Convolutional Neural Networks with Multiple Kernels","created":"2017-11-08","cited_by_count":14},{"id":"1911.02675","title":"Faster Least Squares Optimization","created":"2019-11-06","cited_by_count":8}],"next_cursor":null}