{"list":"other","total":132,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1312.6199","title":"Intriguing properties of neural networks","created":"2013-12-21","cited_by_count":5155},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"1502.01852","title":"Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification","created":"2015-02-06","cited_by_count":3611},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1603.05027","title":"Identity Mappings in Deep Residual Networks","created":"2016-03-16","cited_by_count":1965},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1906.02530","title":"Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift","created":"2019-06-06","cited_by_count":1287},{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167},{"id":"1602.07576","title":"Group Equivariant Convolutional Networks","created":"2016-02-24","cited_by_count":1165},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"1511.07289","title":"Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)","created":"2015-11-23","cited_by_count":1070},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"2011.06225","title":"A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges","created":"2020-11-12","cited_by_count":819},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1606.03490","title":"The Mythos of Model Interpretability","created":"2016-06-10","cited_by_count":721},{"id":"1603.04467","title":"TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems","created":"2016-03-14","cited_by_count":664},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1802.10026","title":"Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs","created":"2018-02-27","cited_by_count":588},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1412.0035","title":"Understanding Deep Image Representations by Inverting Them","created":"2014-11-26","cited_by_count":403},{"id":"1804.08838","title":"Measuring the Intrinsic Dimension of Objective Landscapes","created":"2018-04-24","cited_by_count":370},{"id":"1803.00885","title":"Essentially No Barriers in Neural Network Energy Landscape","created":"2018-03-02","cited_by_count":330},{"id":"1612.08498","title":"Steerable CNNs","created":"2016-12-27","cited_by_count":305},{"id":"1901.10159","title":"An Investigation into Neural Net Optimization via Hessian Eigenvalue Density","created":"2019-01-29","cited_by_count":292},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1406.2572","title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","created":"2014-06-10","cited_by_count":289},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"1902.04615","title":"Gauge Equivariant Convolutional Networks and the Icosahedral CNN","created":"2019-02-11","cited_by_count":267},{"id":"1906.05433","title":"Tackling Climate Change with Machine Learning","created":"2019-06-10","cited_by_count":265},{"id":"1606.05340","title":"Exponential expressivity in deep neural networks through transient chaos","created":"2016-06-16","cited_by_count":261},{"id":"2009.05041","title":"Understanding the Role of Individual Units in a Deep Neural Network","created":"2020-09-10","cited_by_count":255},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2011.14522","title":"Feature Learning in Infinite-Width Neural Networks","created":"2020-11-30","cited_by_count":190},{"id":"2010.15110","title":"Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel","created":"2020-10-28","cited_by_count":187},{"id":"1611.07476","title":"Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond","created":"2016-11-22","cited_by_count":159},{"id":"2007.15801","title":"Finite Versus Infinite Neural Networks: an Empirical Study","created":"2020-07-31","cited_by_count":157},{"id":"2006.13409","title":"When Do Neural Networks Outperform Kernel Methods?","created":"2020-06-24","cited_by_count":150},{"id":"1705.09886","title":"Convergence Analysis of Two-layer Neural Networks with ReLU Activation","created":"2017-05-28","cited_by_count":137},{"id":"1803.04386","title":"Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches","created":"2018-03-12","cited_by_count":133},{"id":"1711.04735","title":"Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice","created":"2017-11-13","cited_by_count":132},{"id":"2006.12024","title":"Bayesian Neural Networks: An Introduction and Survey","created":"2020-06-22","cited_by_count":131},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"1611.04231","title":"Identity Matters in Deep Learning","created":"2016-11-14","cited_by_count":109},{"id":"1611.01540","title":"Topology and Geometry of Half-Rectified Network Optimization","created":"2016-11-04","cited_by_count":102},{"id":"1803.01206","title":"On the Power of Over-parametrization in Neural Networks with Quadratic Activation","created":"2018-03-03","cited_by_count":102},{"id":"1608.08225","title":"Why does deep and cheap learning work so well?","created":"2016-08-29","cited_by_count":100},{"id":"2009.10713","title":"Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't","created":"2020-09-22","cited_by_count":95},{"id":"1706.03175","title":"Recovery Guarantees for One-hidden-layer Neural Networks","created":"2017-06-10","cited_by_count":94},{"id":"2008.11865","title":"Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra","created":"2020-08-27","cited_by_count":94},{"id":"1602.02660","title":"Exploiting Cyclic Symmetry in Convolutional Neural Networks","created":"2016-02-08","cited_by_count":91},{"id":"1807.05031","title":"On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length","created":"2018-07-13","cited_by_count":88},{"id":"1309.7233","title":"Multilayer Networks","created":"2013-09-27","cited_by_count":87},{"id":"1906.08899","title":"Limitations of Lazy Training of Two-layers Neural Networks","created":"2019-06-21","cited_by_count":87},{"id":"2009.14397","title":"Deep Equals Shallow for ReLU Networks in Kernel Regimes","created":"2020-09-30","cited_by_count":85},{"id":"1910.00019","title":"Non-Gaussian processes and neural networks at finite widths","created":"2019-09-30","cited_by_count":78},{"id":"1909.11304","title":"Asymptotics of Wide Networks from Feynman Diagrams","created":"2019-09-25","cited_by_count":77},{"id":"1601.04920","title":"Understanding Deep Convolutional Networks","created":"2016-01-19","cited_by_count":76},{"id":"1704.08045","title":"The loss surface of deep and wide neural networks","created":"2017-04-26","cited_by_count":74},{"id":"2009.10683","title":"Deep Neural Tangent Kernel and Laplace Kernel Have the Same RKHS","created":"2020-09-22","cited_by_count":74},{"id":"1905.05929","title":"Orthogonal Deep Neural Networks","created":"2019-05-15","cited_by_count":72},{"id":"1912.08957","title":"Optimization for deep learning: theory and algorithms","created":"2019-12-19","cited_by_count":70},{"id":"2006.05013","title":"A Random Matrix Analysis of Random Fourier Features: Beyond the Gaussian Kernel, a Precise Phase Transition, and the Corresponding Double Descent","created":"2020-06-09","cited_by_count":70},{"id":"1901.08244","title":"Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians","created":"2019-01-24","cited_by_count":68},{"id":"1906.04724","title":"Large Scale Structure of Neural Network Loss Landscapes","created":"2019-06-11","cited_by_count":68},{"id":"2001.11443","title":"A Rigorous Framework for the Mean Field Limit of Multilayer Neural Networks","created":"2020-01-30","cited_by_count":68},{"id":"1810.09665","title":"A jamming transition from under- to over-parametrization affects loss landscape and generalization","created":"2018-10-22","cited_by_count":67},{"id":"2007.07497","title":"Phase diagram for two-layer ReLU neural networks at infinite-width limit","created":"2020-07-15","cited_by_count":67},{"id":"1705.09156","title":"The free energy principle for action and perception: A mathematical review","created":"2017-05-24","cited_by_count":66},{"id":"2105.02968","title":"This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networks","created":"2021-05-05","cited_by_count":65},{"id":"1906.06247","title":"Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets","created":"2019-06-14","cited_by_count":63},{"id":"1809.09349","title":"The jamming transition as a paradigm to understand the loss landscape of deep neural networks","created":"2018-09-25","cited_by_count":62},{"id":"1702.07966","title":"Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputs","created":"2017-02-26","cited_by_count":61},{"id":"2007.01429","title":"The Global Landscape of Neural Networks: An Overview","created":"2020-07-02","cited_by_count":57},{"id":"1410.3831","title":"An exact mapping between the Variational Renormalization Group and Deep Learning","created":"2014-10-14","cited_by_count":56},{"id":"1801.03421","title":"Blessing of dimensionality: mathematical foundations of the statistical physics of data","created":"2018-01-10","cited_by_count":55},{"id":"1705.04591","title":"Learning ReLUs via Gradient Descent","created":"2017-05-10","cited_by_count":54},{"id":"1901.07417","title":"On Connected Sublevel Sets in Deep Learning","created":"2019-01-22","cited_by_count":51},{"id":"1412.8659","title":"Deep Roto-Translation Scattering for Object Classification","created":"2014-12-30","cited_by_count":50},{"id":"2105.09513","title":"Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions","created":"2021-05-20","cited_by_count":49},{"id":"1910.05929","title":"Emergent properties of the local geometry of neural loss landscapes","created":"2019-10-14","cited_by_count":46},{"id":"2006.13436","title":"Towards Understanding Hierarchical Learning: Benefits of Neural Representations","created":"2020-06-24","cited_by_count":46},{"id":"1803.06969","title":"Comparing Dynamics: Deep Neural Networks versus Glassy Systems","created":"2018-03-19","cited_by_count":42},{"id":"1910.08013","title":"Why bigger is not always better: on finite and infinite neural networks","created":"2019-10-17","cited_by_count":41},{"id":"2103.01210","title":"Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels","created":"2021-03-01","cited_by_count":41},{"id":"1809.10749","title":"On the loss landscape of a class of deep neural networks with no bad local valleys","created":"2018-09-27","cited_by_count":38},{"id":"1511.05176","title":"MuProp: Unbiased Backpropagation for Stochastic Neural Networks","created":"2015-11-16","cited_by_count":37},{"id":"1912.10095","title":"Landscape Connectivity and Dropout Stability of SGD Solutions for Over-parameterized Neural Networks","created":"2019-12-20","cited_by_count":35},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33}],"next_cursor":"100"}