{"list":"other","total":61,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"1409.4842","title":"Going Deeper with Convolutions","created":"2014-09-17","cited_by_count":4241},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1806.01261","title":"Relational inductive biases, deep learning, and graph networks","created":"2018-06-04","cited_by_count":1360},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"2103.03404","title":"Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth","created":"2021-03-05","cited_by_count":419},{"id":"1805.10965","title":"Lipschitz regularity of deep neural networks: analysis and efficient estimation","created":"2018-05-28","cited_by_count":415},{"id":"1402.1869","title":"On the Number of Linear Regions of Deep Neural Networks","created":"2014-02-08","cited_by_count":381},{"id":"1707.09564","title":"A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks","created":"2017-07-29","cited_by_count":314},{"id":"1804.04368","title":"Regularisation of Neural Networks by Enforcing Lipschitz Continuity","created":"2018-04-12","cited_by_count":314},{"id":"1703.02930","title":"Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks","created":"2017-03-08","cited_by_count":311},{"id":"1802.05296","title":"Stronger generalization bounds for deep nets via a compression approach","created":"2018-02-14","cited_by_count":307},{"id":"1606.05336","title":"On the Expressive Power of Deep Neural Networks","created":"2016-06-16","cited_by_count":306},{"id":"1906.04893","title":"Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networks","created":"2019-06-12","cited_by_count":293},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1712.06541","title":"Size-Independent Sample Complexity of Neural Networks","created":"2017-12-18","cited_by_count":290},{"id":"1705.08741","title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","created":"2017-05-24","cited_by_count":279},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"1611.01491","title":"Understanding Deep Neural Networks with Rectified Linear Units","created":"2016-11-04","cited_by_count":257},{"id":"2009.11848","title":"How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks","created":"2020-09-24","cited_by_count":222},{"id":"1811.05381","title":"Sorting out Lipschitz function approximation","created":"2018-11-13","cited_by_count":213},{"id":"1907.03199","title":"What graph neural networks cannot learn: depth vs width","created":"2019-07-06","cited_by_count":201},{"id":"1802.04034","title":"Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networks","created":"2018-02-12","cited_by_count":195},{"id":"1802.08760","title":"Sensitivity and Generalization in Neural Networks: an Empirical Study","created":"2018-02-23","cited_by_count":189},{"id":"1901.09021","title":"Complexity of Linear Regions in Deep Networks","created":"2019-01-25","cited_by_count":167},{"id":"1711.02114","title":"Bounding and Counting Linear Regions of Deep Neural Networks","created":"2017-11-06","cited_by_count":161},{"id":"1705.09886","title":"Convergence Analysis of Two-layer Neural Networks with ReLU Activation","created":"2017-05-28","cited_by_count":137},{"id":"1605.08254","title":"Robust Large Margin Deep Neural Networks","created":"2016-05-26","cited_by_count":118},{"id":"1611.01540","title":"Topology and Geometry of Half-Rectified Network Optimization","created":"2016-11-04","cited_by_count":102},{"id":"2003.01219","title":"Exactly Computing the Local Lipschitz Constant of ReLU Networks","created":"2020-03-02","cited_by_count":102},{"id":"2005.02929","title":"Training robust neural networks using Lipschitz bounds","created":"2020-05-06","cited_by_count":99},{"id":"1703.01678","title":"Data-Dependent Stability of Stochastic Gradient Descent","created":"2017-03-05","cited_by_count":92},{"id":"1902.00744","title":"Asymmetric Valleys: Beyond Sharp and Flat Local Minima","created":"2019-02-02","cited_by_count":90},{"id":"2004.08688","title":"Lipschitz constant estimation of Neural Networks via sparse polynomial optimization","created":"2020-04-18","cited_by_count":87},{"id":"1710.10174","title":"SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data","created":"2017-10-27","cited_by_count":79},{"id":"2002.12915","title":"The Implicit and Explicit Regularization Effects of Dropout","created":"2020-02-28","cited_by_count":71},{"id":"1903.01014","title":"Lipschitz Certificates for Layered Network Structures Driven by Averaged Activation Operators","created":"2019-03-03","cited_by_count":55},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55},{"id":"1307.2118","title":"A PAC-Bayesian Tutorial with A Dropout Bound","created":"2013-07-08","cited_by_count":43},{"id":"1504.08291","title":"Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?","created":"2015-04-30","cited_by_count":41},{"id":"1809.10749","title":"On the loss landscape of a class of deep neural networks with no bad local valleys","created":"2018-09-27","cited_by_count":38},{"id":"1808.01415","title":"On Lipschitz Bounds of General Convolutional Neural Networks","created":"2018-08-04","cited_by_count":29},{"id":"2003.03397","title":"Dropout: Explicit Forms and Capacity Control","created":"2020-03-06","cited_by_count":27},{"id":"1511.04210","title":"On the Quality of the Initial Basin in Overspecified Neural Networks","created":"2015-11-13","cited_by_count":20},{"id":"1907.03207","title":"Towards Robust, Locally Linear Deep Networks","created":"2019-07-07","cited_by_count":20},{"id":"1808.09540","title":"Lipschitz regularized Deep Neural Networks generalize and are adversarially robust","created":"2018-08-28","cited_by_count":19},{"id":"2010.12711","title":"On Convergence and Generalization of Dropout Training","created":"2020-10-23","cited_by_count":19},{"id":"2006.09717","title":"Neural Anisotropy Directions","created":"2020-06-17","cited_by_count":17},{"id":"1402.3811","title":"Dropout Rademacher Complexity of Deep Neural Networks","created":"2014-02-16","cited_by_count":14},{"id":"1801.02254","title":"Theory of Deep Learning IIb: Optimization Properties of SGD","created":"2018-01-07","cited_by_count":12},{"id":"1904.05263","title":"Analysis of the Gradient Descent Algorithm for a Deep Neural Network Model with Skip-connections","created":"2019-04-10","cited_by_count":7},{"id":"1809.01129","title":"Lipschitz Networks and Distributional Robustness","created":"2018-09-04","cited_by_count":6}],"next_cursor":null}