{"list":"other","total":52,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1502.01852","title":"Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification","created":"2015-02-06","cited_by_count":3611},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1904.09237","title":"On the Convergence of Adam and Beyond","created":"2019-04-19","cited_by_count":841},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1610.01145","title":"Error bounds for approximations with deep ReLU networks","created":"2016-10-03","cited_by_count":574},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1709.02540","title":"The Expressive Power of Neural Networks: A View from the Width","created":"2017-09-08","cited_by_count":320},{"id":"1707.09564","title":"A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks","created":"2017-07-29","cited_by_count":314},{"id":"1703.02930","title":"Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks","created":"2017-03-08","cited_by_count":311},{"id":"1503.00036","title":"Norm-Based Capacity Control in Neural Networks","created":"2015-02-27","cited_by_count":299},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"1712.06541","title":"Size-Independent Sample Complexity of Neural Networks","created":"2017-12-18","cited_by_count":290},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1802.08760","title":"Sensitivity and Generalization in Neural Networks: an Empirical Study","created":"2018-02-23","cited_by_count":189},{"id":"1709.05289","title":"Optimal approximation of piecewise smooth functions using deep ReLU neural networks","created":"2017-09-15","cited_by_count":179},{"id":"1802.03620","title":"Optimal approximation of continuous functions by very deep ReLU networks","created":"2018-02-10","cited_by_count":166},{"id":"2001.03040","title":"Deep Network Approximation for Smooth Functions","created":"2020-01-09","cited_by_count":164},{"id":"1906.00904","title":"Deep ReLU Networks Have Surprisingly Few Activation Patterns","created":"2019-06-03","cited_by_count":161},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127},{"id":"1506.02617","title":"Path-SGD: Path-Normalized Optimization in Deep Neural Networks","created":"2015-06-08","cited_by_count":120},{"id":"2211.08403","title":"REPAIR: REnormalizing Permuted Activations for Interpolation Repair","created":"2022-11-15","cited_by_count":120},{"id":"2005.06398","title":"Implicit Regularization in Deep Learning May Not Be Explainable by Norms","created":"2020-05-13","cited_by_count":119},{"id":"1910.01635","title":"A Function Space View of Bounded Norm Infinite Width ReLU Nets: The Multivariate Case","created":"2019-10-03","cited_by_count":114},{"id":"2301.12780","title":"Equivariant Architectures for Learning in Deep Weight Spaces","created":"2023-01-30","cited_by_count":107},{"id":"1709.01953","title":"Implicit Regularization in Deep Learning","created":"2017-09-06","cited_by_count":90},{"id":"1910.00744","title":"Reverse-Engineering Deep ReLU Networks","created":"2019-10-02","cited_by_count":83},{"id":"1907.02911","title":"Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape","created":"2019-07-05","cited_by_count":63},{"id":"2105.14835","title":"Towards Lower Bounds on the Depth of ReLU Neural Networks","created":"2021-05-31","cited_by_count":56},{"id":"1709.09603","title":"Riemannian approach to batch normalization","created":"2017-09-27","cited_by_count":35},{"id":"1802.03713","title":"$\\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space","created":"2018-02-11","cited_by_count":27},{"id":"1806.05159","title":"On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond","created":"2018-06-13","cited_by_count":24},{"id":"2112.12982","title":"Parameter identifiability of a deep feedforward ReLU neural network","created":"2021-12-24","cited_by_count":24},{"id":"2007.14285","title":"Theory of Deep Convolutional Neural Networks II: Spherical Analysis","created":"2020-07-28","cited_by_count":22},{"id":"2107.00896","title":"Theory of Deep Convolutional Neural Networks III: Approximating Radial Functions","created":"2021-07-02","cited_by_count":22},{"id":"1910.01487","title":"Generalization Bounds for Convolutional Neural Networks","created":"2019-10-03","cited_by_count":21},{"id":"2209.04036","title":"Functional dimension of feedforward ReLU neural networks","created":"2022-09-08","cited_by_count":21},{"id":"2107.09370","title":"An Embedding of ReLU Networks and an Analysis of their Identifiability","created":"2021-07-20","cited_by_count":20},{"id":"1511.01029","title":"Understanding symmetries in deep networks","created":"2015-11-03","cited_by_count":17},{"id":"1902.10416","title":"Equi-normalization of Neural Networks","created":"2019-02-27","cited_by_count":16},{"id":"1511.01754","title":"Symmetry-invariant optimization in deep networks","created":"2015-11-05","cited_by_count":15},{"id":"1905.09803","title":"How degenerate is the parametrization of neural networks with the ReLU activation function?","created":"2019-05-23","cited_by_count":15},{"id":"2108.05643","title":"On minimal representations of shallow ReLU networks","created":"2021-08-12","cited_by_count":13},{"id":"2204.06062","title":"Local and global topological complexity measures OF ReLU neural network functions","created":"2022-04-12","cited_by_count":8}],"next_cursor":null}