{"list":"other","total":72,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1608.00859","title":"Temporal Segment Networks: Towards Good Practices for Deep Action Recognition","created":"2016-08-02","cited_by_count":902},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2011.04006","title":"Long Range Arena: A Benchmark for Efficient Transformers","created":"2020-11-08","cited_by_count":700},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"1906.05890","title":"Gradient Descent Maximizes the Margin of Homogeneous Neural Networks","created":"2019-06-13","cited_by_count":320},{"id":"2002.09277","title":"Kernel and Rich Regimes in Overparametrized Models","created":"2020-02-20","cited_by_count":306},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"2002.04486","title":"Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss","created":"2020-02-11","cited_by_count":268},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2006.06657","title":"Directional convergence and alignment in deep learning","created":"2020-06-11","cited_by_count":178},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"2012.09839","title":"Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning","created":"2020-12-17","cited_by_count":150},{"id":"1904.13262","title":"Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks","created":"2019-04-30","cited_by_count":124},{"id":"1904.09080","title":"Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process","created":"2019-04-19","cited_by_count":123},{"id":"2005.06398","title":"Implicit Regularization in Deep Learning May Not Be Explainable by Norms","created":"2020-05-13","cited_by_count":119},{"id":"2008.02457","title":"Graph Convolutional Networks for Hyperspectral Image Classification","created":"2020-08-06","cited_by_count":113},{"id":"1803.01905","title":"Convergence of Gradient Descent on Separable Data","created":"2018-03-05","cited_by_count":110},{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107},{"id":"1805.08315","title":"Learning long-range spatial dependencies with horizontal gated-recurrent units","created":"2018-05-21","cited_by_count":98},{"id":"1509.05009","title":"On the Expressive Power of Deep Learning: A Tensor Analysis","created":"2015-09-16","cited_by_count":97},{"id":"1709.01953","title":"Implicit Regularization in Deep Learning","created":"2017-09-06","cited_by_count":90},{"id":"1812.10004","title":"Overparameterized Nonlinear Learning: Gradient Descent Takes the Shortest Path?","created":"2018-12-25","cited_by_count":88},{"id":"2006.08680","title":"Shape Matters: Understanding the Implicit Bias of the Noise Covariance","created":"2020-06-15","cited_by_count":88},{"id":"1809.10374","title":"An analytic theory of generalization dynamics and transfer learning in deep linear networks","created":"2018-09-27","cited_by_count":85},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83},{"id":"2010.02501","title":"A Unifying View on Implicit Bias in Training Linear Neural Networks","created":"2020-10-06","cited_by_count":75},{"id":"2007.06738","title":"Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy","created":"2020-07-13","cited_by_count":71},{"id":"2102.09769","title":"On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent","created":"2021-02-19","cited_by_count":70},{"id":"1909.12051","title":"The Implicit Bias of Depth: How Incremental Learning Drives Generalization","created":"2019-09-26","cited_by_count":64},{"id":"1910.05505","title":"Learning deep linear neural networks: Riemannian gradient flows and convergence to global minimizers","created":"2019-10-12","cited_by_count":61},{"id":"2006.14599","title":"The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks","created":"2020-06-25","cited_by_count":58},{"id":"1605.06743","title":"Inductive Bias of Deep Convolutional Networks through Pooling Geometry","created":"2016-05-22","cited_by_count":53},{"id":"1905.07325","title":"Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models","created":"2019-05-17","cited_by_count":53},{"id":"1801.00315","title":"Learning Relevant Features of Data with Multi-scale Tensor Networks","created":"2017-12-31","cited_by_count":51},{"id":"1803.09780","title":"Quantum Entanglement in Deep Learning Architectures","created":"2018-03-26","cited_by_count":50},{"id":"2012.05156","title":"Implicit Regularization in ReLU Networks with the Square Loss","created":"2020-12-09","cited_by_count":45},{"id":"1802.06093","title":"Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks","created":"2018-02-16","cited_by_count":44},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44},{"id":"2006.12467","title":"The Depth-to-Width Interplay in Self-Attention","created":"2020-06-22","cited_by_count":42},{"id":"2011.13772","title":"Gradient Descent for Deep Matrix Factorization: Dynamics and Implicit Bias towards Low Rank","created":"2020-11-27","cited_by_count":42},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34},{"id":"2110.02732","title":"On Margin Maximization in Linear and ReLU Networks","created":"2021-10-06","cited_by_count":34},{"id":"2110.04541","title":"The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design","created":"2021-10-09","cited_by_count":33},{"id":"1603.00162","title":"Convolutional Rectifier Networks as Generalized Tensor Decompositions","created":"2016-03-01","cited_by_count":32},{"id":"2004.13747","title":"Quantum-inspired Machine Learning on high-energy physics data","created":"2020-04-28","cited_by_count":31},{"id":"1711.00811","title":"Expressive power of recurrent neural networks","created":"2017-11-02","cited_by_count":30},{"id":"1906.01558","title":"Disentangling neural mechanisms for perceptual grouping","created":"2019-06-04","cited_by_count":28},{"id":"2108.01538","title":"Geometry of Linear Convolutional Networks","created":"2021-08-03","cited_by_count":27},{"id":"1704.01552","title":"Deep Learning and Quantum Entanglement: Fundamental Connections with Implications to Network Design","created":"2017-04-05","cited_by_count":24},{"id":"2112.11027","title":"More is Less: Inducing Sparsity via Overparameterization","created":"2021-12-21","cited_by_count":24},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19},{"id":"2102.12238","title":"Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm","created":"2021-02-24","cited_by_count":18},{"id":"2107.01641","title":"A Theoretical Analysis of Fine-tuning with Linear Teachers","created":"2021-07-04","cited_by_count":17},{"id":"2105.03928","title":"Which transformer architecture fits my data? A vocabulary bottleneck in self-attention","created":"2021-05-09","cited_by_count":16},{"id":"1710.09431","title":"On the Long-Term Memory of Deep Recurrent Networks","created":"2017-10-25","cited_by_count":14},{"id":"1705.02302","title":"Analysis and Design of Convolutional Networks via Hierarchical Tensor Decompositions","created":"2017-05-05","cited_by_count":13},{"id":"1506.03059","title":"Deep SimNets","created":"2015-06-09","cited_by_count":10},{"id":"1901.10801","title":"Generalized Tensor Models for Recurrent Neural Networks","created":"2019-01-30","cited_by_count":8},{"id":"1807.08599","title":"3D Convolutional Neural Networks for Tumor Segmentation using Long-range 2D Context","created":"2018-07-23","cited_by_count":7},{"id":"1410.0781","title":"SimNets: A Generalization of Convolutional Networks","created":"2014-10-03","cited_by_count":5},{"id":"1703.06846","title":"Boosting Dilated Convolutional Networks with Mixed Tensor Decompositions","created":"2017-03-20","cited_by_count":5},{"id":"2105.01346","title":"Implicit Regularization in Deep Tensor Factorization","created":"2021-05-04","cited_by_count":5},{"id":"1906.05746","title":"Nonlinear System Identification via Tensor Completion","created":"2019-06-13","cited_by_count":4},{"id":"2002.04710","title":"Unique Properties of Flat Minima in Deep Networks","created":"2020-02-11","cited_by_count":3},{"id":"2008.12091","title":"Limitations of Implicit Bias in Matrix Sensing: Initialization Rank Matters","created":"2020-08-27","cited_by_count":1}],"next_cursor":null}