{"list":"other","total":71,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1607.06450","title":"Layer Normalization","created":"2016-07-21","cited_by_count":5669},{"id":"1904.09751","title":"The Curious Case of Neural Text Degeneration","created":"2019-04-22","cited_by_count":2916},{"id":"2006.09661","title":"Implicit Neural Representations with Periodic Activation Functions","created":"2020-06-17","cited_by_count":2238},{"id":"2006.10739","title":"Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains","created":"2020-06-18","cited_by_count":2200},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"1711.10925","title":"Deep Image Prior","created":"2017-11-29","cited_by_count":1098},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"2111.11426","title":"Neural Fields in Visual Computing and Beyond","created":"2021-11-22","cited_by_count":540},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1402.1869","title":"On the Number of Linear Regions of Deep Neural Networks","created":"2014-02-08","cited_by_count":381},{"id":"1901.06523","title":"Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks","created":"2019-01-19","cited_by_count":368},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1804.11271","title":"Gaussian Process Behaviour in Wide Deep Neural Networks","created":"2018-04-30","cited_by_count":317},{"id":"1606.05336","title":"On the Expressive Power of Deep Neural Networks","created":"2016-06-16","cited_by_count":306},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"1606.05340","title":"Exponential expressivity in deep neural networks through transient chaos","created":"2016-06-16","cited_by_count":261},{"id":"2301.05187","title":"WIRE: Wavelet Implicit Neural Representations","created":"2023-01-05","cited_by_count":220},{"id":"1911.07013","title":"Understanding and Improving Layer Normalization","created":"2019-11-16","cited_by_count":217},{"id":"2207.02098","title":"Neural Networks and the Chomsky Hierarchy","created":"2022-07-05","cited_by_count":217},{"id":"2310.16028","title":"What Algorithms can Transformers Learn? A Study in Length Generalization","created":"2023-10-24","cited_by_count":199},{"id":"1611.01232","title":"Deep Information Propagation","created":"2016-11-04","cited_by_count":195},{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184},{"id":"1805.08522","title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","created":"2018-05-22","cited_by_count":183},{"id":"1807.01251","title":"Training behavior of deep neural network in frequency domain","created":"2018-07-03","cited_by_count":174},{"id":"1702.08591","title":"The Shattered Gradients Problem: If resnets are the answer, then what is the question?","created":"2017-02-28","cited_by_count":157},{"id":"2109.14545","title":"Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark","created":"2021-09-29","cited_by_count":155},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"1808.05587","title":"Deep Convolutional Networks as shallow Gaussian Processes","created":"2018-08-16","cited_by_count":138},{"id":"2111.15135","title":"Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs","created":"2021-11-30","cited_by_count":135},{"id":"2006.12433","title":"What shapes feature representations? Exploring datasets, architectures, and training","created":"2020-06-22","cited_by_count":126},{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86},{"id":"2012.14660","title":"A Theoretical Analysis of the Repetition Problem in Text Generation","created":"2020-12-29","cited_by_count":83},{"id":"2105.05612","title":"Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization","created":"2021-05-12","cited_by_count":83},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83},{"id":"1703.07950","title":"Failures of Gradient-Based Deep Learning","created":"2017-03-23","cited_by_count":80},{"id":"1802.09979","title":"The Emergence of Spectral Universality in Deep Networks","created":"2018-02-27","cited_by_count":74},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73},{"id":"2211.12316","title":"Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions","created":"2022-11-22","cited_by_count":70},{"id":"2302.14040","title":"Permutation Equivariant Neural Functionals","created":"2023-02-27","cited_by_count":70},{"id":"1907.10599","title":"A Fine-Grained Spectral Perspective on Neural Networks","created":"2019-07-24","cited_by_count":68},{"id":"2310.16228","title":"On the Foundations of Shortcut Learning","created":"2023-10-24","cited_by_count":65},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63},{"id":"2304.05366","title":"The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning","created":"2023-04-11","cited_by_count":63},{"id":"2110.03095","title":"Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective","created":"2021-10-06","cited_by_count":57},{"id":"1605.06743","title":"Inductive Bias of Deep Convolutional Networks through Pooling Geometry","created":"2016-05-22","cited_by_count":53},{"id":"2210.07082","title":"Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data","created":"2022-10-13","cited_by_count":46},{"id":"1504.08291","title":"Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?","created":"2015-04-30","cited_by_count":41},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39},{"id":"2306.13575","title":"Scaling MLPs: A Tale of Inductive Bias","created":"2023-06-23","cited_by_count":37},{"id":"2104.10343","title":"Sensitivity as a Complexity Measure for Sequence Classification Tasks","created":"2021-04-21","cited_by_count":28},{"id":"2208.04924","title":"On the Activation Function Dependence of the Spectral Bias of Neural Networks","created":"2022-08-09","cited_by_count":28},{"id":"2207.02598","title":"Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning","created":"2022-07-06","cited_by_count":26},{"id":"1909.11522","title":"Neural networks are a priori biased towards Boolean functions with low entropy","created":"2019-09-25","cited_by_count":24},{"id":"2202.13473","title":"The Spectral Bias of Polynomial Neural Networks","created":"2022-02-27","cited_by_count":19},{"id":"1809.06848","title":"On the Learning Dynamics of Deep Neural Networks","created":"2018-09-18","cited_by_count":18},{"id":"1910.07476","title":"Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation","created":"2019-10-16","cited_by_count":14},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12},{"id":"2306.17301","title":"Why Shallow Networks Struggle to Approximate and Learn High Frequencies","created":"2023-06-29","cited_by_count":11},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10},{"id":"2305.01034","title":"Model-agnostic Measure of Generalization Difficulty","created":"2023-05-01","cited_by_count":7},{"id":"2310.10899","title":"Instilling Inductive Biases with Subnetworks","created":"2023-10-17","cited_by_count":6},{"id":"2206.08558","title":"How You Start Matters for Generalization","created":"2022-06-17","cited_by_count":5},{"id":"2306.00809","title":"Initial Guessing Bias: How Untrained Networks Favor Some Classes","created":"2023-06-01","cited_by_count":5}],"next_cursor":null}