{"list":"other","total":62,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1311.2901","title":"Visualizing and Understanding Convolutional Networks","created":"2013-11-12","cited_by_count":2290},{"id":"1905.00414","title":"Similarity of Neural Network Representations Revisited","created":"2019-05-01","cited_by_count":1755},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1610.01644","title":"Understanding intermediate layers using linear classifier probes","created":"2016-10-05","cited_by_count":1353},{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167},{"id":"1503.02406","title":"Deep Learning and the Information Bottleneck Principle","created":"2015-03-09","cited_by_count":802},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"2405.07987","title":"The Platonic Representation Hypothesis","created":"2024-05-13","cited_by_count":382},{"id":"1812.09902","title":"Invariant and Equivariant Graph Networks","created":"2018-12-24","cited_by_count":346},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1703.02930","title":"Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks","created":"2017-03-08","cited_by_count":311},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"2106.07682","title":"Revisiting Model Stitching to Compare Neural Representations","created":"2021-06-14","cited_by_count":209},{"id":"1905.11604","title":"SGD on Neural Networks Learns Functions of Increasing Complexity","created":"2019-05-28","cited_by_count":204},{"id":"2011.14522","title":"Feature Learning in Infinite-Width Neural Networks","created":"2020-11-30","cited_by_count":190},{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143},{"id":"1805.12076","title":"Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networks","created":"2018-05-30","cited_by_count":142},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107},{"id":"1803.06084","title":"A Kernel Theory of Modern Data Augmentation","created":"2018-03-16","cited_by_count":106},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106},{"id":"2112.15121","title":"On the Role of Neural Collapse in Transfer Learning","created":"2021-12-30","cited_by_count":100},{"id":"2009.02439","title":"Optimizing Mode Connectivity via Neuron Alignment","created":"2020-09-05","cited_by_count":86},{"id":"2106.15933","title":"Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity","created":"2021-06-30","cited_by_count":85},{"id":"1909.12051","title":"The Implicit Bias of Depth: How Incremental Learning Drives Generalization","created":"2019-09-26","cited_by_count":64},{"id":"2205.14258","title":"On the Symmetries of Deep Learning Models and their Internal Representations","created":"2022-05-27","cited_by_count":64},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63},{"id":"2010.02916","title":"Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate","created":"2020-10-06","cited_by_count":59},{"id":"1901.07417","title":"On Connected Sublevel Sets in Deep Learning","created":"2019-01-22","cited_by_count":51},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50},{"id":"1802.02840","title":"Neural Network Renormalization Group","created":"2018-02-08","cited_by_count":48},{"id":"2307.00144","title":"Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows","created":"2023-06-30","cited_by_count":45},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39},{"id":"2405.17767","title":"Linguistic Collapse: Neural Collapse in (Large) Language Models","created":"2024-05-28","cited_by_count":38},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36},{"id":"2305.19753","title":"The Tunnel Effect: Building Data Representations in Deep Neural Networks","created":"2023-05-31","cited_by_count":34},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28},{"id":"2410.23819","title":"Weight decay induces low-rank attention layers","created":"2024-10-31","cited_by_count":27},{"id":"2205.10637","title":"Symmetry Teleportation for Accelerated Optimization","created":"2022-05-21","cited_by_count":25},{"id":"2309.16932","title":"Symmetry Induces Structure and Constraint of Learning","created":"2023-09-29","cited_by_count":25},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23},{"id":"2405.20231","title":"The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof","created":"2024-05-30","cited_by_count":21},{"id":"2409.04180","title":"The Prevalence of Neural Collapse in Neural Multivariate Regression","created":"2024-09-06","cited_by_count":21},{"id":"1902.02366","title":"Negative eigenvalues of the Hessian in deep neural networks","created":"2019-02-06","cited_by_count":20},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19},{"id":"1803.00094","title":"Neural Networks Should Be Wide Enough to Learn Disconnected Decision Regions","created":"2018-02-28","cited_by_count":17},{"id":"2410.03006","title":"Formation of Representations in Neural Networks","created":"2024-10-03","cited_by_count":10},{"id":"2301.12033","title":"Norm-based Generalization Bounds for Compositionally Sparse Neural Networks","created":"2023-01-28","cited_by_count":7},{"id":"2411.13733","title":"On Generalization Bounds for Neural Networks with Low Rank Layers","created":"2024-11-20","cited_by_count":4},{"id":"1612.09296","title":"Symmetry, Saddle Points, and Global Optimization Landscape of Nonconvex Matrix Factorization","created":"2016-12-29","cited_by_count":3},{"id":"1710.06096","title":"Spontaneous Symmetry Breaking in Neural Networks","created":"2017-10-17","cited_by_count":2}],"next_cursor":null}