{"list":"other","total":51,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1502.01852","title":"Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification","created":"2015-02-06","cited_by_count":3611},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1311.2901","title":"Visualizing and Understanding Convolutional Networks","created":"2013-11-12","cited_by_count":2290},{"id":"1706.02677","title":"Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour","created":"2017-06-08","cited_by_count":1492},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"1606.05340","title":"Exponential expressivity in deep neural networks through transient chaos","created":"2016-06-16","cited_by_count":261},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166},{"id":"1511.06251","title":"Stochastic modified equations and adaptive stochastic gradient algorithms","created":"2015-11-19","cited_by_count":142},{"id":"1602.05897","title":"Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity","created":"2016-02-18","cited_by_count":138},{"id":"1710.06451","title":"A Bayesian Perspective on Generalization and Stochastic Gradient Descent","created":"2017-10-17","cited_by_count":135},{"id":"2106.06530","title":"Label Noise SGD Provably Prefers Flat Global Minimizers","created":"2021-06-11","cited_by_count":121},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105},{"id":"2105.10446","title":"ReduNet: A White-box Deep Network from the Principle of Maximizing Rate Reduction","created":"2021-05-21","cited_by_count":84},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70},{"id":"2007.07497","title":"Phase diagram for two-layer ReLU neural networks at infinite-width limit","created":"2020-07-15","cited_by_count":67},{"id":"2006.10455","title":"What Do Neural Networks Learn When Trained With Random Labels?","created":"2020-06-18","cited_by_count":59},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52},{"id":"1406.2080","title":"Training Convolutional Networks with Noisy Labels","created":"2014-06-09","cited_by_count":48},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38},{"id":"2210.17020","title":"A Law of Data Separation in Deep Learning","created":"2022-10-31","cited_by_count":36},{"id":"2311.02960","title":"Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination","created":"2023-11-06","cited_by_count":32},{"id":"2006.05900","title":"The Hidden Convex Optimization Landscape of Two-Layer ReLU Neural Networks: an Exact Characterization of the Optimal Solutions","created":"2020-06-10","cited_by_count":30},{"id":"2012.10424","title":"Separation and Concentration in Deep Networks","created":"2020-12-18","cited_by_count":30},{"id":"2107.01163","title":"Unveiling the structure of wide flat minima in neural networks","created":"2021-07-02","cited_by_count":28},{"id":"1710.09553","title":"Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior","created":"2017-10-26","cited_by_count":25},{"id":"2206.01246","title":"Stochastic gradient descent introduces an effective landscape-dependent regularization favoring flat solutions","created":"2022-06-02","cited_by_count":22},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20},{"id":"2307.01951","title":"A Neural Collapse Perspective on Feature Evolution in Graph Neural Networks","created":"2023-07-04","cited_by_count":19},{"id":"2110.11749","title":"Feature Learning and Signal Propagation in Deep Neural Networks","created":"2021-10-22","cited_by_count":18},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18},{"id":"2401.10791","title":"Early alignment in two-layer networks training is a two-edged sword","created":"2024-01-19","cited_by_count":18},{"id":"2212.13069","title":"Homophily modulates double descent generalization in graph convolution networks","created":"2022-12-26","cited_by_count":13},{"id":"2402.06184","title":"The boundary of neural network trainability is fractal","created":"2024-02-09","cited_by_count":13},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12},{"id":"2305.15850","title":"Stochastic Modified Equations and Dynamics of Dropout Algorithm","created":"2023-05-25","cited_by_count":11},{"id":"2302.14112","title":"Injectivity of ReLU networks: perspectives from statistical physics","created":"2023-02-27","cited_by_count":10},{"id":"1808.00408","title":"Geometry of energy landscapes and the optimizability of deep neural networks","created":"2018-08-01","cited_by_count":9},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9},{"id":"2303.05161","title":"Inversion dynamics of class manifolds in deep learning reveals tradeoffs underlying generalisation","created":"2023-03-09","cited_by_count":6}],"next_cursor":null}