{"list":"other","total":53,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1608.06993","title":"Densely Connected Convolutional Networks","created":"2016-08-25","cited_by_count":6720},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1609.04747","title":"An overview of gradient descent optimization algorithms","created":"2016-09-15","cited_by_count":1033},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1810.02054","title":"Gradient Descent Provably Optimizes Over-parameterized Neural Networks","created":"2018-10-04","cited_by_count":659},{"id":"1406.2572","title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","created":"2014-06-10","cited_by_count":289},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"2106.04426","title":"Hash Layers For Large Sparse Models","created":"2021-06-08","cited_by_count":237},{"id":"2003.02218","title":"The large learning rate phase of deep learning: the catapult mechanism","created":"2020-03-04","cited_by_count":216},{"id":"1907.04595","title":"Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks","created":"2019-07-10","cited_by_count":162},{"id":"2209.15594","title":"Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability","created":"2022-09-30","cited_by_count":155},{"id":"1511.06251","title":"Stochastic modified equations and adaptive stochastic gradient algorithms","created":"2015-11-19","cited_by_count":142},{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128},{"id":"1712.07628","title":"Improving Generalization Performance by Switching from Adam to SGD","created":"2017-12-20","cited_by_count":125},{"id":"1904.09080","title":"Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process","created":"2019-04-19","cited_by_count":123},{"id":"2002.10365","title":"The Early Phase of Neural Network Training","created":"2020-02-24","cited_by_count":115},{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107},{"id":"1902.05040","title":"How do infinite width bounded norm networks look in function space?","created":"2019-02-13","cited_by_count":106},{"id":"2204.08396","title":"StableMoE: Stable Routing Strategy for Mixture of Experts","created":"2022-04-18","cited_by_count":100},{"id":"2006.11144","title":"On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex Problems","created":"2020-06-19","cited_by_count":80},{"id":"1802.08770","title":"A Walk with SGD","created":"2018-02-24","cited_by_count":78},{"id":"2407.11633","title":"Scaling Diffusion Transformers to 16 Billion Parameters","created":"2024-07-16","cited_by_count":66},{"id":"2207.02628","title":"The alignment property of SGD noise and how it helps select flat minima: A stability analysis","created":"2022-07-06","cited_by_count":64},{"id":"1906.07842","title":"Gradient Dynamics of Shallow Univariate ReLU Networks","created":"2019-06-18","cited_by_count":46},{"id":"2005.13530","title":"On the Convergence of Gradient Descent Training for Two-layer ReLU-networks in the Mean Field Regime","created":"2020-05-27","cited_by_count":39},{"id":"2302.08982","title":"(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability","created":"2023-02-17","cited_by_count":36},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31},{"id":"2002.10376","title":"The Two Regimes of Deep Network Training","created":"2020-02-24","cited_by_count":30},{"id":"2412.20553","title":"Edge of Stochastic Stability: Revisiting the Edge of Stability for SGD","created":"2024-12-29","cited_by_count":30},{"id":"2503.05139","title":"Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs","created":"2025-03-07","cited_by_count":22},{"id":"2408.06793","title":"Layerwise Recurrent Router for Mixture-of-Experts","created":"2024-08-13","cited_by_count":21},{"id":"2401.10791","title":"Early alignment in two-layer networks training is a two-edged sword","created":"2024-01-19","cited_by_count":18},{"id":"2404.19261","title":"High dimensional analysis reveals conservative sharpening and a stochastic edge of stability","created":"2024-04-30","cited_by_count":18},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17},{"id":"2406.09241","title":"What is the long-run distribution of stochastic gradient descent? A large deviations analysis","created":"2024-06-13","cited_by_count":17},{"id":"2505.24022","title":"The Rich and the Simple: On the Implicit Bias of Adam and SGD","created":"2025-05-29","cited_by_count":13},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11},{"id":"2301.07737","title":"Catapult Dynamics and Phase Transitions in Quadratic Nets","created":"2023-01-18","cited_by_count":8},{"id":"2310.17074","title":"Benign Oscillation of Stochastic Gradient Descent with Large Learning Rates","created":"2023-10-26","cited_by_count":8},{"id":"2407.20209","title":"Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning","created":"2024-07-29","cited_by_count":8},{"id":"2503.16398","title":"The global convergence time of stochastic gradient descent in non-convex landscapes: Sharp estimates via large deviations","created":"2025-03-20","cited_by_count":8},{"id":"2404.12293","title":"Singular-limit analysis of gradient descent with noise injection","created":"2024-04-18","cited_by_count":7},{"id":"2509.25351","title":"Gradient Descent with Large Step Sizes: Chaos and Fractal Convergence Region","created":"2025-09-29","cited_by_count":7},{"id":"2502.16977","title":"Convergence of Shallow ReLU Networks on Weakly Interacting Data","created":"2025-02-24","cited_by_count":2},{"id":"2503.06491","title":"MoFE: Mixture of Frozen Experts Architecture","created":"2025-03-09","cited_by_count":1}],"next_cursor":null}