{"list":"other","total":54,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1502.01852","title":"Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification","created":"2015-02-06","cited_by_count":3611},{"id":"1904.09237","title":"On the Convergence of Adam and Beyond","created":"2019-04-19","cited_by_count":841},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1802.04434","title":"signSGD: Compressed Optimisation for Non-Convex Problems","created":"2018-02-13","cited_by_count":571},{"id":"2502.16982","title":"Muon is Scalable for LLM Training","created":"2025-02-24","cited_by_count":428},{"id":"1906.05890","title":"Gradient Descent Maximizes the Margin of Homogeneous Neural Networks","created":"2019-06-13","cited_by_count":320},{"id":"2002.04486","title":"Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss","created":"2020-02-11","cited_by_count":268},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1806.00468","title":"Implicit Bias of Gradient Descent on Linear Convolutional Networks","created":"2018-06-01","cited_by_count":251},{"id":"1705.08292","title":"The Marginal Value of Adaptive Gradient Methods in Machine Learning","created":"2017-05-23","cited_by_count":250},{"id":"2409.20325","title":"Old Optimizer, New Norm: An Anthology","created":"2024-09-30","cited_by_count":193},{"id":"2502.07529","title":"Training Deep Learning Models with Norm-Constrained LMOs","created":"2025-02-11","cited_by_count":192},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"2006.06657","title":"Directional convergence and alignment in deep learning","created":"2020-06-11","cited_by_count":178},{"id":"2003.02395","title":"A Simple Convergence Proof of Adam and Adagrad","created":"2020-03-05","cited_by_count":171},{"id":"2206.07758","title":"Reconstructing Training Data from Trained Neural Networks","created":"2022-06-15","cited_by_count":133},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1811.09358","title":"A Sufficient Condition for Convergences of Adam and RMSProp","created":"2018-11-23","cited_by_count":126},{"id":"2010.05627","title":"Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning","created":"2020-10-12","cited_by_count":126},{"id":"1804.07795","title":"Stochastic subgradient method converges on tame functions","created":"2018-04-20","cited_by_count":124},{"id":"1506.02617","title":"Path-SGD: Path-Normalized Optimization in Deep Neural Networks","created":"2015-06-08","cited_by_count":120},{"id":"2208.09632","title":"Adam Can Converge Without Any Modification On Update Rules","created":"2022-08-20","cited_by_count":114},{"id":"1803.01905","title":"Convergence of Gradient Descent on Separable Data","created":"2018-03-05","cited_by_count":110},{"id":"1803.01206","title":"On the Power of Over-parametrization in Neural Networks with Quadratic Activation","created":"2018-03-03","cited_by_count":102},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86},{"id":"2010.02501","title":"A Unifying View on Implicit Bias in Training Linear Neural Networks","created":"2020-10-06","cited_by_count":75},{"id":"2007.06738","title":"Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy","created":"2020-07-13","cited_by_count":71},{"id":"2404.04454","title":"Implicit Bias of AdamW: $\\ell_\\infty$ Norm Constrained Optimization","created":"2024-04-05","cited_by_count":58},{"id":"1905.07325","title":"Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models","created":"2019-05-17","cited_by_count":53},{"id":"2006.15459","title":"Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions","created":"2020-06-27","cited_by_count":50},{"id":"1810.02263","title":"Convergence and Dynamical Behavior of the ADAM Algorithm for Non-Convex Stochastic Optimization","created":"2018-10-04","cited_by_count":49},{"id":"2012.06244","title":"The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks","created":"2020-12-11","cited_by_count":46},{"id":"2502.04664","title":"Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data","created":"2025-02-07","cited_by_count":41},{"id":"2505.21829","title":"In Search of Adam's Secret Sauce","created":"2025-05-27","cited_by_count":40},{"id":"2406.10650","title":"The Implicit Bias of Adam on Separable Data","created":"2024-06-15","cited_by_count":36},{"id":"2407.12332","title":"Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition","created":"2024-07-17","cited_by_count":36},{"id":"2202.04347","title":"Gradient Methods Provably Converge to Non-Robust Networks","created":"2022-02-09","cited_by_count":27},{"id":"2307.01827","title":"Deconstructing Data Reconstruction: Multiclass, Weight Decay and General Losses","created":"2023-07-04","cited_by_count":26},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25},{"id":"2508.03688","title":"Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws","created":"2025-08-05","cited_by_count":25},{"id":"2303.01456","title":"The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks","created":"2023-03-02","cited_by_count":23},{"id":"2311.03794","title":"On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions","created":"2023-11-07","cited_by_count":21},{"id":"2410.22069","title":"Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks","created":"2024-10-29","cited_by_count":18},{"id":"1912.01599","title":"Stationary Points of Shallow Neural Networks with Quadratic Activation Function","created":"2019-12-03","cited_by_count":12},{"id":"2407.15845","title":"Reconstructing Training Data From Real World Models Trained with Transfer Learning","created":"2024-07-22","cited_by_count":12},{"id":"2210.02070","title":"Non-Convergence and Limit Cycles in the Adam optimizer","created":"2022-10-05","cited_by_count":9},{"id":"2502.16075","title":"Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks","created":"2025-02-22","cited_by_count":9},{"id":"2601.10483","title":"High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks","created":"2026-01-15","cited_by_count":7},{"id":"2405.15942","title":"Can Implicit Bias Imply Adversarial Robustness?","created":"2024-05-24","cited_by_count":5},{"id":"2510.10625","title":"ImpMIA: Leveraging Implicit Bias for Membership Inference Attack","created":"2025-10-12","cited_by_count":2},{"id":"2510.26303","title":"Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime","created":"2025-10-30","cited_by_count":2}],"next_cursor":null}