{"list":"other","total":55,"rows":[{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"2003.02218","title":"The large learning rate phase of deep learning: the catapult mechanism","created":"2020-03-04","cited_by_count":216},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"2209.15594","title":"Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability","created":"2022-09-30","cited_by_count":155},{"id":"2002.09572","title":"The Break-Even Point on Optimization Trajectories of Deep Neural Networks","created":"2020-02-21","cited_by_count":150},{"id":"2012.09839","title":"Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning","created":"2020-12-17","cited_by_count":150},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"1704.00708","title":"No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis","created":"2017-04-03","cited_by_count":129},{"id":"1611.04231","title":"Identity Matters in Deep Learning","created":"2016-11-14","cited_by_count":109},{"id":"1507.03566","title":"Low-rank Solutions of Linear Matrix Equations via Procrustes Flow","created":"2015-07-13","cited_by_count":97},{"id":"2203.01238","title":"On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features","created":"2022-03-02","cited_by_count":97},{"id":"2204.01050","title":"Understanding the unstable convergence of gradient descent","created":"2022-04-03","cited_by_count":86},{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76},{"id":"2010.02501","title":"A Unifying View on Implicit Bias in Training Linear Neural Networks","created":"2020-10-06","cited_by_count":75},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68},{"id":"2210.03294","title":"Understanding Edge-of-Stability Training Dynamics with a Minimalist Example","created":"2022-10-07","cited_by_count":56},{"id":"2212.07469","title":"Learning threshold neurons via the \"edge of stability\"","created":"2022-12-14","cited_by_count":51},{"id":"2110.03677","title":"Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect","created":"2021-10-07","cited_by_count":50},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49},{"id":"2106.14289","title":"Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization","created":"2021-06-27","cited_by_count":45},{"id":"1802.06093","title":"Gradient descent with identity initialization efficiently learns positive definite linear transformations by deep residual networks","created":"2018-02-16","cited_by_count":44},{"id":"2305.17490","title":"The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent","created":"2023-05-27","cited_by_count":44},{"id":"2011.13772","title":"Gradient Descent for Deep Matrix Factorization: Dynamics and Implicit Bias towards Low Rank","created":"2020-11-27","cited_by_count":42},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40},{"id":"2206.04172","title":"Beyond the Edge of Stability via Two-step Gradient Updates","created":"2022-06-08","cited_by_count":38},{"id":"2402.15926","title":"Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency","created":"2024-02-24","cited_by_count":35},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31},{"id":"2002.06189","title":"Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function","created":"2020-02-14","cited_by_count":26},{"id":"2307.04204","title":"Trajectory Alignment: Understanding the Edge of Stability Phenomenon via Bifurcation Theory","created":"2023-07-09","cited_by_count":26},{"id":"2310.17087","title":"Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult","created":"2023-10-26","cited_by_count":25},{"id":"2311.02076","title":"Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos","created":"2023-11-03","cited_by_count":22},{"id":"2305.13064","title":"Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond","created":"2023-05-22","cited_by_count":21},{"id":"1805.08890","title":"Step Size Matters in Deep Learning","created":"2018-05-22","cited_by_count":19},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17},{"id":"2310.01687","title":"From Stability to Chaos: Analyzing Gradient Descent Dynamics in Quadratic Regression","created":"2023-10-02","cited_by_count":17},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17},{"id":"2406.08654","title":"Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization","created":"2024-06-12","cited_by_count":17},{"id":"1911.00645","title":"Global Convergence of Gradient Descent for Deep Linear Residual Networks","created":"2019-11-02","cited_by_count":16},{"id":"2306.17499","title":"The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks","created":"2023-06-30","cited_by_count":15},{"id":"2406.05033","title":"Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes","created":"2024-06-07","cited_by_count":14},{"id":"2402.06184","title":"The boundary of neural network trainability is fractal","created":"2024-02-09","cited_by_count":13},{"id":"2406.06838","title":"Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes","created":"2024-06-10","cited_by_count":12},{"id":"2411.09004","title":"The geometry of the deep linear network","created":"2024-11-13","cited_by_count":11},{"id":"2301.07737","title":"Catapult Dynamics and Phase Transitions in Quadratic Nets","created":"2023-01-18","cited_by_count":8},{"id":"2404.05782","title":"Dynamical stability and chaos in artificial neural network trajectories along training","created":"2024-04-08","cited_by_count":6},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6},{"id":"2402.13108","title":"On the Convergence of Gradient Descent for Large Learning Rates","created":"2024-02-20","cited_by_count":3},{"id":"2506.08523","title":"Leveraging chaotic transients in the training of artificial neural networks","created":"2025-06-10","cited_by_count":3},{"id":"2305.19206","title":"Gradient descent in matrix factorization: Understanding large initialization","created":"2023-05-30","cited_by_count":2},{"id":"2506.20344","title":"A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization","created":"2025-06-25","cited_by_count":2}],"next_cursor":null}