{"total":50,"rows":[{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2210.03294","title":"Understanding Edge-of-Stability Training Dynamics with a Minimalist Example","created":"2022-10-07","cited_by_count":56,"area":null},{"id":"2212.07469","title":"Learning threshold neurons via the \"edge of stability\"","created":"2022-12-14","cited_by_count":51,"area":null},{"id":"2204.11326","title":"Beyond the Quadratic Approximation: the Multiscale Structure of Neural Network Loss Landscapes","created":"2022-04-24","cited_by_count":43,"area":null},{"id":"2305.11788","title":"Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability","created":"2023-05-19","cited_by_count":42,"area":null},{"id":"2302.08982","title":"(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability","created":"2023-02-17","cited_by_count":36,"area":null},{"id":"2506.13018","title":"Symmetry in Neural Network Parameter Spaces","created":"2025-06-16","cited_by_count":36,"area":null},{"id":"2402.15926","title":"Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency","created":"2024-02-24","cited_by_count":35,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2206.03093","title":"Beyond spectral gap: The role of the topology in decentralized learning","created":"2022-06-07","cited_by_count":27,"area":null},{"id":"2310.17087","title":"Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult","created":"2023-10-26","cited_by_count":25,"area":null},{"id":"2112.11027","title":"More is Less: Inducing Sparsity via Overparameterization","created":"2021-12-21","cited_by_count":24,"area":null},{"id":"2311.02076","title":"Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos","created":"2023-11-03","cited_by_count":22,"area":null},{"id":"2305.13064","title":"Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond","created":"2023-05-22","cited_by_count":21,"area":null},{"id":"2310.01687","title":"From Stability to Chaos: Analyzing Gradient Descent Dynamics in Quadratic Regression","created":"2023-10-02","cited_by_count":17,"area":null},{"id":"2406.08654","title":"Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization","created":"2024-06-12","cited_by_count":17,"area":null},{"id":"2305.15659","title":"How to escape sharp minima with random perturbations","created":"2023-05-25","cited_by_count":13,"area":null},{"id":"2305.06927","title":"Convergence of Alternating Gradient Descent for Matrix Factorization","created":"2023-05-11","cited_by_count":12,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2301.07737","title":"Catapult Dynamics and Phase Transitions in Quadratic Nets","created":"2023-01-18","cited_by_count":8,"area":null},{"id":"2308.06671","title":"Noise Balance and Stationary Distribution of Stochastic Gradient Descent","created":"2023-08-13","cited_by_count":7,"area":null},{"id":"2504.04105","title":"Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes","created":"2025-04-05","cited_by_count":7,"area":null},{"id":"2509.25351","title":"Gradient Descent with Large Step Sizes: Chaos and Fractal Convergence Region","created":"2025-09-29","cited_by_count":7,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6,"area":null},{"id":"2503.02809","title":"A Minimalist Example of Edge-of-Stability and Progressive Sharpening","created":"2025-03-04","cited_by_count":4,"area":null},{"id":"2510.17506","title":"Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares","created":"2025-10-20","cited_by_count":4,"area":null},{"id":"2303.17805","title":"On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks","created":"2023-03-31","cited_by_count":3,"area":null},{"id":"2410.09640","title":"Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks","created":"2024-10-12","cited_by_count":3,"area":null},{"id":"2501.09137","title":"Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks","created":"2025-01-15","cited_by_count":2,"area":null},{"id":"2506.12903","title":"Variational Learning Finds Flatter Solutions at the Edge of Stability","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2509.25783","title":"Sharpness of Minima in Deep Matrix Factorization","created":"2025-09-30","cited_by_count":2,"area":null},{"id":"2510.12013","title":"Statistical Guarantees for High-Dimensional Stochastic Gradient Descent","created":"2025-10-13","cited_by_count":2,"area":null},{"id":"2604.26993","title":"State-Dependent Lyapunov Analysis of Rank-1 Matrix Factorization","created":"2026-04-28","cited_by_count":2,"area":null},{"id":"2502.04889","title":"Any-stepsize Gradient Descent for Separable Data under Fenchel-Young Losses","created":"2025-02-07","cited_by_count":1,"area":null},{"id":"2506.24120","title":"Data Uniformity Improves Training Efficiency and More, with a Convergence Framework Beyond the NTK Regime","created":"2025-06-30","cited_by_count":1,"area":null},{"id":"2602.05065","title":"Does SGD Seek Flatness or Sharpness? An Exactly Solvable Model","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2604.02653","title":"Product-Stability: Provable Convergence for Gradient Descent on the Edge of Stability","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.21292","title":"Unbiased Gradients, Moving Stability Boundaries: Exact Mini-Batch Geometry in Linear Self-Attention","created":"2026-05-20","cited_by_count":1,"area":null},{"id":"2606.00340","title":"Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2607.08380","title":"Dynamics of Gradient Descent with Large Step Size Near a Manifold of Flat Minima","created":"2026-07-09","cited_by_count":1,"area":null},{"id":"2303.14244","title":"Implicit Balancing and Regularization: Generalization and Convergence Guarantees for Overparameterized Asymmetric Matrix Sensing","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2402.03021","title":"Data-induced multiscale losses and efficient multirate gradient descent schemes","created":"2024-02-05","cited_by_count":0,"area":null},{"id":"2604.18202","title":"Centre manifold theorem for maps along manifolds of fixed points","created":"2026-04-20","cited_by_count":0,"area":null},{"id":"2606.15551","title":"A Bifurcation Theory Framework for Gradient Descent on the Edge of Stability","created":"2026-06-14","cited_by_count":0,"area":null}],"next_cursor":null}