{"total":64,"rows":[{"id":"2511.00674","title":"Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?","created":"2025-11-01","cited_by_count":37,"area":null},{"id":"2502.19002","title":"The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training","created":"2025-02-26","cited_by_count":30,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2510.25000","title":"What Really Matters in Matrix-Whitening Optimizers?","created":"2025-10-28","cited_by_count":16,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2506.04805","title":"Adaptive Preconditioners Trigger Loss Spikes in Adam","created":"2025-06-05","cited_by_count":13,"area":null},{"id":"2604.14108","title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","created":"2026-04-15","cited_by_count":10,"area":null},{"id":"2505.12387","title":"Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning","created":"2025-05-18","cited_by_count":9,"area":null},{"id":"2506.02336","title":"Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression","created":"2025-06-03","cited_by_count":9,"area":null},{"id":"2507.09846","title":"Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training","created":"2025-07-14","cited_by_count":9,"area":null},{"id":"2602.01480","title":"Rod Flow: A Continuous-Time Model for Gradient Descent at the Edge of Stability","created":"2026-02-01","cited_by_count":9,"area":null},{"id":"2603.05002","title":"Non-Euclidean Gradient Descent Operates at the Edge of Stability","created":"2026-03-05","cited_by_count":9,"area":null},{"id":"2505.24275","title":"GradPower: Powering Gradients for Faster Language Model Pre-Training","created":"2025-05-30","cited_by_count":8,"area":null},{"id":"2601.16979","title":"A Scalable Measure of Loss Landscape Curvature for Analyzing the Training Dynamics of LLMs","created":"2026-01-23","cited_by_count":8,"area":null},{"id":"2602.09314","title":"Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory","created":"2026-02-10","cited_by_count":8,"area":null},{"id":"2602.22681","title":"Accelerating LLM Pre-Training through Flat-Direction Dynamics Enhancement","created":"2026-02-26","cited_by_count":8,"area":null},{"id":"2512.22768","title":"Understanding the Mechanisms of Fast Hyperparameter Transfer","created":"2025-12-28","cited_by_count":7,"area":null},{"id":"2605.26097","title":"Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay","created":"2026-05-25","cited_by_count":7,"area":"synth"},{"id":"2507.12837","title":"Understanding the Evolution of the Neural Tangent Kernel at the Edge of Stability","created":"2025-07-17","cited_by_count":6,"area":null},{"id":"2604.13627","title":"(How) Learning Rates Regulate Catastrophic Overtraining","created":"2026-04-15","cited_by_count":6,"area":null},{"id":"2506.06940","title":"Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More","created":"2025-06-07","cited_by_count":5,"area":null},{"id":"2510.17506","title":"Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares","created":"2025-10-20","cited_by_count":4,"area":null},{"id":"2604.09258","title":"Nexus: Same Pretraining Loss, Better Downstream Generalization via Common Minima","created":"2026-04-10","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2605.22432","title":"AMUSE: Anytime Muon with Stable Gradient Evaluation","created":"2026-05-21","cited_by_count":4,"area":null},{"id":"2607.22444","title":"Hyperball May Not Be a Free Lunch","created":"2026-07-24","cited_by_count":4,"area":null},{"id":"2510.18120","title":"Generalization Below the Edge of Stability: The Role of Data Geometry","created":"2025-10-20","cited_by_count":3,"area":null},{"id":"2606.18080","title":"Edge Flow: A Tractable and Predictive Continuous-Time Model for Gradient Descent at the Edge of Stability","created":"2026-06-16","cited_by_count":3,"area":null},{"id":"2506.12903","title":"Variational Learning Finds Flatter Solutions at the Edge of Stability","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2510.00236","title":"Per-example gradients: a new frontier for understanding and improving optimizers","created":"2025-09-30","cited_by_count":2,"area":null},{"id":"2605.06077","title":"Understanding diffusion models requires rethinking (again) generalization","created":"2026-05-07","cited_by_count":2,"area":"diffusion"},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2606.30930","title":"SGD at the Edge of Stability: Stochastic Stabilization with Large Learning Rates","created":"2026-06-29","cited_by_count":2,"area":null},{"id":"2602.05065","title":"Does SGD Seek Flatness or Sharpness? An Exactly Solvable Model","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2602.12471","title":"Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension","created":"2026-02-12","cited_by_count":1,"area":null},{"id":"2605.16622","title":"Does Weight Decay Enhance Training Stability?","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2606.05326","title":"Mean--Fluctuation Dynamics at the Edge of Stability","created":"2026-06-03","cited_by_count":1,"area":null},{"id":"2607.08380","title":"Dynamics of Gradient Descent with Large Step Size Near a Manifold of Flat Minima","created":"2026-07-09","cited_by_count":1,"area":null},{"id":"2607.23012","title":"Mini-batch Noise Lowers Sharpness via Dominant-Subspace Fluctuations","created":"2026-07-25","cited_by_count":1,"area":null},{"id":"2608.18415","title":"The Road Taken: The Role of Optimizers at the Edge of Stability","created":"2026-08-19","cited_by_count":1,"area":null},{"id":"2609.30957","title":"Towards Understanding Momentum Acceleration in River-Valley Loss Landscape","created":"2026-09-25","cited_by_count":1,"area":null},{"id":"2502.13110","title":"Feature Learning Beyond the Edge of Stability","created":"2025-02-18","cited_by_count":0,"area":null},{"id":"2510.04203","title":"Adaptive Federated Learning via Dynamical System Model","created":"2025-10-05","cited_by_count":0,"area":null},{"id":"2603.02620","title":"Same Error, Different Function: The Optimizer as an Implicit Prior in Financial Time Series","created":"2026-03-03","cited_by_count":0,"area":null},{"id":"2604.06366","title":"Stochastic Gradient Descent in the Saddle-to-Saddle Regime of Deep Linear Networks","created":"2026-04-07","cited_by_count":0,"area":null},{"id":"2604.14669","title":"Zeroth-Order Optimization at the Edge of Stability","created":"2026-04-16","cited_by_count":0,"area":null},{"id":"2605.19392","title":"Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2605.29983","title":"Improving Adversarial Robustness of Attribution via Implicit Regularization","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.05219","title":"Gradient Descent with Large Step Size Restores Symmetry in Deep Linear Networks with Multi-Pathway","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.24953","title":"How Complexity Contributes to Learning Opacity in Machine Learning","created":"2026-06-23","cited_by_count":0,"area":null},{"id":"2607.07884","title":"Optimal Learning Rate Scaling Depends on Data in Deep Scalar Linear Networks","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2608.21660","title":"Variational Structure at the Edge of Stability","created":"2026-08-21","cited_by_count":0,"area":null},{"id":"2608.25873","title":"How Edge of Stability Hinders SCAFFOLD in Federated Optimization","created":"2026-08-26","cited_by_count":0,"area":null},{"id":"2608.28442","title":"Curvature-Conditioned Multiscale Momentum with Sphere Constraints for LLM Pretraining","created":"2026-08-28","cited_by_count":0,"area":null},{"id":"2609.01034","title":"The Multiple Timescales of Gradient Descent on the Edge of Stability: A Perturbative Derivation of the Central Flow","created":"2026-09-01","cited_by_count":0,"area":null},{"id":"2609.18314","title":"Beyond Quadratic Loss: The Stability Phase Diagram of Adam","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.32290","title":"A Journey to the Edge of Stability","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.37745","title":"Optimizer-dependent training dynamics converge to the same one-third optimal data scaling","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2609.39767","title":"How Does Local Landscape Geometry Evolve in Language Model Pre-Training?","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.01459","title":"Tight Transition Time Bounds for Separable Logistic Regression at the Edge of Stability","created":"2026-10-01","cited_by_count":0,"area":null},{"id":"2610.03640","title":"Broken scale symmetries in undercomplete linear autoencoders","created":"2026-10-02","cited_by_count":0,"area":null},{"id":"2610.06120","title":"Mind the Drift: Diagonal Linear Networks Under Large Learning Rates","created":"2026-10-05","cited_by_count":0,"area":null},{"id":"2610.13524","title":"Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}