{"list":"other","total":61,"rows":[{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2012.12877","title":"Training data-efficient image transformers & distillation through attention","created":"2020-12-23","cited_by_count":4586},{"id":"2406.17557","title":"The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale","created":"2024-06-25","cited_by_count":1160},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"2002.09277","title":"Kernel and Rich Regimes in Overparametrized Models","created":"2020-02-20","cited_by_count":306},{"id":"1703.00887","title":"How to Escape Saddle Points Efficiently","created":"2017-03-02","cited_by_count":285},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"1901.06053","title":"A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks","created":"2019-01-18","cited_by_count":214},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"1904.13262","title":"Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks","created":"2019-04-30","cited_by_count":124},{"id":"2006.04740","title":"The Heavy-Tail Phenomenon in SGD","created":"2020-06-08","cited_by_count":124},{"id":"2106.09524","title":"Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity","created":"2021-06-17","cited_by_count":110},{"id":"1909.05122","title":"Implicit Regularization for Optimal Sparse Recovery","created":"2019-09-11","cited_by_count":80},{"id":"2410.21265","title":"Modular Duality in Deep Learning","created":"2024-10-28","cited_by_count":77},{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74},{"id":"2102.09769","title":"On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent","created":"2021-02-19","cited_by_count":70},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68},{"id":"2509.01440","title":"Benchmarking Optimizers for Large Language Model Pretraining","created":"2025-09-01","cited_by_count":68},{"id":"2304.00488","title":"Saddle-to-Saddle Dynamics in Diagonal Linear Networks","created":"2023-04-02","cited_by_count":57},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49},{"id":"1906.09069","title":"First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise","created":"2019-06-21","cited_by_count":44},{"id":"2002.08056","title":"The Geometry of Sign Gradient Descent","created":"2020-02-19","cited_by_count":41},{"id":"2502.04664","title":"Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data","created":"2025-02-07","cited_by_count":41},{"id":"2105.01650","title":"Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis","created":"2021-05-04","cited_by_count":39},{"id":"2207.04036","title":"Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent","created":"2022-07-08","cited_by_count":39},{"id":"1811.10331","title":"Hessian Riemannian gradient flows in convex programming","created":"2018-11-26","cited_by_count":26},{"id":"2205.12808","title":"Mirror Descent Maximizes Generalized Margin and Can Be Implemented Efficiently","created":"2022-05-25","cited_by_count":26},{"id":"2206.04613","title":"Explicit Regularization in Overparametrized Models via Noise Injection","created":"2022-06-09","cited_by_count":26},{"id":"2112.11027","title":"More is Less: Inducing Sparsity via Overparameterization","created":"2021-12-21","cited_by_count":24},{"id":"2410.22069","title":"Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks","created":"2024-10-29","cited_by_count":18},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15},{"id":"2602.07425","title":"Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise","created":"2026-02-07","cited_by_count":15},{"id":"2408.09966","title":"Mask in the Mirror: Implicit Sparsification","created":"2024-08-19","cited_by_count":14},{"id":"2605.11181","title":"Muon is Not That Special: Random or Inverted Spectra Work Just as Well","created":"2026-05-11","cited_by_count":14},{"id":"2305.05448","title":"Robust Implicit Regularization via Weight Normalization","created":"2023-05-09","cited_by_count":12},{"id":"2410.04870","title":"On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent","created":"2024-10-07","cited_by_count":12},{"id":"2504.12883","title":"Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?","created":"2025-04-17","cited_by_count":12},{"id":"2310.07235","title":"Are GATs Out of Balance?","created":"2023-10-11","cited_by_count":10},{"id":"2603.00742","title":"To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters","created":"2026-02-28","cited_by_count":10},{"id":"2603.14315","title":"Enhancing LLM Training via Spectral Clipping","created":"2026-03-15","cited_by_count":10},{"id":"2406.12763","title":"Implicit Bias of Mirror Flow on Separable Data","created":"2024-06-18","cited_by_count":9},{"id":"2404.12293","title":"Singular-limit analysis of gradient descent with noise injection","created":"2024-04-18","cited_by_count":7},{"id":"2411.12135","title":"Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects","created":"2024-11-19","cited_by_count":7},{"id":"2410.03988","title":"Implicit Bias of Mirror Flow for Shallow Neural Networks in Univariate Regression","created":"2024-10-05","cited_by_count":6},{"id":"2406.00418","title":"GATE: How to Keep Out Intrusive Neighbors","created":"2024-06-01","cited_by_count":5},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4},{"id":"2603.02064","title":"Never Saddle for Reparameterized Steepest Descent as Mirror Flow","created":"2026-03-02","cited_by_count":4},{"id":"2410.14158","title":"A Mirror Descent Perspective of Smoothed Sign Descent","created":"2024-10-18","cited_by_count":3},{"id":"2605.19458","title":"Implicit Bias of Mirror Flow in Homogeneous Neural Networks: Sparse and Dense Feature Learning","created":"2026-05-19","cited_by_count":3},{"id":"2606.27153","title":"DMuon: Efficient Distributed Muon Training with Near-Adam Overhead","created":"2026-06-25","cited_by_count":3},{"id":"2606.30509","title":"Muon learns balanced solutions in matrix factorization without slow saddle-to-saddle dynamics","created":"2026-06-29","cited_by_count":3},{"id":"2605.26977","title":"Convergence of Spectral Descent for Non-smooth Optimization","created":"2026-05-26","cited_by_count":2},{"id":"2606.14560","title":"Free Heavy-Tailed Lunch for Muon: A Theoretical Justification of Empirical Success","created":"2026-06-12","cited_by_count":2},{"id":"2606.15268","title":"When to use what Schatten-$p$ norm in deep learning?","created":"2026-06-13","cited_by_count":2},{"id":"2606.23198","title":"Incremental Learning in Mirror Flows","created":"2026-06-22","cited_by_count":2},{"id":"2607.03613","title":"Implicit Bias of SGD in Multivariate ReLU Networks: Effective Width Collapse","created":"2026-07-03","cited_by_count":2},{"id":"2605.09331","title":"Dimension-Free Saddle-Point Escape in Muon","created":"2026-05-10","cited_by_count":1},{"id":"2607.12332","title":"Gradient Flow Dynamics and Implicit Bias of Diagonal Linear Networks under Infinitesimal Initialization","created":"2026-07-14","cited_by_count":1}],"next_cursor":null}