{"total":184,"rows":[{"id":"2504.20571","title":"Reinforcement Learning for Reasoning in Large Language Models with One Training Example","created":"2025-04-29","cited_by_count":295,"area":"lr"},{"id":"2106.09647","title":"Deep Learning Through the Lens of Example Difficulty","created":"2021-06-17","cited_by_count":141,"area":null},{"id":"2110.08529","title":"Sharpness-Aware Minimization Improves Language Model Generalization","created":"2021-10-16","cited_by_count":108,"area":null},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107,"area":null},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2402.18762","title":"Disentangling the Causes of Plasticity Loss in Neural Networks","created":"2024-02-29","cited_by_count":86,"area":"deeprl"},{"id":"2104.09667","title":"Manipulating SGD with Data Ordering Attacks","created":"2021-04-19","cited_by_count":74,"area":"safety"},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2307.09542","title":"Can Neural Network Memorization Be Localized?","created":"2023-07-18","cited_by_count":69,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2503.08099","title":"Whoever Started the Interference Should End It: Guiding Data-Free Model Merging via Task Vectors","created":"2025-03-11","cited_by_count":62,"area":null},{"id":"2210.01513","title":"The Dynamics of Sharpness-Aware Minimization: Bouncing Across Ravines and Drifting Towards Wide Minima","created":"2022-10-04","cited_by_count":51,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2305.17490","title":"The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent","created":"2023-05-27","cited_by_count":44,"area":null},{"id":"2306.13812","title":"Maintaining Plasticity in Deep Continual Learning","created":"2023-06-23","cited_by_count":43,"area":null},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43,"area":null},{"id":"2102.04877","title":"Noisy Recurrent Neural Networks","created":"2021-02-09","cited_by_count":42,"area":null},{"id":"2202.02831","title":"Anticorrelated Noise Injection for Improved Generalization","created":"2022-02-06","cited_by_count":42,"area":null},{"id":"2507.07101","title":"Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful","created":"2025-07-09","cited_by_count":41,"area":null},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39,"area":null},{"id":"2305.16292","title":"Sharpness-Aware Minimization Leads to Low-Rank Features","created":"2023-05-25","cited_by_count":38,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2303.02749","title":"Revisiting the Noise Model of Stochastic Gradient Descent","created":"2023-03-05","cited_by_count":36,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2105.13343","title":"Drawing Multiple Augmentation Samples Per Image During Training Efficiently Decreases Test Error","created":"2021-05-27","cited_by_count":33,"area":null},{"id":"2307.07873","title":"Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferability","created":"2023-07-15","cited_by_count":32,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2106.13897","title":"Implicit Gradient Alignment in Distributed and Federated Learning","created":"2021-06-25","cited_by_count":29,"area":null},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2106.02588","title":"Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis","created":"2021-06-04","cited_by_count":25,"area":null},{"id":"2207.05952","title":"Implicit regularization of dropout","created":"2022-07-13","cited_by_count":25,"area":null},{"id":"2302.00849","title":"Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent","created":"2023-02-02","cited_by_count":25,"area":null},{"id":"2207.02099","title":"An Empirical Study of Implicit Regularization in Deep Offline RL","created":"2022-07-05","cited_by_count":24,"area":"offlinerl"},{"id":"2201.11066","title":"Server-Side Stepsizes and Sampling Without Replacement Provably Help in Federated Optimization","created":"2022-01-26","cited_by_count":23,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2202.01263","title":"NoisyMix: Boosting Model Robustness to Common Corruptions","created":"2022-02-02","cited_by_count":17,"area":null},{"id":"2502.11986","title":"Selective Task Group Updates for Multi-Task Optimization","created":"2025-02-17","cited_by_count":17,"area":null},{"id":"2507.12224","title":"Optimizers Qualitatively Alter Solutions And We Should Leverage This","created":"2025-07-16","cited_by_count":17,"area":null},{"id":"2110.02600","title":"Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning","created":"2021-10-06","cited_by_count":16,"area":null},{"id":"2210.02720","title":"Understanding Gradient Regularization in Deep Learning: Efficient Finite-Difference Computation and Implicit Bias","created":"2022-10-06","cited_by_count":16,"area":null},{"id":"2308.09543","title":"Latent State Models of Training Dynamics","created":"2023-08-18","cited_by_count":16,"area":null},{"id":"2210.00706","title":"Information-Theoretic Analysis of Unsupervised Domain Adaptation","created":"2022-10-03","cited_by_count":15,"area":null},{"id":"2306.02913","title":"Decentralized SGD and Average-direction SAM are Asymptotically Equivalent","created":"2023-06-05","cited_by_count":15,"area":null},{"id":"2306.17499","title":"The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks","created":"2023-06-30","cited_by_count":15,"area":null},{"id":"2309.13692","title":"Regularization and Optimal Multiclass Learning","created":"2023-09-24","cited_by_count":15,"area":null},{"id":"2105.13922","title":"Discretization Drift in Two-Player Games","created":"2021-05-28","cited_by_count":14,"area":null},{"id":"2206.02126","title":"Learning Dynamics and Generalization in Reinforcement Learning","created":"2022-06-05","cited_by_count":14,"area":null},{"id":"2210.15898","title":"Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis","created":"2022-10-28","cited_by_count":13,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2307.07785","title":"The Interpolating Information Criterion for Overparameterized Models","created":"2023-07-15","cited_by_count":12,"area":null},{"id":"2309.13885","title":"TouchUp-G: Improving Feature Representation through Graph-Centric Finetuning","created":"2023-09-25","cited_by_count":12,"area":null},{"id":"2401.10809","title":"Neglected Hessian component explains mysteries in Sharpness regularization","created":"2024-01-19","cited_by_count":12,"area":null},{"id":"2410.20957","title":"Neuro-symbolic Learning Yielding Logical Constraints","created":"2024-10-28","cited_by_count":12,"area":"lr"},{"id":"2502.05300","title":"Parameter Symmetry Potentially Unifies Deep Learning Theory","created":"2025-02-07","cited_by_count":12,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2310.01362","title":"Robot Fleet Learning via Policy Merging","created":"2023-10-02","cited_by_count":11,"area":null},{"id":"2406.09958","title":"Memory-Efficient Optimization with Factorized Hamiltonian Descent","created":"2024-06-14","cited_by_count":11,"area":null},{"id":"2104.04874","title":"SGD Implicitly Regularizes Generalization Error","created":"2021-04-10","cited_by_count":10,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2210.12864","title":"K-SAM: Sharpness-Aware Minimization at the Speed of SGD","created":"2022-10-23","cited_by_count":10,"area":null},{"id":"2306.08590","title":"Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning","created":"2023-06-14","cited_by_count":10,"area":null},{"id":"2310.15047","title":"Implicit meta-learning may lead language models to trust more reliable sources","created":"2023-10-23","cited_by_count":10,"area":null},{"id":"2502.20566","title":"Stochastic Rounding for LLM Training: Theory and Practice","created":"2025-02-27","cited_by_count":10,"area":null},{"id":"2105.10190","title":"AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks","created":"2021-05-21","cited_by_count":9,"area":null},{"id":"2505.12387","title":"Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning","created":"2025-05-18","cited_by_count":9,"area":null},{"id":"2602.01480","title":"Rod Flow: A Continuous-Time Model for Gradient Descent at the Edge of Stability","created":"2026-02-01","cited_by_count":9,"area":null},{"id":"2202.13733","title":"On the Benefits of Large Learning Rates for Kernel Methods","created":"2022-02-28","cited_by_count":8,"area":null},{"id":"2205.14546","title":"The Missing Invariance Principle Found -- the Reciprocal Twin of Invariant Risk Minimization","created":"2022-05-29","cited_by_count":8,"area":null},{"id":"2210.10452","title":"Rethinking Sharpness-Aware Minimization as Variational Inference","created":"2022-10-19","cited_by_count":8,"area":null},{"id":"2304.11446","title":"Fast Diffusion Probabilistic Model Sampling through the lens of Backward Error Analysis","created":"2023-04-22","cited_by_count":8,"area":"diffusion"},{"id":"2406.11110","title":"How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD","created":"2024-06-17","cited_by_count":8,"area":null},{"id":"2507.01098","title":"Proof of a perfect platonic representation hypothesis","created":"2025-07-01","cited_by_count":8,"area":null},{"id":"2111.04558","title":"Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes","created":"2021-11-08","cited_by_count":7,"area":null},{"id":"2111.15090","title":"The Geometric Occam's Razor Implicit in Deep Learning","created":"2021-11-30","cited_by_count":7,"area":null},{"id":"2112.03754","title":"A Continuous-time Stochastic Gradient Descent Method for Continuous Data","created":"2021-12-07","cited_by_count":7,"area":null},{"id":"2303.17940","title":"Per-Example Gradient Regularization Improves Learning Signals from Noisy Data","created":"2023-03-31","cited_by_count":7,"area":null},{"id":"2402.17759","title":"Towards Optimal Learning of Language Models","created":"2024-02-27","cited_by_count":7,"area":null},{"id":"2606.29554","title":"Optimizer Memory Makes Shuffle Order a First-Order Source of Fine-Tuning Noise","created":"2026-06-28","cited_by_count":7,"area":null},{"id":"2207.04922","title":"On uniform-in-time diffusion approximation for stochastic gradient descent","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2210.11318","title":"A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculture","created":"2022-10-20","cited_by_count":6,"area":null},{"id":"2308.12585","title":"Persistent learning signals and working memory without continuous attractors","created":"2023-08-24","cited_by_count":6,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2409.06142","title":"Variational Search Distributions","created":"2024-09-10","cited_by_count":6,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6,"area":null},{"id":"2502.02132","title":"How Memory in Optimization Algorithms Implicitly Modifies the Loss","created":"2025-02-04","cited_by_count":6,"area":null},{"id":"2507.22216","title":"Representation biases: will we achieve complete understanding by analyzing representations?","created":"2025-07-29","cited_by_count":6,"area":null},{"id":"2602.00693","title":"Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities","created":"2026-01-31","cited_by_count":6,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2302.11836","title":"On Statistical Properties of Sharpness-Aware Minimization: Provable Guarantees","created":"2023-02-23","cited_by_count":5,"area":null},{"id":"2309.02082","title":"Backward error analysis and the qualitative behaviour of stochastic optimization algorithms: Application to stochastic coordinate descent","created":"2023-09-05","cited_by_count":5,"area":null},{"id":"2310.14423","title":"A Quadratic Synchronization Rule for Distributed Deep Learning","created":"2023-10-22","cited_by_count":5,"area":null}],"next_cursor":"100"}