{"list":"other","total":66,"rows":[{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"2010.01412","title":"Sharpness-Aware Minimization for Efficiently Improving Generalization","created":"2020-10-03","cited_by_count":1417},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"1912.02178","title":"Fantastic Generalization Measures and Where to Find Them","created":"2019-12-04","cited_by_count":513},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"2102.11600","title":"ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks","created":"2021-02-23","cited_by_count":293},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"2106.01548","title":"When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations","created":"2021-06-03","cited_by_count":260},{"id":"2203.08065","title":"Surrogate Gap Minimization Improves Sharpness-Aware Training","created":"2022-03-15","cited_by_count":172},{"id":"2206.06232","title":"Towards Understanding Sharpness-Aware Minimization","created":"2022-06-13","cited_by_count":146},{"id":"2110.03141","title":"Efficient Sharpness-aware Minimization for Improved Training of Neural Networks","created":"2021-10-07","cited_by_count":137},{"id":"2203.02714","title":"Towards Efficient and Scalable Sharpness-Aware Minimization","created":"2022-03-05","cited_by_count":129},{"id":"1904.09080","title":"Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process","created":"2019-04-19","cited_by_count":123},{"id":"2106.06530","title":"Label Noise SGD Provably Prefers Flat Global Minimizers","created":"2021-06-11","cited_by_count":121},{"id":"2006.08157","title":"Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent","created":"2020-06-15","cited_by_count":119},{"id":"2110.08529","title":"Sharpness-Aware Minimization Improves Language Model Generalization","created":"2021-10-16","cited_by_count":108},{"id":"2110.06914","title":"What Happens after SGD Reaches Zero Loss? --A Mathematical Framework","created":"2021-10-13","cited_by_count":107},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102},{"id":"2205.14083","title":"Sharpness-Aware Training for Free","created":"2022-05-27","cited_by_count":95},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92},{"id":"2006.08680","title":"Shape Matters: Understanding the Implicit Bias of the Noise Covariance","created":"2020-06-15","cited_by_count":88},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86},{"id":"2206.04920","title":"Fisher SAM: Information Geometry and Sharpness Aware Minimisation","created":"2022-06-10","cited_by_count":84},{"id":"2010.04925","title":"Regularizing Neural Networks via Adversarial Model Perturbation","created":"2020-10-10","cited_by_count":78},{"id":"2202.00661","title":"When Do Flat Minima Optimizers Work?","created":"2022-02-01","cited_by_count":78},{"id":"1905.03684","title":"Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation","created":"2019-05-09","cited_by_count":71},{"id":"2210.05177","title":"Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach","created":"2022-10-11","cited_by_count":70},{"id":"2211.05729","title":"How Does Sharpness-Aware Minimization Minimize Sharpness?","created":"2022-11-10","cited_by_count":65},{"id":"2105.13462","title":"On Linear Stability of SGD and Input-Smoothness of Neural Networks","created":"2021-05-27","cited_by_count":63},{"id":"1910.04284","title":"Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin","created":"2019-10-09","cited_by_count":56},{"id":"2403.12350","title":"Friendly Sharpness-Aware Minimization","created":"2024-03-19","cited_by_count":53},{"id":"2210.01513","title":"The Dynamics of Sharpness-Aware Minimization: Bouncing Across Ravines and Drifting Towards Wide Minima","created":"2022-10-04","cited_by_count":51},{"id":"2305.17490","title":"The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent","created":"2023-05-27","cited_by_count":44},{"id":"2306.10711","title":"PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning","created":"2023-06-19","cited_by_count":42},{"id":"2307.11007","title":"Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization","created":"2023-07-20","cited_by_count":39},{"id":"2102.01117","title":"SGD Generalizes Better Than GD (And Regularization Doesn't Help)","created":"2021-02-01","cited_by_count":38},{"id":"2305.16292","title":"Sharpness-Aware Minimization Leads to Low-Rank Features","created":"2023-05-25","cited_by_count":38},{"id":"1608.04414","title":"Generalization of ERM in Stochastic Convex Optimization: The Dimension Strikes Back","created":"2016-08-15","cited_by_count":37},{"id":"2309.15639","title":"Enhancing Sharpness-Aware Optimization Through Variance Suppression","created":"2023-09-27","cited_by_count":37},{"id":"2202.13441","title":"Stability vs Implicit Bias of Gradient Methods on Separable Data and Beyond","created":"2022-02-27","cited_by_count":29},{"id":"2203.03756","title":"Flat minima generalize for low-rank matrix recovery","created":"2022-03-07","cited_by_count":28},{"id":"2310.07269","title":"Why Does Sharpness-Aware Minimization Generalize Better Than SGD?","created":"2023-10-11","cited_by_count":28},{"id":"2305.15287","title":"The Crucial Role of Normalization in Sharpness-Aware Minimization","created":"2023-05-24","cited_by_count":26},{"id":"2302.08692","title":"SAM operates far from home: eigenvalue regularization as a dynamical phenomenon","created":"2023-02-17","cited_by_count":24},{"id":"2308.06058","title":"Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction","created":"2023-08-11","cited_by_count":23},{"id":"2303.00565","title":"AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks","created":"2023-03-01","cited_by_count":21},{"id":"2306.09850","title":"Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima","created":"2023-06-16","cited_by_count":20},{"id":"2202.13361","title":"Benign Underfitting of Stochastic Gradient Descent","created":"2022-02-27","cited_by_count":19},{"id":"2204.12446","title":"Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD","created":"2022-04-26","cited_by_count":19},{"id":"1910.10844","title":"Diametrical Risk Minimization: Theory and Computations","created":"2019-10-24","cited_by_count":15},{"id":"2203.09962","title":"Randomized Sharpness-Aware Training for Boosting Computational Efficiency in Deep Learning","created":"2022-03-18","cited_by_count":14},{"id":"2301.06308","title":"Stability Analysis of Sharpness-Aware Minimization","created":"2023-01-16","cited_by_count":14},{"id":"2406.03682","title":"A Universal Class of Sharpness-Aware Minimization Algorithms","created":"2024-06-06","cited_by_count":14},{"id":"2504.04579","title":"From Continual Learning to SGD and Back: Better Rates for Continual Linear Models","created":"2025-04-06","cited_by_count":12},{"id":"2507.11274","title":"Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime","created":"2025-07-15","cited_by_count":12},{"id":"2311.05398","title":"The Sample Complexity Of ERMs In Stochastic Convex Optimization","created":"2023-11-09","cited_by_count":8},{"id":"2401.07250","title":"Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy","created":"2024-01-14","cited_by_count":8},{"id":"2410.10683","title":"SAMPa: Sharpness-aware Minimization Parallelized","created":"2024-10-14","cited_by_count":8},{"id":"2502.02407","title":"Avoiding spurious sharpness minimization broadens applicability of SAM","created":"2025-02-04","cited_by_count":8},{"id":"2401.12058","title":"The Dimension Strikes Back with Gradients: Generalization of Gradient Methods in Stochastic Convex Optimization","created":"2024-01-22","cited_by_count":6},{"id":"2404.04931","title":"The Sample Complexity of Gradient Descent in Stochastic Convex Optimization","created":"2024-04-07","cited_by_count":6},{"id":"2505.08306","title":"Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization","created":"2025-05-13","cited_by_count":3}],"next_cursor":null}