{"total":92,"rows":[{"id":"2402.09963","title":"Why are Sensitive Functions Hard for Transformers?","created":"2024-02-15","cited_by_count":74,"area":null},{"id":"2307.11007","title":"Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization","created":"2023-07-20","cited_by_count":39,"area":null},{"id":"2306.04226","title":"Normalization Layers Are All That Sharpness-Aware Minimization Needs","created":"2023-06-07","cited_by_count":27,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2307.06966","title":"Layer-wise Linear Mode Connectivity","created":"2023-07-13","cited_by_count":22,"area":null},{"id":"2403.01874","title":"A Survey on Evaluation of Out-of-Distribution Generalization","created":"2024-03-04","cited_by_count":21,"area":null},{"id":"2405.03676","title":"Why is SAM Robust to Label Noise?","created":"2024-05-06","cited_by_count":21,"area":null},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17,"area":null},{"id":"2401.12033","title":"Momentum-SAM: Sharpness Aware Minimization without Computational Overhead","created":"2024-01-22","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2406.03682","title":"A Universal Class of Sharpness-Aware Minimization Algorithms","created":"2024-06-06","cited_by_count":14,"area":null},{"id":"2305.15659","title":"How to escape sharp minima with random perturbations","created":"2023-05-25","cited_by_count":13,"area":null},{"id":"2402.08508","title":"A PAC-Bayesian Link Between Generalisation and Flat Minima","created":"2024-02-13","cited_by_count":13,"area":null},{"id":"2410.06020","title":"QT-DoG: Quantization-aware Training for Domain Generalization","created":"2024-10-08","cited_by_count":13,"area":null},{"id":"2505.17646","title":"Unveiling the Basin-Like Loss Landscape in Large Language Models","created":"2025-05-23","cited_by_count":13,"area":null},{"id":"2505.24022","title":"The Rich and the Simple: On the Implicit Bias of Adam and SGD","created":"2025-05-29","cited_by_count":13,"area":null},{"id":"2603.16127","title":"Pre-training LLM without Learning Rate Decay Enhances Supervised Fine-Tuning","created":"2026-03-17","cited_by_count":13,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2605.02105","title":"Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting","created":"2026-05-04","cited_by_count":10,"area":null},{"id":"2405.20439","title":"Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning","created":"2024-05-30","cited_by_count":9,"area":null},{"id":"2401.07250","title":"Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy","created":"2024-01-14","cited_by_count":8,"area":null},{"id":"2509.17738","title":"Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking","created":"2025-09-22","cited_by_count":8,"area":null},{"id":"2306.13239","title":"The Inductive Bias of Flatness Regularization for Deep Matrix Factorization","created":"2023-06-22","cited_by_count":6,"area":null},{"id":"2310.03646","title":"TRAM: Bridging Trust Regions and Sharpness Aware Minimization","created":"2023-10-05","cited_by_count":6,"area":null},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6,"area":null},{"id":"2410.22656","title":"Tilted Sharpness-Aware Minimization","created":"2024-10-30","cited_by_count":6,"area":null},{"id":"2502.02132","title":"How Memory in Optimization Algorithms Implicitly Modifies the Loss","created":"2025-02-04","cited_by_count":6,"area":null},{"id":"2604.13627","title":"(How) Learning Rates Regulate Catastrophic Overtraining","created":"2026-04-15","cited_by_count":6,"area":null},{"id":"2606.04662","title":"Why Muon Outperforms Adam: A Curvature Perspective","created":"2026-06-03","cited_by_count":6,"area":null},{"id":"2306.07104","title":"Unveiling the Hessian's Connection to the Decision Boundary","created":"2023-06-12","cited_by_count":5,"area":null},{"id":"2311.06423","title":"Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatness","created":"2023-11-10","cited_by_count":5,"area":null},{"id":"2311.07013","title":"A PAC-Bayesian Perspective on the Interpolating Information Criterion","created":"2023-11-13","cited_by_count":5,"area":null},{"id":"2411.02139","title":"Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks","created":"2024-11-04","cited_by_count":5,"area":null},{"id":"2505.05409","title":"Hide & Seek: Transformer Symmetries Obscure Sharpness & Riemannian Geometry Finds It","created":"2025-05-08","cited_by_count":5,"area":null},{"id":"2506.06866","title":"SAFE: Finding Sparse and Flat Minima to Improve Pruning","created":"2025-06-07","cited_by_count":5,"area":null},{"id":"2506.06940","title":"Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More","created":"2025-06-07","cited_by_count":5,"area":null},{"id":"2309.16369","title":"Bringing the Discussion of Minima Sharpness to the Audio Domain: a Filter-Normalised Evaluation for Acoustic Scene Classification","created":"2023-09-28","cited_by_count":4,"area":null},{"id":"2405.15006","title":"A Rescaling-Invariant Lipschitz Bound Based on Path-Metrics for Modern ReLU Network Parameterizations","created":"2024-05-23","cited_by_count":4,"area":null},{"id":"2511.03548","title":"Flat Minima and Generalization: Insights from Stochastic Convex Optimization","created":"2025-11-05","cited_by_count":4,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2602.18116","title":"Cut Less, Fold More: Model Compression through the Lens of Projection Geometry","created":"2026-02-20","cited_by_count":4,"area":null},{"id":"2309.04788","title":"Stochastic Gradient Descent outperforms Gradient Descent in recovering a high-dimensional signal in a glassy energy landscape","created":"2023-09-09","cited_by_count":3,"area":null},{"id":"2311.15051","title":"Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults","created":"2023-11-25","cited_by_count":3,"area":null},{"id":"2406.16988","title":"MD tree: a model-diagnostic tree grown on loss landscape","created":"2024-06-24","cited_by_count":3,"area":null},{"id":"2407.12996","title":"Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance","created":"2024-07-17","cited_by_count":3,"area":null},{"id":"2504.18072","title":"A Model Zoo on Phase Transitions in Neural Networks","created":"2025-04-25","cited_by_count":3,"area":null},{"id":"2510.14231","title":"When Flatness Does (Not) Guarantee Adversarial Robustness","created":"2025-10-16","cited_by_count":3,"area":null},{"id":"2511.04808","title":"Sharp Minima Can Generalize: A Loss Landscape Perspective On Data","created":"2025-11-06","cited_by_count":3,"area":null},{"id":"2304.02688","title":"Going Further: Flatness at the Rescue of Early Stopping for Adversarial Example Transferability","created":"2023-04-05","cited_by_count":2,"area":null},{"id":"2311.08745","title":"Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization","created":"2023-11-15","cited_by_count":2,"area":null},{"id":"2401.12332","title":"A Precise Characterization of SGD Stability Using Loss Surface Geometry","created":"2024-01-22","cited_by_count":2,"area":null},{"id":"2407.03848","title":"Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks","created":"2024-07-04","cited_by_count":2,"area":null},{"id":"2408.14677","title":"Can Optimization Trajectories Explain Multi-Task Transfer?","created":"2024-08-26","cited_by_count":2,"area":null},{"id":"2505.11370","title":"Understanding Nonlinear Implicit Bias via Region Counts in Input Space","created":"2025-05-16","cited_by_count":2,"area":null},{"id":"2505.23866","title":"Towards Understanding The Calibration Benefits of Sharpness-Aware Minimization","created":"2025-05-29","cited_by_count":2,"area":null},{"id":"2510.04686","title":"How does the optimizer implicitly bias the model merging loss landscape?","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2512.21288","title":"Model Merging via Multi-Teacher Knowledge Distillation","created":"2025-12-24","cited_by_count":2,"area":"distill"},{"id":"2403.15210","title":"Early Period of Training Impacts Adaptation for Out-of-Distribution Generalization: An Empirical Study","created":"2024-03-22","cited_by_count":1,"area":null},{"id":"2405.12489","title":"Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks","created":"2024-05-21","cited_by_count":1,"area":null},{"id":"2405.12493","title":"Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks","created":"2024-05-21","cited_by_count":1,"area":null},{"id":"2409.09984","title":"Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate","created":"2024-09-16","cited_by_count":1,"area":null},{"id":"2410.16476","title":"In Search of the Successful Interpolation: On the Role of Sharpness in CLIP Generalization","created":"2024-10-21","cited_by_count":1,"area":null},{"id":"2506.17809","title":"Flatness After All?","created":"2025-06-21","cited_by_count":1,"area":null},{"id":"2510.07758","title":"R\\'enyi Sharpness: A Novel Sharpness that Strongly Correlates with Generalization","created":"2025-10-09","cited_by_count":1,"area":null},{"id":"2511.17918","title":"Do Flat Minima Improve Sparse Novel View Synthesis?","created":"2025-11-22","cited_by_count":1,"area":null},{"id":"2602.07135","title":"Landscaper: Understanding Loss Landscapes Through Multi-Dimensional Topological Analysis","created":"2026-02-06","cited_by_count":1,"area":null},{"id":"2602.23795","title":"GRAIL: Post-hoc Compensation by Linear Reconstruction for Compressed Networks","created":"2026-02-27","cited_by_count":1,"area":null},{"id":"2605.29153","title":"Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2609.01244","title":"Post-Training Science for Supervised Fine-Tuning","created":"2026-09-01","cited_by_count":1,"area":"moe"},{"id":"2310.01770","title":"A simple connection from loss flatness to compressed neural representations","created":"2023-10-03","cited_by_count":0,"area":null},{"id":"2403.05532","title":"Twin: Tuning Learning Rate and Weight Decay of Deep Homogeneous Classifiers without Validation","created":"2024-03-08","cited_by_count":0,"area":null},{"id":"2406.06700","title":"Forget Sharpness: Perturbed Forgetting of Model Biases Within SAM Dynamics","created":"2024-06-10","cited_by_count":0,"area":null},{"id":"2412.17613","title":"Can Stability be Detrimental? Better Generalization through Gradient Descent Instabilities","created":"2024-12-23","cited_by_count":0,"area":null},{"id":"2502.11071","title":"Generalization of the Gibbs algorithm with high probability at low temperatures","created":"2025-02-16","cited_by_count":0,"area":null},{"id":"2507.20424","title":"Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning","created":"2025-07-27","cited_by_count":0,"area":null},{"id":"2508.10435","title":"Unpacking the Implicit Norm Dynamics of Sharpness-Aware Minimization in Tensorized Models","created":"2025-08-14","cited_by_count":0,"area":null},{"id":"2510.02174","title":"Flatness-Aware Stochastic Gradient Langevin Dynamics","created":"2025-10-02","cited_by_count":0,"area":null},{"id":"2510.09034","title":"Convergence of optimizers implies eigenvalues filtering at equilibrium","created":"2025-10-10","cited_by_count":0,"area":null},{"id":"2510.18381","title":"S2AP: Score-space Sharpness Minimization for Adversarial Pruning","created":"2025-10-21","cited_by_count":0,"area":null},{"id":"2512.07676","title":"A Bootstrap Perspective on Stochastic Gradient Descent","created":"2025-12-08","cited_by_count":0,"area":null},{"id":"2602.23219","title":"Takeuchi's Information Criteria as Generalization Measures for DNNs Close to NTK Regime","created":"2026-02-26","cited_by_count":0,"area":null},{"id":"2603.09016","title":"An accurate flatness measure to estimate the generalization performance of CNN models","created":"2026-03-09","cited_by_count":0,"area":null},{"id":"2603.10048","title":"Revisiting Sharpness-Aware Minimization: A More Faithful and Effective Implementation","created":"2026-03-09","cited_by_count":0,"area":null},{"id":"2604.08192","title":"Inside-Out: Measuring Generalization in Vision Transformers Through Inner Workings","created":"2026-04-09","cited_by_count":0,"area":null},{"id":"2605.13652","title":"Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.29823","title":"Quantifying and Optimizing Simplicity via Polynomial Representations","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2605.31324","title":"Inconsistency-Aware Minimization: Improving Generalization with Unlabeled Data","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2607.06151","title":"Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning","created":"2026-07-07","cited_by_count":0,"area":null},{"id":"2607.28304","title":"Semi-Supervised Learning for Molecular Graphs via Ensemble Consensus","created":"2026-07-30","cited_by_count":0,"area":null},{"id":"2608.24568","title":"Across the Loss Landscape with Progressive Growth","created":"2026-08-25","cited_by_count":0,"area":null},{"id":"2609.39099","title":"A Generalisation Signal Need Not Be a Model-Selection Signal","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}